Setting a column as index in Pandas - Step-by-Step Execution

Concept Flow - Setting a column as index

Start with DataFrame

↓

Choose column to set as index

↓

Use set_index() method

↓

New DataFrame with chosen column as index

↓

Use DataFrame with new index for operations

You start with a table, pick a column, then use set_index() to make that column the row labels (index).

Execution Sample

Pandas

import pandas as pd

df = pd.DataFrame({
  'Name': ['Alice', 'Bob', 'Charlie'],
  'Age': [25, 30, 35]
})

new_df = df.set_index('Name')

This code creates a table with names and ages, then sets the 'Name' column as the index.

Execution Table

Step	Action	DataFrame State	Index Column	Output
1	Create DataFrame	Name | Age Alice | 25 Bob | 30 Charlie | 35	Default (0,1,2)	DataFrame with default index
2	Call set_index('Name')	Name | Age Alice | 25 Bob | 30 Charlie | 35	Name	New DataFrame with 'Name' as index
3	Resulting DataFrame	Age Name Alice | 25 Bob | 30 Charlie | 35	Name	Index set to 'Name' column

💡 Index is set to 'Name' column, replacing default numeric index.

Variable Tracker

Variable	Start	After set_index	Final
df	DataFrame with default index	Unchanged	Unchanged
new_df	Not defined	DataFrame with 'Name' as index	Same as after set_index

Key Moments - 2 Insights

Why does the original DataFrame 'df' not change after set_index?

Because set_index() returns a new DataFrame and does not modify 'df' unless you use inplace=True. See execution_table step 2 where 'df' remains unchanged.

What happens to the 'Name' column after setting it as index?

The 'Name' column becomes the index and is no longer a regular column in the new DataFrame, as shown in execution_table step 3.

Visual Quiz - 3 Questions

Look at the execution_table, what is the index of 'new_df' after step 2?

A 'Name' column values

B Default numeric index 0,1,2

C 'Age' column values

D Empty index

💡 Hint

Check the 'Index Column' column in execution_table row 2.

At which step does the 'Name' column become the index?

A Step 1

B Step 2

C Step 3

D Never

💡 Hint

Look at the 'Action' and 'Index Column' columns in execution_table.

If you want to change 'df' itself to have 'Name' as index, what should you do?

A Call df.set_index('Name') without assignment

B Use df.set_index('Name', inplace=True)

C Assign df = df.set_index('Name')

D Rename the 'Name' column

💡 Hint

See key_moments about set_index() returning a new DataFrame.

Concept Snapshot

Use df.set_index('column_name') to make a column the index.
This returns a new DataFrame; original stays same unless inplace=True.
The chosen column becomes row labels, not a regular column.
Useful for faster lookups and clearer data organization.

Full Transcript

We start with a DataFrame having default numeric index. We pick a column, here 'Name', to become the index. Using set_index('Name') creates a new DataFrame where 'Name' is the index. The original DataFrame remains unchanged unless we assign the result back or use inplace=True. The 'Name' column moves from being a regular column to the row labels, making data easier to access by name.

Practice

1. What does the set_index() method do in pandas?

easy

A. It sorts the DataFrame by a column.

B. It deletes a column from the DataFrame.

C. It adds a new column to the DataFrame.

D. It sets a specified column as the index of the DataFrame.

Solution

1. Step 1: Understand the purpose of set_index()

   The set_index() method changes the row labels to the values of a specified column.

2. Step 2: Compare with other options

   Options A, B, and D describe different DataFrame operations, not setting the index.

3. Final Answer:

   It sets a specified column as the index of the DataFrame. -> Option D

4. Quick Check:

   set_index() changes row labels to a column [OK]

Hint: Remember: set_index() changes row labels to a column [OK]

Common Mistakes:

• Confusing set_index() with drop() method
• Thinking set_index() adds a new column
• Assuming set_index() sorts data

2. Which of the following is the correct syntax to set the column 'Name' as the index of DataFrame df without modifying df itself?

easy

A. df.set_index('Name', inplace=True)

B. df.set_index('Name')

C. df.set_index(Name, inplace=False)

D. df.set_index('Name', drop=False)

Solution

1. Step 1: Understand inplace parameter

   By default, inplace=False, so df.set_index('Name') returns a new DataFrame without changing df.

2. Step 2: Analyze options

   df.set_index('Name', inplace=True) modifies df inplace. df.set_index('Name', inplace=False) is invalid because inplace=False is default and usually omitted. df.set_index('Name', drop=False) keeps the column but does not specify inplace, so it returns a new DataFrame.

3. Final Answer:

   df.set_index('Name') -> Option B

4. Quick Check:

   Default inplace=False means returns new DataFrame [OK]

Hint: Omit inplace to keep original DataFrame unchanged [OK]

Common Mistakes:

• Using inplace=True when wanting a new DataFrame
• Confusing drop parameter with inplace
• Adding invalid parameters

3. Given the DataFrame df below:

   ID  Score
0  101     88
1  102     92
2  103     85

What will be the output of df.set_index('ID')?

medium

A. ID Score
0 101 88
1 102 92
2 103 85

B. ID Score
0 101 88
1 102 92
2 103 85

C. Score
ID
101 88
102 92
103 85

D. Score
ID
0 88
1 92
2 85

Solution

1. Step 1: Understand set_index('ID')

   This sets the 'ID' column as the index, so 'ID' values become row labels and are no longer columns.

2. Step 2: Check output format

   The resulting DataFrame shows 'Score' as the only column, indexed by 'ID' values 101, 102, 103.

3. Final Answer:

   Score ID 101 88 102 92 103 85 -> Option C

4. Quick Check:

   set_index moves column to index =

        Score
   ID          
   101      88
   102      92
   103      85

   [OK]

Hint: Index column moves from data to row labels [OK]

Common Mistakes:

• Expecting the index column to remain as a data column
• Confusing output with original DataFrame
• Misreading index as a new column

4. You run the code:

df.set_index('Age', inplace=True)

but get a KeyError: 'Age'. What is the most likely cause?

medium

A. The column 'Age' does not exist in the DataFrame.

B. You forgot to import pandas.

C. You need to reset the index before setting a new one.

D. The inplace parameter must be False.

Solution

1. Step 1: Understand KeyError meaning

   A KeyError means the specified key (column) is not found in the DataFrame.

2. Step 2: Analyze options

   The column 'Age' does not exist in the DataFrame. correctly identifies the missing column. You forgot to import pandas. is unrelated to KeyError. You need to reset the index before setting a new one. is unnecessary; you can set any existing column as index. The inplace parameter must be False. is incorrect; inplace can be True or False.

3. Final Answer:

   The column 'Age' does not exist in the DataFrame. -> Option A

4. Quick Check:

   KeyError means missing column [OK]

Hint: Check column names before set_index to avoid KeyError [OK]

Common Mistakes:

• Assuming inplace=True causes KeyError
• Ignoring column name typos
• Thinking reset_index is required first

5. You have a DataFrame df with columns ['City', 'Population', 'Area']. You want to set 'City' as the index but keep it as a column too. Which code achieves this?

hard

A. df.set_index('City', drop=False, inplace=True)

B. df.set_index('City', inplace=True)

C. df.set_index('City', drop=True, inplace=False)

D. df.set_index('City', keep=True)

Solution

1. Step 1: Understand drop parameter

   By default, drop=True removes the column from data when setting it as index. To keep it, use drop=False.

2. Step 2: Apply inplace to modify original DataFrame

   Using inplace=True changes df directly.

3. Step 3: Analyze options

   df.set_index('City', drop=False, inplace=True) correctly uses drop=False and inplace=True. df.set_index('City', inplace=True) drops the column. df.set_index('City', drop=True, inplace=False) returns new DataFrame but drops column. df.set_index('City', keep=True) uses invalid parameter keep.

4. Final Answer:

   df.set_index('City', drop=False, inplace=True) -> Option A

5. Quick Check:

   drop=False keeps column when setting index [OK]

Hint: Use drop=False to keep column when setting index [OK]

Common Mistakes:

• Forgetting drop=False to keep the column
• Using invalid parameters like keep=True
• Not using inplace when wanting to modify original DataFrame