Renaming columns in Data Analysis Python - Time & Space Complexity

Time Complexity: Renaming columns

O(n)

Understanding Time Complexity

We want to see how the time it takes to rename columns changes as the number of columns grows.

How does the work increase when we rename more columns?

Scenario Under Consideration

Analyze the time complexity of the following code snippet.

import pandas as pd

df = pd.DataFrame({f'col{i}': range(10) for i in range(1000)})

new_names = {f'col{i}': f'new_col{i}' for i in range(1000)}
df.rename(columns=new_names, inplace=True)

This code creates a DataFrame with 1000 columns and renames all columns using a dictionary mapping.

Identify Repeating Operations

• Primary operation: Renaming each column by looking it up in the dictionary and updating its name.
• How many times: Once for each column, so 1000 times in this example.

How Execution Grows With Input

As the number of columns increases, the time to rename grows roughly in the same way.

Input Size (n)	Approx. Operations
10	About 10 lookups and renames
100	About 100 lookups and renames
1000	About 1000 lookups and renames

Pattern observation: The work grows directly with the number of columns; doubling columns roughly doubles the work.

Final Time Complexity

Time Complexity: O(n)

This means the time to rename columns grows linearly with the number of columns.

Common Mistake

[X] Wrong: "Renaming columns is instant no matter how many columns there are."

[OK] Correct: Each column must be checked and renamed, so more columns mean more work and more time.

Interview Connect

Understanding how operations scale with data size helps you write efficient data code and explain your choices clearly.

Self-Check

"What if we rename only a few columns instead of all? How would the time complexity change?"

Practice

1. What does the df.rename(columns={'old': 'new'}) function do in pandas?

easy

A. It sorts the DataFrame by the column 'old'.

B. It deletes the column named 'old' from the DataFrame.

C. It adds a new column named 'new' with values from 'old'.

D. It changes the column name from 'old' to 'new' in the DataFrame.

Solution

1. Step 1: Understand the rename function

   The rename method changes column names based on a dictionary mapping old names to new names.

2. Step 2: Identify the effect of the dictionary

   The dictionary {'old': 'new'} means the column named 'old' will be renamed to 'new'.

3. Final Answer:

   It changes the column name from 'old' to 'new' in the DataFrame. -> Option D

4. Quick Check:

   Rename columns = change names [OK]

Hint: Rename columns using a dictionary with old:new pairs [OK]

Common Mistakes:

• Thinking rename deletes columns
• Confusing rename with adding columns
• Assuming rename sorts data

2. Which of the following is the correct syntax to rename column 'A' to 'Alpha' in a pandas DataFrame df?

easy

A. df.rename('A' to 'Alpha')

B. df.rename(columns={'A': 'Alpha'}, inplace=True)

C. df.rename_columns('A', 'Alpha')

D. df.columns.rename('A', 'Alpha')

Solution

1. Step 1: Recall pandas rename syntax

   The correct syntax uses df.rename(columns={old_name: new_name}, inplace=True) to rename columns.

2. Step 2: Match the syntax to options

   df.rename(columns={'A': 'Alpha'}, inplace=True) matches the correct syntax exactly, including inplace=True to change the original DataFrame.

3. Final Answer:

   df.rename(columns={'A': 'Alpha'}, inplace=True) -> Option B

4. Quick Check:

   Use rename with columns dict and inplace [OK]

Hint: Use rename(columns={old:new}, inplace=True) to rename columns [OK]

Common Mistakes:

• Using wrong method names like rename_columns
• Missing columns= keyword
• Forgetting inplace=True to apply changes

3. Given the DataFrame df below:

import pandas as pd
df = pd.DataFrame({'X': [1,2], 'Y': [3,4]})
df.rename(columns={'X': 'A', 'Y': 'B'}, inplace=True)
print(df.columns.tolist())

What is the output?

medium

A. ['A', 'B']

B. ['X', 'Y']

C. ['X', 'B']

D. ['A', 'Y']

Solution

1. Step 1: Understand the rename operation

   The rename changes 'X' to 'A' and 'Y' to 'B' in the DataFrame columns.

2. Step 2: Check inplace=True effect

   Since inplace=True, the original DataFrame columns are updated.

3. Final Answer:

   ['A', 'B'] -> Option A

4. Quick Check:

   Renamed columns list = ['A', 'B'] [OK]

Hint: inplace=True updates columns immediately [OK]

Common Mistakes:

• Ignoring inplace=True and expecting old names
• Partial renaming confusion
• Printing DataFrame instead of columns

4. What is wrong with this code snippet?

df.rename({'old_name': 'new_name'}, inplace=True)

medium

A. The dictionary keys and values are reversed.

B. inplace=True is not a valid argument for rename.

C. The dictionary should be passed to the columns parameter.

D. The rename method cannot rename columns.

Solution

1. Step 1: Check rename method parameters

   The rename method requires the dictionary to be passed with the keyword columns= to rename columns.

2. Step 2: Identify the error in the code

   The code passes the dictionary as a positional argument without specifying columns=, so it will not rename columns.

3. Final Answer:

   The dictionary should be passed to the columns parameter. -> Option C

4. Quick Check:

   Use columns= to rename columns [OK]

Hint: Always use columns= when renaming columns [OK]

Common Mistakes:

• Passing dictionary without columns= keyword
• Confusing inplace argument
• Thinking rename can't change columns

5. You have a DataFrame df with columns ['temp', 'humidity', 'pressure']. You want to rename only 'temp' to 'temperature' without changing other columns. Which code correctly does this and keeps the change in df?

hard

A. df.rename(columns={'temp': 'temperature'}, inplace=True)

B. df.columns = ['temperature', 'humidity', 'pressure', 'wind']

C. df.rename({'temp': 'temperature'})

D. df.rename(columns={'temp': 'temperature'})

Solution

1. Step 1: Identify correct rename syntax with inplace

   To rename a single column and keep changes in the original DataFrame, use rename(columns={...}, inplace=True).

2. Step 2: Check other options

   df.columns = ['temperature', 'humidity', 'pressure', 'wind'] replaces all columns, which is risky. Options C and D do not use inplace=True, so changes won't persist in df.

3. Final Answer:

   df.rename(columns={'temp': 'temperature'}, inplace=True) -> Option A

4. Quick Check:

   Use inplace=True to keep rename changes [OK]

Hint: Use inplace=True to save rename changes in original DataFrame [OK]

Common Mistakes:

• Replacing all columns instead of renaming one
• Forgetting inplace=True to save changes
• Using rename without columns= keyword