replace() for value substitution in Pandas - Step-by-Step Execution

Concept Flow - replace() for value substitution

Start with DataFrame

↓

Call replace() with mapping

↓

Check each cell value

↓

If value matches key in mapping?

No→Keep original value

Yes↓

Replace with mapped value

↓

Return new DataFrame with substitutions

The replace() method scans the DataFrame values and substitutes matching values with new ones based on a given mapping.

Execution Sample

Pandas

import pandas as pd

df = pd.DataFrame({'A': [1, 2, 3], 'B': [4, 2, 6]})
df_replaced = df.replace({2: 20, 4: 40})
print(df_replaced)

This code replaces all 2s with 20 and all 4s with 40 in the DataFrame.

Execution Table

Step	Cell Checked	Original Value	Match in Mapping?	Action	Resulting Value
1	Row 0, Col A	1	No	Keep original	1
2	Row 0, Col B	4	Yes	Replace with 40	40
3	Row 1, Col A	2	Yes	Replace with 20	20
4	Row 1, Col B	2	Yes	Replace with 20	20
5	Row 2, Col A	3	No	Keep original	3
6	Row 2, Col B	6	No	Keep original	6
7	End	-	-	-	Replacement complete

💡 All cells checked; replacements done where mapping matched.

Variable Tracker

Variable	Start	After Step 2	After Step 4	After Step 6	Final
df	[[1,4],[2,2],[3,6]]	[[1,40],[2,2],[3,6]]	[[1,40],[20,20],[3,6]]	[[1,40],[20,20],[3,6]]	[[1,40],[20,20],[3,6]]
df_replaced	Empty	[[1,40],[2,2],[3,6]]	[[1,40],[20,20],[3,6]]	[[1,40],[20,20],[3,6]]	[[1,40],[20,20],[3,6]]

Key Moments - 2 Insights

Why does replace() only change some values and not others?

Because replace() only substitutes values that exactly match keys in the mapping, as shown in execution_table rows 2, 3, and 4 where only 2 and 4 are replaced.

Does replace() change the original DataFrame?

No, replace() returns a new DataFrame with substitutions, leaving the original unchanged, as seen in variable_tracker where 'df' stays the same while 'df_replaced' changes.

Visual Quiz - 3 Questions

Look at the execution_table, what is the resulting value at Row 1, Column B after replacement?

A 2

B 20

C 40

D 6

💡 Hint

Check execution_table row 4 for Row 1, Col B value after replacement.

At which step does the first replacement happen according to the execution_table?

A Step 3

B Step 1

C Step 2

D Step 5

💡 Hint

Look at the 'Match in Mapping?' column to find the first 'Yes'.

If we add {3: 30} to the mapping, how would the final value at Row 2, Column A change?

A It becomes 30

B It becomes 20

C It stays 3

D It becomes 40

💡 Hint

Refer to variable_tracker for current value and think about how adding 3:30 affects replacements.

Concept Snapshot

replace(mapping) substitutes values in DataFrame
Only exact matches in mapping keys are replaced
Returns a new DataFrame, original stays unchanged
Mapping is a dict: {old_value: new_value}
Works element-wise across all columns

Full Transcript

The replace() method in pandas scans each cell in a DataFrame and replaces values that match keys in a given mapping dictionary with their corresponding new values. It returns a new DataFrame with these substitutions, leaving the original DataFrame unchanged. For example, if the mapping is {2: 20, 4: 40}, all 2s become 20 and all 4s become 40. The process checks each cell one by one, replacing only when a match is found. This method is useful for cleaning or updating data values quickly and safely.

Practice

1. What does the replace() method do in pandas?

easy

A. It sorts the DataFrame based on column values.

B. It deletes rows containing specific values.

C. It adds new columns to the DataFrame.

D. It swaps specified values in a DataFrame or Series with new values.

Solution

1. Step 1: Understand the purpose of replace()

   The replace() method is used to change specific values in pandas data structures.

2. Step 2: Compare with other options

   The other options describe sorting the DataFrame, deleting rows, and adding columns, which are unrelated to value substitution.

3. Final Answer:

   It swaps specified values in a DataFrame or Series with new values. -> Option D

4. Quick Check:

   replace() = value substitution [OK]

Hint: Remember: replace() swaps old values with new ones [OK]

Common Mistakes:

• Confusing replace() with drop() or sort_values()
• Thinking replace() adds or removes rows
• Assuming replace() changes column names

2. Which of the following is the correct syntax to replace all occurrences of 0 with 100 in a pandas Series s?

easy

A. s.replace([100], [0])

B. s.replace(100, 0)

C. s.replace(0, 100)

D. s.replace({100: 0})

Solution

1. Step 1: Identify the correct replace() syntax

   The syntax s.replace(old_value, new_value) replaces all old_value with new_value.

2. Step 2: Check each option

   s.replace(0, 100) correctly replaces 0 with 100. The other options reverse the values: s.replace(100, 0), s.replace([100], [0]), s.replace({100: 0}).

3. Final Answer:

   s.replace(0, 100) -> Option C

4. Quick Check:

   replace(old, new) = s.replace(0, 100) [OK]

Hint: Use s.replace(old_value, new_value) for single value swap [OK]

Common Mistakes:

• Swapping the old and new values by mistake
• Using dict with reversed keys and values
• Confusing list syntax with dict syntax

3. Given the DataFrame:

import pandas as pd
df = pd.DataFrame({'A': [1, 2, 3, 2], 'B': [4, 5, 2, 4]})
df_new = df.replace(2, 99)

What is the content of df_new?

medium

A. {'A': [1, 99, 3, 99], 'B': [4, 5, 99, 4]}

B. {'A': [1, 2, 3, 2], 'B': [4, 5, 2, 4]}

C. {'A': [99, 99, 99, 99], 'B': [99, 99, 99, 99]}

D. {'A': [1, 2, 3, 2], 'B': [4, 5, 99, 4]}

Solution

1. Step 1: Understand replace(2, 99) on DataFrame

   All occurrences of 2 in the DataFrame are replaced by 99.

2. Step 2: Apply replacement to each column

   Column 'A': 2 replaced by 99 at positions 1 and 3.
   Column 'B': 2 replaced by 99 at position 2.

3. Final Answer:

   {'A': [1, 99, 3, 99], 'B': [4, 5, 99, 4]} -> Option A

4. Quick Check:

   All 2s -> 99 in df_new [OK]

Hint: replace() changes all matching values in all columns [OK]

Common Mistakes:

• Assuming replace only affects one column
• Thinking original df changes without assignment
• Replacing only first occurrence instead of all

4. What is wrong with this code snippet?

df = pd.DataFrame({'X': [1, 2, 3]})
df.replace(2, 99)
print(df)

It is intended to replace 2 with 99 in column 'X'.

medium

A. The replace() method does not modify df unless inplace=True or reassigned.

B. The replace() method syntax is incorrect; it needs a dictionary.

C. The print statement should be before replace().

D. replace() cannot be used on DataFrames.

Solution

1. Step 1: Understand replace() behavior

   By default, replace() returns a new DataFrame and does not change the original unless inplace=True or reassigned.

2. Step 2: Analyze the code snippet

   The code calls replace() but does not assign the result back to df or use inplace=True, so df remains unchanged.

3. Final Answer:

   The replace() method does not modify df unless inplace=True or reassigned. -> Option A

4. Quick Check:

   replace() returns new object unless inplace=True [OK]

Hint: Always assign replace() result or use inplace=True [OK]

Common Mistakes:

• Expecting replace() to change original without assignment
• Using wrong syntax for replace()
• Thinking replace() works only on Series

5. You have a DataFrame:

df = pd.DataFrame({'Grade': ['A', 'B', 'C', 'D', 'F']})

You want to replace grades 'A' and 'B' with 'Pass' and 'C', 'D', 'F' with 'Fail' in one call. Which code does this correctly?

hard

A. df.replace(['A', 'B'], ['Pass', 'Pass']).replace(['C', 'D', 'F'], ['Fail', 'Fail', 'Fail'])

B. df.replace({'A': 'Pass', 'B': 'Pass', 'C': 'Fail', 'D': 'Fail', 'F': 'Fail'})

C. df.replace({'Pass': ['A', 'B'], 'Fail': ['C', 'D', 'F']})

D. df.replace({'A': 'Pass', 'B': 'Fail', 'C': 'Pass', 'D': 'Fail', 'F': 'Pass'})

Solution

1. Step 1: Understand replace() with dictionary mapping

   Using a dictionary with keys as old values and values as new values allows multiple replacements in one call.

2. Step 2: Check each option

   df.replace({'A': 'Pass', 'B': 'Pass', 'C': 'Fail', 'D': 'Fail', 'F': 'Fail'}) correctly maps each grade to 'Pass' or 'Fail'. df.replace(['A', 'B'], ['Pass', 'Pass']).replace(['C', 'D', 'F'], ['Fail', 'Fail', 'Fail']) uses two replace calls, which works but is two steps, not one call. df.replace({'Pass': ['A', 'B'], 'Fail': ['C', 'D', 'F']}) reverses keys and values, which is invalid. df.replace({'A': 'Pass', 'B': 'Fail', 'C': 'Pass', 'D': 'Fail', 'F': 'Pass'}) mixes mappings incorrectly.

3. Final Answer:

   df.replace({'A': 'Pass', 'B': 'Pass', 'C': 'Fail', 'D': 'Fail', 'F': 'Fail'}) -> Option B

4. Quick Check:

   Use dict in replace() for multiple value swaps [OK]

Hint: Use dict with old:new pairs for multiple replacements [OK]

Common Mistakes:

• Using lists instead of dict for multiple replacements
• Reversing keys and values in dict
• Chaining replace() unnecessarily