apply() with lambda functions in Pandas - Step-by-Step Execution

Concept Flow - apply() with lambda functions

Start with DataFrame

↓

Define lambda function

↓

Call apply() on DataFrame/Series

↓

apply() sends each element/row/column to lambda

↓

Lambda processes element and returns result

↓

apply() collects all results

↓

Return new Series/DataFrame with results

apply() takes a lambda function and runs it on each element, row, or column of a DataFrame or Series, returning the processed results.

Execution Sample

Pandas

import pandas as pd

df = pd.DataFrame({'A': [1, 2], 'B': [3, 4]})
result = df['A'].apply(lambda x: x * 2)
print(result)

This code doubles each value in column 'A' using apply() with a lambda function.

Execution Table

Step	Input to lambda (x)	Lambda operation	Lambda output	Result Series state
1	1	1 * 2	2	0: 2
2	2	2 * 2	4	0: 2, 1: 4
3	End of Series	No operation	N/A	Final Series: [2, 4]

💡 All elements in Series 'A' processed; apply() returns new Series with doubled values.

Variable Tracker

Variable	Start	After 1	After 2	Final
x	N/A	1	2	N/A
result	Empty	[2]	[2, 4]	[2, 4]

Key Moments - 2 Insights

Why does apply() return a new Series instead of modifying the original?

apply() creates a new Series with the results of the lambda function, leaving the original data unchanged, as shown in execution_table rows 1-3.

What does the lambda function receive as input during apply()?

The lambda receives each element of the Series one by one, as seen in execution_table column 'Input to lambda (x)'.

Visual Quiz - 3 Questions

Look at the execution table, what is the lambda output when x is 2?

A 2

B 4

C 6

D 8

💡 Hint

Check the row where Input to lambda (x) is 2 in the execution_table.

At which step does the result Series first contain the value 2?

A Step 1

B Step 2

C Step 3

D Never

💡 Hint

Look at the 'Result Series state' column in the execution_table.

If the lambda was changed to 'lambda x: x + 1', what would be the final result Series?

A [3, 4]

B [1, 2]

C [2, 3]

D [4, 5]

💡 Hint

Add 1 to each original value in variable_tracker for 'x' after each step.

Concept Snapshot

apply() runs a lambda on each element of a Series or DataFrame.
Syntax: df['col'].apply(lambda x: operation)
Returns a new Series with results.
Original data stays unchanged.
Useful for quick element-wise transformations.

Full Transcript

We start with a DataFrame and want to change values in one column. We define a lambda function that doubles a number. Using apply(), we send each value in the column to the lambda. The lambda returns the doubled value. apply() collects these results into a new Series. The original column stays the same. This process is step-by-step shown in the execution table and variable tracker. Beginners often wonder why the original data doesn't change or what the lambda receives. The quiz questions help check understanding of these steps.

Practice

1. What does the apply() function with a lambda do in pandas?

easy

A. It sorts the DataFrame by column values.

B. It applies a small function to each element in a DataFrame column or row.

C. It merges two DataFrames based on a key.

D. It creates a new DataFrame from scratch.

Solution

1. Step 1: Understand the purpose of apply() with lambda

   The apply() method lets you run a function on each element or row/column of a DataFrame or Series.

2. Step 2: Recognize what lambda does

   A lambda is a small anonymous function used inside apply() to specify what to do with each element.

3. Final Answer:

   It applies a small function to each element in a DataFrame column or row. -> Option B

4. Quick Check:

   apply() + lambda = element-wise function [OK]

Hint: apply() runs a function on each item quickly [OK]

Common Mistakes:

• Thinking apply() sorts data
• Confusing apply() with merge or join
• Believing apply() creates new DataFrames

2. Which of the following is the correct syntax to use apply() with a lambda on a pandas Series named data to double each value?

easy

A. data.apply(lambda x: x * 2)

B. data.apply(x => x * 2)

C. apply(data, lambda x: x * 2)

D. data.apply(lambda x x * 2)

Solution

1. Step 1: Recall correct lambda syntax in Python

   Python lambda functions use the format lambda x: expression, so lambda x: x * 2 is correct.

2. Step 2: Check apply() usage on Series

   The method call is data.apply(lambda x: x * 2). Other options have syntax errors or wrong order.

3. Final Answer:

   data.apply(lambda x: x * 2) -> Option A

4. Quick Check:

   Correct lambda syntax = data.apply(lambda x: x * 2) [OK]

Hint: Use colon after lambda parameter: lambda x: ... [OK]

Common Mistakes:

• Using arrow syntax (=>) from other languages
• Missing colon after lambda parameter
• Calling apply() as a standalone function

3. Given the DataFrame:

import pandas as pd
df = pd.DataFrame({'A': [1, 2, 3]})
df['B'] = df['A'].apply(lambda x: x + 5)
print(df)

What is the output?

medium

A. Error: lambda function syntax

B. A B
0 1 5
1 2 6
2 3 7

C. A B
0 1 6
1 2 7
2 3 8

D. A B
0 6 1
1 7 2
2 8 3

Solution

1. Step 1: Understand the lambda function applied

   The lambda adds 5 to each value in column 'A'. So 1+5=6, 2+5=7, 3+5=8.

2. Step 2: Check DataFrame after assignment

   Column 'B' gets these new values, while 'A' remains unchanged.

3. Final Answer:

   A B 0 1 6 1 2 7 2 3 8 -> Option C

4. Quick Check:

   Original + 5 = New column [OK]

Hint: apply() changes each value as per lambda [OK]

Common Mistakes:

• Mixing up columns A and B
• Forgetting to add 5 inside lambda
• Expecting error from correct syntax

4. What is wrong with this code snippet?

df['C'] = df['A'].apply(lambda x x * 3)

medium

A. Missing colon after lambda parameter causes syntax error.

B. apply() cannot be used on DataFrame columns.

C. lambda functions cannot multiply values.

D. Column 'C' does not exist yet.

Solution

1. Step 1: Check lambda function syntax

   Python lambda requires a colon after parameters: lambda x: x * 3. The code misses the colon.

2. Step 2: Understand error cause

   Missing colon causes a syntax error, so code won't run.

3. Final Answer:

   Missing colon after lambda parameter causes syntax error. -> Option A

4. Quick Check:

   lambda syntax error = missing colon [OK]

Hint: Always put colon after lambda parameters [OK]

Common Mistakes:

• Forgetting colon after lambda parameter
• Thinking apply() can't be used on columns
• Assuming new columns must exist before assignment

5. You have a DataFrame df with a column 'score' containing numbers. You want to create a new column 'grade' that says 'Pass' if the score is 50 or more, and 'Fail' otherwise. Which code correctly uses apply() with a lambda to do this?

hard

A. df['grade'] = df.apply(lambda x: 'Pass' if x['score'] >= 50 else 'Fail')

B. df['grade'] = df['score'].apply(lambda x: if x >= 50 then 'Pass' else 'Fail')

C. df['grade'] = df['score'].apply(lambda x: x >= 50 ? 'Pass' : 'Fail')

D. df['grade'] = df['score'].apply(lambda x: 'Pass' if x >= 50 else 'Fail')

Solution

1. Step 1: Understand conditional expression in lambda

   Python uses value_if_true if condition else value_if_false syntax inside lambda.

2. Step 2: Check application target and syntax

   Applying to the Series df['score'] with lambda x: 'Pass' if x >= 50 else 'Fail' is correct, as x is each scalar score. Applying to the whole df (without axis=1) passes column Series to lambda, where x['score'] causes KeyError. Syntaxes like ? : ternary or if-then are invalid in Python.

3. Final Answer:

   df['grade'] = df['score'].apply(lambda x: 'Pass' if x >= 50 else 'Fail') -> Option D

4. Quick Check:

   Correct if-else in lambda = df['grade'] = df['score'].apply(lambda x: 'Pass' if x >= 50 else 'Fail') [OK]

Hint: Use Python's if-else inside lambda: val_if_true if cond else val_if_false [OK]

Common Mistakes:

• Using ?: ternary operator from other languages
• Applying lambda on whole DataFrame without axis
• Writing if-else without proper Python syntax