Why custom functions matter in Pandas - Visual Breakdown

Concept Flow - Why custom functions matter

Start with raw data

↓

Define custom function

↓

Apply function to data

↓

Get transformed data

↓

Use transformed data for analysis

We start with raw data, create a custom function to transform it, apply this function to the data, and then use the transformed data for analysis.

Execution Sample

Pandas

import pandas as pd

def double(x):
    return x * 2

df = pd.DataFrame({'A': [1, 2, 3]})
df['B'] = df['A'].apply(double)

This code doubles each value in column 'A' and stores the result in a new column 'B'.

Execution Table

Step	Action	Input	Output	Notes
1	Create DataFrame	{'A': [1, 2, 3]}	DataFrame with column A: [1, 2, 3]	Initial data setup
2	Define function double(x)	x = value from column A	Returns x * 2	Function ready to use
3	Apply double to first row	x=1	2	First value doubled
4	Apply double to second row	x=2	4	Second value doubled
5	Apply double to third row	x=3	6	Third value doubled
6	Assign results to new column B	Values [2, 4, 6]	DataFrame with columns A and B	Transformation complete

💡 All rows processed, function applied to entire column.

Variable Tracker

Variable	Start	After 1	After 2	After 3	Final
df['A']	[1, 2, 3]	[1, 2, 3]	[1, 2, 3]	[1, 2, 3]	[1, 2, 3]
df['B']	[]	[]	[2]	[2, 4]	[2, 4, 6]

Key Moments - 2 Insights

Why do we need to define a custom function instead of writing the operation directly?

Defining a custom function lets us reuse the same logic easily on many values, as shown in steps 3 to 5 where the function is applied to each row.

What happens if we forget to assign the result back to the DataFrame?

If we don't assign the output (step 6), the transformed data won't be saved, so the DataFrame stays unchanged, as seen in the variable tracker where df['B'] would remain empty.

Visual Quiz - 3 Questions

Look at the execution table, what is the output when the function is applied to the second row?

A 4

B 3

C 2

D 6

💡 Hint

Check step 4 in the execution table where input x=2 produces output 4.

At which step is the new column 'B' created in the DataFrame?

A Step 2

B Step 3

C Step 6

D Step 5

💡 Hint

Step 6 shows assigning the results to column B.

If the function doubled the values incorrectly by adding 2 instead of multiplying by 2, what would be the output for the first row?

A 2

B 3

C 1

D 4

💡 Hint

Look at the input 1 and imagine adding 2 instead of multiplying by 2.

Concept Snapshot

Custom functions let you reuse code to transform data easily.
Define a function with def, then apply it to DataFrame columns.
Use df['col'].apply(func) to run it on each value.
Assign the result back to save changes.
This keeps code clean and flexible.

Full Transcript

We start with a DataFrame containing numbers. We define a custom function called double that multiplies a number by two. Then, we apply this function to each value in column 'A' using the apply method. The results are stored in a new column 'B'. This process shows why custom functions matter: they let us reuse logic easily and keep our code clean. Without assigning the results back, the DataFrame would not change. The execution table traces each step, showing inputs and outputs clearly.

Practice

1. Why do we use custom functions when working with pandas DataFrames?

easy

A. To reuse code and make data changes clear and simple

B. To make the DataFrame larger automatically

C. To delete all data quickly

D. To change the pandas version

Solution

1. Step 1: Understand the purpose of custom functions

   Custom functions let us write a piece of code once and use it many times, which saves effort.

2. Step 2: Connect to pandas usage

   In pandas, custom functions help apply the same change or calculation to many rows or columns easily and clearly.

3. Final Answer:

   To reuse code and make data changes clear and simple -> Option A

4. Quick Check:

   Custom functions improve code reuse and clarity [OK]

Hint: Custom functions simplify repeated data changes [OK]

Common Mistakes:

• Thinking custom functions automatically change DataFrame size
• Believing custom functions delete data
• Confusing custom functions with pandas version control

2. Which of the following is the correct way to define a simple custom function in Python to double a number?

easy

A. function double(x) { return x * 2 }

B. def double x: return x * 2

C. def double(x): return x * 2

D. double = x => x * 2

Solution

1. Step 1: Identify Python function syntax

   Python functions start with 'def', followed by the function name and parentheses with parameters.

2. Step 2: Check each option

   def double(x): return x * 2 uses correct Python syntax. function double(x) { return x * 2 } is JavaScript syntax. def double x: return x * 2 misses parentheses. double = x => x * 2 is JavaScript arrow function syntax.

3. Final Answer:

   def double(x): return x * 2 -> Option C

4. Quick Check:

   Python function syntax = def name(params): [OK]

Hint: Python functions start with 'def' and use parentheses [OK]

Common Mistakes:

• Using JavaScript syntax in Python
• Omitting parentheses in function definition
• Confusing arrow functions with Python syntax

3. Given the code below, what will be the output of df['new']?

import pandas as pd
def add_five(x):
    return x + 5
df = pd.DataFrame({'num': [1, 2, 3]})
df['new'] = df['num'].apply(add_five)
print(df['new'])

medium

A. [1, 2, 3]

B. [6, 7, 8]

C. [5, 6, 7]

D. Error: add_five is not defined

Solution

1. Step 1: Understand the function add_five

   The function adds 5 to the input number.

2. Step 2: Apply the function to each element in 'num'

   Applying add_five to [1, 2, 3] results in [6, 7, 8].

3. Final Answer:

   [6, 7, 8] -> Option B

4. Quick Check:

   1+5=6, 2+5=7, 3+5=8 [OK]

Hint: Apply adds function result to each element [OK]

Common Mistakes:

• Thinking apply changes original column without assignment
• Confusing function name or missing definition
• Expecting original values without addition

4. What is wrong with this code snippet?

import pandas as pd
def multiply_by_two(x):
    x * 2
df = pd.DataFrame({'val': [4, 5, 6]})
df['result'] = df['val'].apply(multiply_by_two)
print(df['result'])

medium

A. The DataFrame is not imported correctly

B. The DataFrame is missing a column

C. apply() cannot be used with custom functions

D. The function multiply_by_two does not return a value

Solution

1. Step 1: Check the function multiply_by_two

   The function calculates x * 2 but does not return the result.

2. Step 2: Understand apply behavior

   apply expects the function to return a value to create the new column. Without return, it returns None for each row.

3. Final Answer:

   The function multiply_by_two does not return a value -> Option D

4. Quick Check:

   Functions must return values for apply to work [OK]

Hint: Always return a value in your custom function [OK]

Common Mistakes:

• Forgetting the return statement in functions
• Assuming apply works without returned values
• Thinking DataFrame import affects apply

5. You have a DataFrame with a column 'score' containing numbers. You want to create a new column 'grade' that assigns 'Pass' if the score is 50 or more, and 'Fail' otherwise. Which custom function and pandas code correctly achieve this?

hard

A. def grade_func(x): return 'Pass' if x >= 50 else 'Fail'
df['grade'] = df['score'].apply(grade_func)

B. def grade_func(x): if x >= 50: 'Pass' else: 'Fail'
df['grade'] = df['score'].apply(grade_func)

C. def grade_func(x): return x >= 50 or 'Pass' and 'Fail'
df['grade'] = df['score'].apply(grade_func)

D. def grade_func(x): return 'Pass' if x > 50 else 'Fail'
df['grade'] = df['score'].apply(grade_func)

Solution

1. Step 1: Check the function logic for grading

   def grade_func(x): return 'Pass' if x >= 50 else 'Fail' df['grade'] = df['score'].apply(grade_func) correctly returns 'Pass' if x is 50 or more, else 'Fail'. def grade_func(x): if x >= 50: 'Pass' else: 'Fail' df['grade'] = df['score'].apply(grade_func) misses return statement. def grade_func(x): return x >= 50 or 'Pass' and 'Fail' df['grade'] = df['score'].apply(grade_func) uses incorrect logical operators, resulting in True or 'Fail'. def grade_func(x): return 'Pass' if x > 50 else 'Fail' df['grade'] = df['score'].apply(grade_func) uses > 50, which excludes 50.

2. Step 2: Confirm pandas apply usage

   All options use apply correctly, but only def grade_func(x): return 'Pass' if x >= 50 else 'Fail' df['grade'] = df['score'].apply(grade_func) has correct function logic and syntax.

3. Final Answer:

   def grade_func(x): return 'Pass' if x >= 50 else 'Fail' df['grade'] = df['score'].apply(grade_func) -> Option A

4. Quick Check:

   Use return with correct condition for grading [OK]

Hint: Use return and correct condition in custom function [OK]

Common Mistakes:

• Forgetting return in function
• Using wrong comparison operator
• Confusing logical expressions without return