Aggregation functions (sum, mean, std) in Data Analysis Python - Step-by-Step Execution

Concept Flow - Aggregation functions (sum, mean, std)

Start with data

↓

Choose aggregation function

↓

Apply function to data

↓

Calculate result

↓

Return aggregated value

Aggregation functions take a list of numbers and return a single summary value like total, average, or spread.

Execution Sample

Data Analysis Python

import pandas as pd

data = pd.Series([10, 20, 30, 40, 50])
sum_val = data.sum()
mean_val = data.mean()
std_val = data.std()

This code calculates the sum, mean, and standard deviation of a list of numbers.

Execution Table

Step	Data	Function Applied	Intermediate Calculation	Result
1	[10, 20, 30, 40, 50]	sum()	10+20+30+40+50	150
2	[10, 20, 30, 40, 50]	mean()	(10+20+30+40+50)/5	30.0
3	[10, 20, 30, 40, 50]	std()	sqrt(((10-30)**2+(20-30)**2+(30-30)**2+(40-30)**2+(50-30)**2)/4)	15.811388300841896
4				Execution complete

💡 All aggregation functions applied to the data, results calculated and returned.

Variable Tracker

Variable	Start	After sum()	After mean()	After std()
data	[10, 20, 30, 40, 50]	[10, 20, 30, 40, 50]	[10, 20, 30, 40, 50]	[10, 20, 30, 40, 50]
sum_val	None	150	150	150
mean_val	None	None	30.0	30.0
std_val	None	None	None	15.811388300841896

Key Moments - 2 Insights

Why does the standard deviation divide by 4 instead of 5 in the calculation?

Standard deviation uses n-1 (4 here) for an unbiased estimate of spread in sample data, as shown in step 3 of the execution_table.

Is the mean the same as sum divided by the number of items?

Yes, the mean is calculated by dividing the sum by the count of items, as shown in step 2 of the execution_table.

Visual Quiz - 3 Questions

Look at the execution_table, what is the sum_val after step 1?

A 150

B 30.0

C 15.81

D None

💡 Hint

Check the 'Result' column in row for step 1 in execution_table.

At which step does the mean_val get its value?

A Step 1

B Step 2

C Step 3

D Step 4

💡 Hint

Look at the 'Function Applied' and 'Result' columns in execution_table.

If the data changed to [10, 20, 30], what would happen to the sum_val in the variable_tracker?

A It would be 30

B It would stay 150

C It would be 60

D It would be 20

💡 Hint

Sum adds all numbers, so sum of 10+20+30 equals 60.

Concept Snapshot

Aggregation functions summarize data:
- sum(): adds all values
- mean(): average value (sum/count)
- std(): spread of data (standard deviation)
Use on lists or columns to get quick insights.

Full Transcript

Aggregation functions like sum, mean, and standard deviation take a list of numbers and return a single value summarizing them. Sum adds all numbers, mean divides the sum by the count, and standard deviation measures how spread out the numbers are. In the example, we use pandas Series with values 10, 20, 30, 40, 50. The sum is 150, mean is 30, and standard deviation is about 15.81. The standard deviation divides by n-1 (4 here) for an unbiased estimate. These functions help quickly understand data with simple calculations.

Practice

1. What does the mean() function calculate in a dataset?

easy

A. The most frequent value in the data

B. The total sum of all data points

C. The difference between the largest and smallest values

D. The average value of the data

Solution

1. Step 1: Understand the purpose of mean()

   The mean() function calculates the average by adding all values and dividing by the count.

2. Step 2: Compare with other options

   Sum is total, range is difference, mode is most frequent. Only mean is average.

3. Final Answer:

   The average value of the data -> Option D

4. Quick Check:

   mean = average [OK]

Hint: Mean is average, sum is total, std is spread [OK]

Common Mistakes:

• Confusing mean with sum
• Thinking mean finds the most frequent value
• Mixing mean with range or mode

2. Which of the following is the correct way to calculate the standard deviation of a pandas DataFrame column named data?

easy

A. df.std(data)

B. std(df['data'])

C. df.data.std()

D. df['data'].standard_deviation()

Solution

1. Step 1: Recall pandas syntax for std()

   In pandas, to get std of a column, use df.column.std() or df['column'].std().

2. Step 2: Check each option

   df.data.std() uses correct dot notation. df.std(data) is wrong syntax. std(df['data']) is not a pandas function call. df['data'].standard_deviation() uses a non-existent method.

3. Final Answer:

   df.data.std() -> Option C

4. Quick Check:

   Use dot notation with std() [OK]

Hint: Use df.column.std() to get standard deviation [OK]

Common Mistakes:

• Calling std() as a standalone function
• Using wrong method names
• Passing column name as argument to std()

3. Given the following code:

import pandas as pd
df = pd.DataFrame({'values': [10, 20, 30, 40, 50]})
result = df['values'].sum()

What is the value of result?

medium

A. 150

B. 30

C. 25

D. 10

Solution

1. Step 1: Identify the data values

   The column 'values' contains [10, 20, 30, 40, 50].

2. Step 2: Calculate the sum

   Sum = 10 + 20 + 30 + 40 + 50 = 150.

3. Final Answer:

   150 -> Option A

4. Quick Check:

   Sum of values = 150 [OK]

Hint: Add all numbers to get sum [OK]

Common Mistakes:

• Calculating mean instead of sum
• Adding only first two numbers
• Confusing sum with count

4. The following code is intended to calculate the mean of a list but causes an error:

import pandas as pd
numbers = [5, 10, 15]
mean_value = numbers.mean()

What is the error and how to fix it?

medium

A. Error: 'list' object has no attribute 'mean'. Fix by converting list to pandas Series first.

B. Error: mean() requires two arguments. Fix by adding an argument.

C. Error: mean() is not imported. Fix by importing mean from pandas.

D. No error, code runs correctly.

Solution

1. Step 1: Identify the error cause

   Python lists do not have a mean() method, so calling numbers.mean() causes an AttributeError.

2. Step 2: Fix by converting list to pandas Series

   Convert list to pd.Series(numbers) then call .mean() to get the average.

3. Final Answer:

   Error: 'list' object has no attribute 'mean'. Fix by converting list to pandas Series first. -> Option A

4. Quick Check:

   Lists lack mean(), use pd.Series [OK]

Hint: Convert list to Series before calling mean() [OK]

Common Mistakes:

• Calling mean() directly on list
• Trying to import mean() separately
• Assuming mean() needs arguments

5. You have a DataFrame df with a column scores containing exam scores. You want to find the average score but only for scores above 50. Which code correctly calculates this?

hard

A. df['scores'].mean(df['scores'] > 50)

B. df[df['scores'] > 50]['scores'].mean()

C. df['scores'].sum() / 50

D. df['scores'].std()[df['scores'] > 50]

Solution

1. Step 1: Filter scores greater than 50

   Use df[df['scores'] > 50] to select rows where scores are above 50.

2. Step 2: Calculate mean of filtered scores

   Access the 'scores' column of filtered data and call .mean() to get average.

3. Final Answer:

   df[df['scores'] > 50]['scores'].mean() -> Option B

4. Quick Check:

   Filter then mean = correct approach [OK]

Hint: Filter first, then apply mean() [OK]

Common Mistakes:

• Passing condition inside mean()
• Dividing sum by 50 instead of count
• Using std() instead of mean()