Aggregation functions (sum, mean, std) in Data Analysis Python

Introduction

Aggregation functions help us find simple summaries of data, like totals, averages, or how spread out numbers are.

When you want to find the total sales from a list of daily sales numbers.

When you need to calculate the average temperature over a week.

When checking how much variation there is in students' test scores.

When summarizing data to understand overall trends quickly.

When preparing data for reports or visualizations.

Syntax

Data Analysis Python

data.sum()
data.mean()
data.std()

These functions are often used on columns of data in tables (like pandas DataFrames or Series).

They return a single number summarizing the data.

Examples

This adds all numbers: 10 + 20 + 30 + 40 = 100.

Data Analysis Python

import pandas as pd

numbers = pd.Series([10, 20, 30, 40])
print(numbers.sum())

This calculates the average: (10 + 20 + 30 + 40) / 4 = 25.

Data Analysis Python

import pandas as pd

numbers = pd.Series([10, 20, 30, 40])
print(numbers.mean())

This finds how spread out the numbers are around the average.

Data Analysis Python

import pandas as pd

numbers = pd.Series([10, 20, 30, 40])
print(numbers.std())

Sample Program

This program shows how to use sum, mean, and std to summarize daily sales data.

Data Analysis Python

import pandas as pd

# Create a small dataset of daily sales
sales = pd.Series([100, 150, 200, 130, 170])

# Calculate total sales
total_sales = sales.sum()

# Calculate average sales
average_sales = sales.mean()

# Calculate sales standard deviation
sales_std = sales.std()

print(f"Total sales: {total_sales}")
print(f"Average sales: {average_sales}")
print(f"Sales standard deviation: {sales_std:.2f}")

Important Notes

Standard deviation (std) tells you how much the numbers differ from the average.

If your data has missing values, these functions usually ignore them automatically.

You can use these functions on columns in tables to summarize each column.

Summary

Aggregation functions give quick summaries like total, average, and spread.

They help understand data without looking at every number.

sum(), mean(), and std() are common and easy to use in data analysis.

Practice

1. What does the mean() function calculate in a dataset?

easy

A. The most frequent value in the data

B. The total sum of all data points

C. The difference between the largest and smallest values

D. The average value of the data

Solution

1. Step 1: Understand the purpose of mean()

   The mean() function calculates the average by adding all values and dividing by the count.

2. Step 2: Compare with other options

   Sum is total, range is difference, mode is most frequent. Only mean is average.

3. Final Answer:

   The average value of the data -> Option D

4. Quick Check:

   mean = average [OK]

Hint: Mean is average, sum is total, std is spread [OK]

Common Mistakes:

• Confusing mean with sum
• Thinking mean finds the most frequent value
• Mixing mean with range or mode

2. Which of the following is the correct way to calculate the standard deviation of a pandas DataFrame column named data?

easy

A. df.std(data)

B. std(df['data'])

C. df.data.std()

D. df['data'].standard_deviation()

Solution

1. Step 1: Recall pandas syntax for std()

   In pandas, to get std of a column, use df.column.std() or df['column'].std().

2. Step 2: Check each option

   df.data.std() uses correct dot notation. df.std(data) is wrong syntax. std(df['data']) is not a pandas function call. df['data'].standard_deviation() uses a non-existent method.

3. Final Answer:

   df.data.std() -> Option C

4. Quick Check:

   Use dot notation with std() [OK]

Hint: Use df.column.std() to get standard deviation [OK]

Common Mistakes:

• Calling std() as a standalone function
• Using wrong method names
• Passing column name as argument to std()

3. Given the following code:

import pandas as pd
df = pd.DataFrame({'values': [10, 20, 30, 40, 50]})
result = df['values'].sum()

What is the value of result?

medium

A. 150

B. 30

C. 25

D. 10

Solution

1. Step 1: Identify the data values

   The column 'values' contains [10, 20, 30, 40, 50].

2. Step 2: Calculate the sum

   Sum = 10 + 20 + 30 + 40 + 50 = 150.

3. Final Answer:

   150 -> Option A

4. Quick Check:

   Sum of values = 150 [OK]

Hint: Add all numbers to get sum [OK]

Common Mistakes:

• Calculating mean instead of sum
• Adding only first two numbers
• Confusing sum with count

4. The following code is intended to calculate the mean of a list but causes an error:

import pandas as pd
numbers = [5, 10, 15]
mean_value = numbers.mean()

What is the error and how to fix it?

medium

A. Error: 'list' object has no attribute 'mean'. Fix by converting list to pandas Series first.

B. Error: mean() requires two arguments. Fix by adding an argument.

C. Error: mean() is not imported. Fix by importing mean from pandas.

D. No error, code runs correctly.

Solution

1. Step 1: Identify the error cause

   Python lists do not have a mean() method, so calling numbers.mean() causes an AttributeError.

2. Step 2: Fix by converting list to pandas Series

   Convert list to pd.Series(numbers) then call .mean() to get the average.

3. Final Answer:

   Error: 'list' object has no attribute 'mean'. Fix by converting list to pandas Series first. -> Option A

4. Quick Check:

   Lists lack mean(), use pd.Series [OK]

Hint: Convert list to Series before calling mean() [OK]

Common Mistakes:

• Calling mean() directly on list
• Trying to import mean() separately
• Assuming mean() needs arguments

5. You have a DataFrame df with a column scores containing exam scores. You want to find the average score but only for scores above 50. Which code correctly calculates this?

hard

A. df['scores'].mean(df['scores'] > 50)

B. df[df['scores'] > 50]['scores'].mean()

C. df['scores'].sum() / 50

D. df['scores'].std()[df['scores'] > 50]

Solution

1. Step 1: Filter scores greater than 50

   Use df[df['scores'] > 50] to select rows where scores are above 50.

2. Step 2: Calculate mean of filtered scores

   Access the 'scores' column of filtered data and call .mean() to get average.

3. Final Answer:

   df[df['scores'] > 50]['scores'].mean() -> Option B

4. Quick Check:

   Filter then mean = correct approach [OK]

Hint: Filter first, then apply mean() [OK]

Common Mistakes:

• Passing condition inside mean()
• Dividing sum by 50 instead of count
• Using std() instead of mean()