Descriptive statistics review in Data Analysis Python - Step-by-Step Execution

Concept Flow - Descriptive statistics review

Start with Data

↓

Calculate Mean

→Calculate Median

↓

Calculate Variance

→Calculate Std Dev

↓

Summarize Results

↓

End

The flow starts with data, then calculates key statistics like mean, median, mode, variance, standard deviation, and range, and finally summarizes the results.

Execution Sample

Data Analysis Python

import pandas as pd

data = pd.Series([10, 20, 20, 40, 50])
mean = data.mean()
median = data.median()
mode = data.mode()[0]
variance = data.var(ddof=0)
std_dev = data.std(ddof=0)
range_val = data.max() - data.min()

This code calculates basic descriptive statistics from a small dataset.

Execution Table

Step	Action	Calculation	Result
1	Calculate Mean	(10+20+20+40+50)/5	28.0
2	Calculate Median	Middle value after sorting [10,20,20,40,50]	20.0
3	Calculate Mode	Most frequent value	20
4	Calculate Variance	Average squared difference from mean	216.0
5	Calculate Std Dev	Square root of variance	14.7
6	Calculate Range	Max - Min (50 - 10)	40
7	Summary	Collect all statistics	{mean:28.0, median:20.0, mode:20, variance:216.0, std_dev:14.7, range:40}

💡 All descriptive statistics calculated and summarized.

Variable Tracker

Variable	Start	After Step 1	After Step 2	After Step 3	After Step 4	After Step 5	After Step 6	Final
mean	None	28.0	28.0	28.0	28.0	28.0	28.0	28.0
median	None	None	20.0	20.0	20.0	20.0	20.0	20.0
mode	None	None	None	20	20	20	20	20
variance	None	None	None	None	216.0	216.0	216.0	216.0
std_dev	None	None	None	None	None	14.7	14.7	14.7
range_val	None	None	None	None	None	None	40	40

Key Moments - 3 Insights

Why is the mode 20 and not 10 or 40?

Because 20 appears twice in the data, more than any other number, as shown in step 3 of the execution table.

Why is variance larger than the mean?

Variance measures spread squared, so it can be larger than the mean; see step 4 where variance is 216.0 while mean is 28.0.

Why do we calculate standard deviation after variance?

Standard deviation is the square root of variance, making it easier to interpret; this is shown in step 5.

Visual Quiz - 3 Questions

Look at the execution table, what is the median value calculated at step 2?

A 40

B 28.0

C 20.0

D 16.33

💡 Hint

Check the 'Result' column in row for step 2 in the execution table.

At which step does the calculation of the range occur?

A Step 3

B Step 6

C Step 4

D Step 5

💡 Hint

Look for 'Calculate Range' in the 'Action' column of the execution table.

If the data changed to [10, 20, 30, 40, 50], how would the mode change?

A There would be no mode

B Mode would be 20

C Mode would be 10

D Mode would be 30

💡 Hint

Mode is the most frequent value; check how frequency affects mode in the key moments.

Concept Snapshot

Descriptive statistics summarize data.
Mean is the average.
Median is the middle value.
Mode is the most frequent value.
Variance and std dev show spread.
Range is max minus min.

Full Transcript

This visual execution traces calculating descriptive statistics on a small dataset. We start with data values and calculate mean by averaging all numbers. Then we find the median by sorting and picking the middle value. The mode is the number that appears most often. Variance measures how spread out the data is by averaging squared differences from the mean. Standard deviation is the square root of variance, giving spread in original units. Range is the difference between the largest and smallest values. Each step updates variables and results are summarized at the end.

Practice

1. Which of the following best describes the median in a dataset?

easy

A. The middle value when data is sorted from smallest to largest

B. The most frequently occurring value in the data

C. The average of all values in the data

D. The difference between the largest and smallest values

Solution

1. Step 1: Understand what median means

   The median is the value that lies in the middle of a sorted list of numbers.

2. Step 2: Compare with other options

   Mode is the most frequent value, mean is the average, and range is max-min.

3. Final Answer:

   The middle value when data is sorted from smallest to largest -> Option A

4. Quick Check:

   Median = middle value [OK]

Hint: Median splits sorted data in half [OK]

Common Mistakes:

• Confusing median with mean
• Thinking median is the most frequent value
• Mixing median with range

2. Which of the following is the correct way to get descriptive statistics of a pandas DataFrame df?

easy

A. describe(df)

B. df.summary()

C. df.describe()

D. df.stats()

Solution

1. Step 1: Recall pandas method for summary

   In pandas, describe() is the method to get descriptive stats.

2. Step 2: Check other options

   Methods like summary(), stats() do not exist in pandas, and describe(df) is not valid syntax.

3. Final Answer:

   df.describe() -> Option C

4. Quick Check:

   Use df.describe() for stats [OK]

Hint: Use df.describe() for quick stats [OK]

Common Mistakes:

• Using non-existent methods like summary()
• Calling describe as a function with df argument
• Confusing with other libraries

3. Given the following code, what will be the output of print(df.mean())?

import pandas as pd
data = {'A': [1, 2, 3], 'B': [4, 5, 6]}
df = pd.DataFrame(data)

medium

A. A 2.0
B 5.0
dtype: float64

B. A 3.0
B 6.0
dtype: int64

C. A 1.5
B 4.5
dtype: float64

D. Error: mean() not defined

Solution

1. Step 1: Calculate mean for each column

   Column A values: 1, 2, 3; mean = (1+2+3)/3 = 2.0. Column B values: 4, 5, 6; mean = (4+5+6)/3 = 5.0.

2. Step 2: Understand pandas output format

   Printing df.mean() shows means per column with dtype float64.

3. Final Answer:

   A 2.0 B 5.0 dtype: float64 -> Option A

4. Quick Check:

   Mean = sum/number of values [OK]

Hint: Mean = sum of values divided by count [OK]

Common Mistakes:

• Calculating median instead of mean
• Mixing up column values
• Expecting integer dtype instead of float

4. The following code is intended to calculate the standard deviation of column 'X' in DataFrame df. What is the error?

import pandas as pd
data = {'X': [10, 20, 30, 40]}
df = pd.DataFrame(data)
std_dev = df.std('X')
print(std_dev)

medium

A. DataFrame std() method requires axis=1 argument

B. The std() method does not take any arguments; column must be selected first

C. The code should use df['X'].variance() instead

D. No error; code runs correctly

Solution

1. Step 1: Check std() method usage

   In pandas, std() calculates standard deviation for all numeric columns or Series. It does not accept a column name as argument.

2. Step 2: Correct way to get std of column 'X'

   We must select the column first: df['X'].std().

3. Final Answer:

   The std() method does not take any arguments; column must be selected first -> Option B

4. Quick Check:

   Use df['X'].std() to get column std [OK]

Hint: Select column before std() call [OK]

Common Mistakes:

• Passing column name as argument to std()
• Using variance() instead of std()
• Assuming std() needs axis=1

5. You have a DataFrame df with columns 'Age' and 'Salary'. You want to find the average salary for people older than 30. Which code correctly does this?

hard

A. df['Salary'].mean(df['Age'] > 30)

B. df['Salary'].mean().filter(df['Age'] > 30)

C. df.mean()['Salary'][df['Age'] > 30]

D. df[df['Age'] > 30]['Salary'].mean()

Solution

1. Step 1: Filter rows where Age > 30

   Use boolean indexing: df[df['Age'] > 30] selects rows with Age greater than 30.

2. Step 2: Select 'Salary' column and calculate mean

   From filtered rows, select 'Salary' column and call mean() to get average salary.

3. Final Answer:

   df[df['Age'] > 30]['Salary'].mean() -> Option D

4. Quick Check:

   Filter then mean for conditional average [OK]

Hint: Filter rows first, then calculate mean [OK]

Common Mistakes:

• Passing condition inside mean()
• Trying to filter after mean()
• Using mean() on entire DataFrame