np.std() and np.var() for spread in NumPy - Step-by-Step Execution

Concept Flow - np.std() and np.var() for spread

Start with data array

↓

Calculate mean

↓

Calculate deviations from mean

↓

Square deviations (for variance)

↓

Average squared deviations = variance

↓

Square root of variance = std deviation

↓

Output variance and std deviation

This flow shows how variance and standard deviation measure data spread by first finding the mean, then deviations, then variance, and finally standard deviation.

Execution Sample

NumPy

import numpy as np
arr = np.array([2, 4, 4, 4, 5, 5, 7, 9])
var = np.var(arr)
std = np.std(arr)
print(var, std)

Calculate variance and standard deviation of a simple data array to measure spread.

Execution Table

Step	Action	Intermediate Value	Result
1	Input array	[2, 4, 4, 4, 5, 5, 7, 9]	Data ready
2	Calculate mean	mean = (2+4+4+4+5+5+7+9)/8	mean = 5.0
3	Calculate deviations	deviations = arr - mean	[-3, -1, -1, -1, 0, 0, 2, 4]
4	Square deviations	squared = deviations ** 2	[9, 1, 1, 1, 0, 0, 4, 16]
5	Calculate variance	variance = mean of squared	variance = 4.0
6	Calculate std deviation	std = sqrt(variance)	std = 2.0
7	Output	variance and std deviation	4.0 and 2.0

💡 All steps complete, variance and std deviation calculated

Variable Tracker

Variable	Start	After Step 2	After Step 3	After Step 4	After Step 5	After Step 6	Final
arr	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]	[2,4,4,4,5,5,7,9]
mean	N/A	5.0	5.0	5.0	5.0	5.0	5.0
deviations	N/A	N/A	[-3, -1, -1, -1, 0, 0, 2, 4]	[-3, -1, -1, -1, 0, 0, 2, 4]	[-3, -1, -1, -1, 0, 0, 2, 4]	[-3, -1, -1, -1, 0, 0, 2, 4]	[-3, -1, -1, -1, 0, 0, 2, 4]
squared	N/A	N/A	N/A	[9, 1, 1, 1, 0, 0, 4, 16]	[9, 1, 1, 1, 0, 0, 4, 16]	[9, 1, 1, 1, 0, 0, 4, 16]	[9, 1, 1, 1, 0, 0, 4, 16]
variance	N/A	N/A	N/A	N/A	4.0	4.0	4.0
std	N/A	N/A	N/A	N/A	N/A	2.0	2.0

Key Moments - 3 Insights

Why do we square the deviations before averaging for variance?

Squaring makes all deviations positive and emphasizes larger differences, as shown in step 4 of the execution_table.

Why is standard deviation the square root of variance?

Standard deviation is in the same units as the original data, unlike variance which is squared units, as shown in step 6.

What does a higher variance or std deviation mean about the data?

It means data points are more spread out from the mean, which you can see from the larger squared deviations in step 4.

Visual Quiz - 3 Questions

Look at the execution_table at step 3, what is the deviations array?

A [-3, -1, -1, -1, 0, 0, 2, 4]

B [3, 1, 1, 1, 0, 0, -2, -4]

C [2, 4, 4, 4, 5, 5, 7, 9]

D [9, 1, 1, 1, 0, 0, 4, 16]

💡 Hint

Check the 'Intermediate Value' column for step 3 in execution_table.

At which step does the variance get calculated?

A Step 4

B Step 6

C Step 5

D Step 3

💡 Hint

Look for 'Calculate variance' in the 'Action' column of execution_table.

If the data array had all identical values, what would np.var(arr) return?

A A positive number

B Zero

C Negative number

D Cannot be calculated

💡 Hint

Variance measures spread; no spread means zero variance, see variable_tracker for variance values.

Concept Snapshot

np.var(array) calculates variance = average squared deviation from mean
np.std(array) calculates standard deviation = sqrt(variance)
Variance shows spread in squared units
Std deviation shows spread in original units
Higher values mean more spread out data
Use these to understand data variability

Full Transcript

This lesson shows how numpy's np.var() and np.std() functions measure data spread. We start with a data array, calculate its mean, then find how far each value is from the mean (deviations). We square these deviations to avoid negatives and emphasize bigger differences, then average them to get variance. Taking the square root of variance gives standard deviation, which is easier to interpret because it uses the same units as the data. The execution table traces each step with values, and the variable tracker shows how variables change. Key moments clarify why we square deviations and why std deviation is the square root of variance. The quiz tests understanding of these steps and concepts.

Practice

1. What does np.std() measure in a dataset?

easy

A. The maximum value in the dataset

B. The sum of all data points

C. The average distance of data points from the mean in original units

D. The total number of data points

Solution

1. Step 1: Understand the purpose of np.std()

   np.std() calculates the standard deviation, which shows how spread out the data is around the mean in the same units as the data.

2. Step 2: Compare options to definition

   Only The average distance of data points from the mean in original units correctly describes this as the average distance from the mean in original units.

3. Final Answer:

   The average distance of data points from the mean in original units -> Option C

4. Quick Check:

   Standard deviation = average spread in original units [OK]

Hint: Standard deviation = spread in original units [OK]

Common Mistakes:

• Confusing standard deviation with variance
• Thinking it counts data points
• Mixing it with sum or max values

2. Which of the following is the correct syntax to calculate variance of array arr using NumPy?

easy

A. np.std(arr)

B. np.variance(arr)

C. arr.var()

D. np.var(arr)

Solution

1. Step 1: Recall the NumPy function for variance

   The correct NumPy function to calculate variance is np.var().

2. Step 2: Check each option

   np.var(arr) uses np.var(arr) which is correct. np.variance(arr) uses a non-existent function np.variance(). arr.var() uses arr.var() which works only if arr is a NumPy array, but the question asks for NumPy function syntax. np.std(arr) calculates standard deviation, not variance.

3. Final Answer:

   np.var(arr) -> Option D

4. Quick Check:

   Variance function = np.var() [OK]

Hint: Variance uses np.var(), not np.variance() [OK]

Common Mistakes:

• Using np.variance() which does not exist
• Confusing variance with standard deviation function
• Using method on list instead of NumPy array

3. What is the output of the following code?

import numpy as np
arr = np.array([2, 4, 4, 4, 5, 5, 7, 9])
print(np.var(arr))

medium

A. 2.0

B. 4.0

C. 2.5

D. 3.0

Solution

1. Step 1: Calculate the mean of the array

   The array is [2,4,4,4,5,5,7,9]. Sum = 40, count = 8, mean = 40/8 = 5.

2. Step 2: Calculate variance

   Variance = average of squared differences from mean:
   (2-5)^2=9, (4-5)^2=1, (4-5)^2=1, (4-5)^2=1, (5-5)^2=0, (5-5)^2=0, (7-5)^2=4, (9-5)^2=16
   Sum = 9+1+1+1+0+0+4+16 = 32
   Variance = 32/8 = 4.0

3. Step 3: Check code output

   NumPy's np.var() by default calculates population variance (divides by N). So output is 4.0.

4. Final Answer:

   4.0 -> Option B

5. Quick Check:

   Variance = 4.0 [OK]

Hint: Variance = mean of squared differences [OK]

Common Mistakes:

• Calculating sample variance (dividing by N-1) instead of population
• Mixing variance with standard deviation
• Incorrect mean calculation

4. The code below is intended to print the standard deviation of data. What is wrong?

import numpy as np
data = [1, 2, 3, 4, 5]
print(np.std(data, ddof=1))

medium

A. Nothing is wrong; code runs correctly

B. ddof is not a valid argument for np.std()

C. The code will raise a TypeError because data is a list, not an array

D. The code calculates variance, not standard deviation

Solution

1. Step 1: Check if ddof is valid for np.std()

   The ddof parameter (delta degrees of freedom) is valid for np.std() and adjusts divisor for sample standard deviation.

2. Step 2: Check if input type is acceptable

   np.std() accepts lists and converts them internally to arrays, so no error occurs.

3. Final Answer:

   Nothing is wrong; code runs correctly -> Option A

4. Quick Check:

   ddof works with np.std() and lists accepted [OK]

Hint: ddof works with np.std() for sample std [OK]

Common Mistakes:

• Thinking ddof is invalid for standard deviation
• Assuming lists cause errors in NumPy functions
• Confusing variance and standard deviation

5. You have two datasets:
data1 = np.array([10, 12, 14, 16, 18])
data2 = np.array([10, 10, 10, 10, 10])
Which statement is true about their standard deviation and variance?

hard

A. data1 has higher variance and standard deviation than data2

B. data2 has zero variance and standard deviation

C. data2 has higher variance but lower standard deviation than data1

D. Both datasets have the same variance and standard deviation

Solution

1. Step 1: Analyze data2 values

   All values in data2 are the same (10), so variance and standard deviation must be zero because there is no spread.

2. Step 2: Analyze data1 values

   data1 values vary from 10 to 18, so variance and standard deviation are greater than zero, meaning data1 has higher spread.

3. Final Answer:

   data1 has higher variance and standard deviation than data2 -> Option A

4. Quick Check:

   Constant data variance = 0; varying data variance > 0 [OK]

Hint: Constant data has zero variance and std [OK]

Common Mistakes:

• Assuming equal variance for different spread data
• Confusing variance with mean
• Thinking zero variance means error