Why statistics quantifies uncertainty in SciPy - See It in Action

Why Statistics Quantifies Uncertainty

📖 Scenario: Imagine you are a quality inspector at a factory. You want to check if the machines are producing parts with the right size. But you cannot measure every part because there are too many. So, you take a small sample and use statistics to understand the whole batch.

🎯 Goal: You will create a small dataset of part sizes, calculate the average size, and then use statistics to find the uncertainty in your measurement by calculating the standard error. This shows how statistics helps us understand uncertainty in real life.

📋 What You'll Learn

Create a list of part sizes with exact values

Create a variable for the sample size

Calculate the mean of the part sizes using scipy

Calculate the standard error of the mean using scipy

Print the mean and the standard error

💡 Why This Matters

🌍 Real World

Quality control in factories uses statistics to check if products meet standards without measuring every item.

💼 Career

Data scientists and quality engineers use statistical measures like mean and standard error to make decisions based on sample data.

1

Create the dataset of part sizes

Create a list called part_sizes with these exact values: 10.1, 10.3, 9.9, 10.2, 10.0

SciPy

# Create the list part_sizes with the given values
# Your code here

Hint

Use square brackets to create a list and separate values with commas.

2

Set the sample size variable

Create a variable called sample_size and set it to the length of the part_sizes list using the len() function

SciPy

part_sizes = [10.1, 10.3, 9.9, 10.2, 10.0]
# Create sample_size as the length of part_sizes
# Your code here

Hint

Use len(part_sizes) to get the number of items in the list.

3

Calculate mean and standard error

Import scipy.stats as stats. Then create a variable mean_size that stores the mean of part_sizes using stats.tmean(). Next, create a variable std_error that stores the standard error of the mean using stats.sem() on part_sizes

SciPy

part_sizes = [10.1, 10.3, 9.9, 10.2, 10.0]
sample_size = len(part_sizes)
# Import scipy.stats as stats
# Calculate mean_size using stats.tmean(part_sizes)
# Calculate std_error using stats.sem(part_sizes)
# Your code here

Hint

Use import scipy.stats as stats to import. Then use stats.tmean() and stats.sem() functions.

4

Print the mean and standard error

Write two print statements: one to print mean_size with the text "Mean size:" and another to print std_error with the text "Standard error:"

SciPy

import scipy.stats as stats

part_sizes = [10.1, 10.3, 9.9, 10.2, 10.0]
sample_size = len(part_sizes)

mean_size = stats.tmean(part_sizes)
std_error = stats.sem(part_sizes)
# Print mean_size with label
# Print std_error with label
# Your code here

Hint

Use print("Mean size:", mean_size) and print("Standard error:", std_error).

Practice

1. Why do statisticians use confidence intervals when analyzing data?

easy

A. To show a range where the true value likely lies

B. To find the exact value of a measurement

C. To ignore uncertainty in data

D. To make data look more complex

Solution

1. Step 1: Understand the purpose of confidence intervals

   Confidence intervals provide a range of values that likely contain the true population parameter, showing uncertainty.

2. Step 2: Compare options to this purpose

   Only To show a range where the true value likely lies correctly describes this purpose; others misunderstand or ignore uncertainty.

3. Final Answer:

   To show a range where the true value likely lies -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty = C [OK]

Hint: Confidence intervals give a range, not exact values [OK]

Common Mistakes:

• Thinking confidence intervals give exact values
• Ignoring uncertainty in data
• Confusing confidence intervals with p-values

2. Which of the following is the correct way to import the function for calculating a confidence interval from scipy.stats?

easy

A. from scipy.stats import conf_interval

B. from scipy.stats import t

C. from scipy.stats import tconfint

D. from scipy.stats import t.interval

Solution

1. Step 1: Recall scipy.stats syntax for confidence intervals

   The function to calculate confidence intervals for t-distribution is accessed as t.interval.

2. Step 2: Check import statements

   from scipy.stats import t correctly imports t; others are invalid or incorrect syntax.

3. Final Answer:

   from scipy.stats import t -> Option B

4. Quick Check:

   Correct scipy.stats import syntax = B [OK]

Hint: Use dot notation for submodules like t.interval [OK]

Common Mistakes:

• Trying to import functions that don't exist
• Using wrong function names
• Confusing import syntax with function calls

3. What will be the output of this code snippet?

import numpy as np
from scipy import stats

data = np.array([5, 7, 8, 9, 10])
mean = np.mean(data)
conf_int = stats.t.interval(0.95, len(data)-1, loc=mean, scale=stats.sem(data))
print(conf_int)

medium

A. An error because stats.sem is not defined

B. A single number representing the mean

C. A tuple with two numbers showing the 95% confidence interval

D. A list of all data points

Solution

1. Step 1: Understand the code's purpose

   The code calculates the mean and then the 95% confidence interval using t-distribution and standard error of the mean.

2. Step 2: Analyze the output of stats.t.interval

   This function returns a tuple with lower and upper bounds of the confidence interval, so the print statement outputs a tuple of two numbers.

3. Final Answer:

   A tuple with two numbers showing the 95% confidence interval -> Option C

4. Quick Check:

   stats.t.interval returns confidence bounds = A [OK]

Hint: t.interval returns a tuple (low, high) for confidence [OK]

Common Mistakes:

• Expecting a single number instead of a tuple
• Confusing stats.sem with undefined function
• Thinking output is the raw data list

4. Identify the error in this code that tries to calculate a 90% confidence interval:

from scipy.stats import t

sample = [12, 15, 14, 10, 13]
mean = sum(sample) / len(sample)
interval = t.interval(0.90, len(sample), loc=mean, scale=2)
print(interval)

medium

A. The mean calculation is incorrect

B. The scale parameter cannot be a fixed number like 2

C. The confidence level 0.90 is invalid

D. Degrees of freedom should be len(sample) - 1, not len(sample)

Solution

1. Step 1: Check degrees of freedom parameter

   The degrees of freedom for t-distribution should be sample size minus one, so len(sample) - 1.

2. Step 2: Verify other parameters

   Scale can be a fixed number if it represents standard error; confidence level 0.90 is valid; mean calculation is correct.

3. Final Answer:

   Degrees of freedom should be len(sample) - 1, not len(sample) -> Option D

4. Quick Check:

   Degrees of freedom = sample size - 1 = D [OK]

Hint: Degrees of freedom = sample size minus one [OK]

Common Mistakes:

• Using sample size instead of sample size minus one for df
• Assuming scale must be computed, not fixed
• Misunderstanding confidence level values

5. You have two sets of exam scores from different classes. You want to compare their average scores but also understand how uncertain these averages are. Which approach using scipy best quantifies this uncertainty?

hard

A. Calculate the mean of each class and use stats.t.interval to get confidence intervals for both

B. Calculate the median of each class and compare them directly

C. Use stats.ttest_ind without checking confidence intervals

D. Just compare the highest scores from each class

Solution

1. Step 1: Understand the goal

   You want to compare averages and also quantify uncertainty around those averages.

2. Step 2: Evaluate options for quantifying uncertainty

   Calculating means and confidence intervals with stats.t.interval directly shows uncertainty. Medians or highest scores don't quantify uncertainty. t-test compares means but does not show intervals.

3. Final Answer:

   Calculate the mean of each class and use stats.t.interval to get confidence intervals for both -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty best = A [OK]

Hint: Confidence intervals show uncertainty around averages [OK]

Common Mistakes:

• Using median without uncertainty measures
• Ignoring confidence intervals in comparisons
• Relying only on highest scores