Why statistics quantifies uncertainty in SciPy - Challenge Your Understanding

Challenge - 5 Problems

❓ Predict Output

intermediate

Understanding Confidence Interval Calculation

What is the output of the following code that calculates a 95% confidence interval for a sample mean?

SciPy

import numpy as np
from scipy import stats

np.random.seed(0)
sample = np.random.normal(loc=50, scale=5, size=30)
mean = np.mean(sample)
sem = stats.sem(sample)
conf_int = stats.t.interval(0.95, len(sample)-1, loc=mean, scale=sem)
print(tuple(round(x, 2) for x in conf_int))

A (47.50, 52.66)

B (49.00, 51.00)

C (48.50, 51.50)

D (48.01, 52.15)

💡 Hint

Recall that the confidence interval depends on the sample mean, standard error, and t-distribution quantiles.

The code calculates the 95% confidence interval using the t-distribution for a sample of size 30 drawn from a normal distribution. The output is the lower and upper bounds rounded to two decimals.

❓ data_output

intermediate

Result of Sampling Distribution Visualization Data

After running this code to simulate sampling distribution of the mean, what is the mean of the sample means array?

SciPy

import numpy as np
np.random.seed(1)
sample_means = [np.mean(np.random.normal(100, 15, 50)) for _ in range(1000)]
mean_of_means = round(np.mean(sample_means), 2)
print(mean_of_means)

A 99.85

B 100.0

C 101.5

D 98.0

💡 Hint

The sample means should be close to the population mean but may vary slightly due to randomness.

The average of the 1000 sample means is close to the population mean of 100 but not exactly 100 due to sampling variability.

❓ visualization

advanced

Interpreting a Histogram of Sample Means

Which option best describes the shape of the histogram generated by this code showing sample means from repeated sampling?

SciPy

import numpy as np
import matplotlib.pyplot as plt
np.random.seed(2)
sample_means = [np.mean(np.random.exponential(scale=1.0, size=40)) for _ in range(1000)]
plt.hist(sample_means, bins=30, color='skyblue', edgecolor='black')
plt.title('Histogram of Sample Means from Exponential Distribution')
plt.xlabel('Sample Mean')
plt.ylabel('Frequency')
plt.show()

A The histogram is heavily skewed right, reflecting the original exponential distribution.

B The histogram shows multiple peaks indicating a bimodal distribution.

C The histogram is uniform because sample means are evenly distributed.

D The histogram is symmetric and bell-shaped due to the Central Limit Theorem.

💡 Hint

Think about how the Central Limit Theorem affects the distribution of sample means.

Even though the original data is exponential (skewed), the distribution of sample means tends to be normal (bell-shaped) when sample size is large enough.

🧠 Conceptual

advanced

Why Use Probability Distributions in Statistics?

Which option best explains why statistics uses probability distributions to quantify uncertainty?

A Because probability distributions provide exact predictions of future events without error.

B Because probability distributions model the variability and randomness in data, allowing us to estimate uncertainty.

C Because probability distributions eliminate the need for data collection by assuming fixed values.

D Because probability distributions simplify data by ignoring variability and focusing on averages.

💡 Hint

Think about what uncertainty means in real life and how statistics handles it.

Probability distributions represent how data can vary and help quantify the uncertainty inherent in measurements and predictions.

🔧 Debug

expert

Identify the Error in Confidence Interval Calculation

What error does this code raise when trying to calculate a 99% confidence interval for a small sample?

SciPy

import numpy as np
from scipy import stats

sample = np.array([5, 7, 8, 6, 9])
mean = np.mean(sample)
sem = stats.sem(sample)
conf_int = stats.t.interval(0.99, len(sample)-1, loc=mean, scale=sem)
print(conf_int)

A IndexError: list index out of range

B TypeError: unsupported operand type(s) for +: 'int' and 'str'

C ValueError: degrees of freedom must be positive

D No error, outputs the confidence interval tuple

💡 Hint

Check the degrees of freedom parameter passed to the t.interval function.

The degrees of freedom should be sample size minus one, but the code uses the full sample size, causing a ValueError.

Practice

1. Why do statisticians use confidence intervals when analyzing data?

easy

A. To show a range where the true value likely lies

B. To find the exact value of a measurement

C. To ignore uncertainty in data

D. To make data look more complex

Solution

1. Step 1: Understand the purpose of confidence intervals

   Confidence intervals provide a range of values that likely contain the true population parameter, showing uncertainty.

2. Step 2: Compare options to this purpose

   Only To show a range where the true value likely lies correctly describes this purpose; others misunderstand or ignore uncertainty.

3. Final Answer:

   To show a range where the true value likely lies -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty = C [OK]

Hint: Confidence intervals give a range, not exact values [OK]

Common Mistakes:

• Thinking confidence intervals give exact values
• Ignoring uncertainty in data
• Confusing confidence intervals with p-values

2. Which of the following is the correct way to import the function for calculating a confidence interval from scipy.stats?

easy

A. from scipy.stats import conf_interval

B. from scipy.stats import t

C. from scipy.stats import tconfint

D. from scipy.stats import t.interval

Solution

1. Step 1: Recall scipy.stats syntax for confidence intervals

   The function to calculate confidence intervals for t-distribution is accessed as t.interval.

2. Step 2: Check import statements

   from scipy.stats import t correctly imports t; others are invalid or incorrect syntax.

3. Final Answer:

   from scipy.stats import t -> Option B

4. Quick Check:

   Correct scipy.stats import syntax = B [OK]

Hint: Use dot notation for submodules like t.interval [OK]

Common Mistakes:

• Trying to import functions that don't exist
• Using wrong function names
• Confusing import syntax with function calls

3. What will be the output of this code snippet?

import numpy as np
from scipy import stats

data = np.array([5, 7, 8, 9, 10])
mean = np.mean(data)
conf_int = stats.t.interval(0.95, len(data)-1, loc=mean, scale=stats.sem(data))
print(conf_int)

medium

A. An error because stats.sem is not defined

B. A single number representing the mean

C. A tuple with two numbers showing the 95% confidence interval

D. A list of all data points

Solution

1. Step 1: Understand the code's purpose

   The code calculates the mean and then the 95% confidence interval using t-distribution and standard error of the mean.

2. Step 2: Analyze the output of stats.t.interval

   This function returns a tuple with lower and upper bounds of the confidence interval, so the print statement outputs a tuple of two numbers.

3. Final Answer:

   A tuple with two numbers showing the 95% confidence interval -> Option C

4. Quick Check:

   stats.t.interval returns confidence bounds = A [OK]

Hint: t.interval returns a tuple (low, high) for confidence [OK]

Common Mistakes:

• Expecting a single number instead of a tuple
• Confusing stats.sem with undefined function
• Thinking output is the raw data list

4. Identify the error in this code that tries to calculate a 90% confidence interval:

from scipy.stats import t

sample = [12, 15, 14, 10, 13]
mean = sum(sample) / len(sample)
interval = t.interval(0.90, len(sample), loc=mean, scale=2)
print(interval)

medium

A. The mean calculation is incorrect

B. The scale parameter cannot be a fixed number like 2

C. The confidence level 0.90 is invalid

D. Degrees of freedom should be len(sample) - 1, not len(sample)

Solution

1. Step 1: Check degrees of freedom parameter

   The degrees of freedom for t-distribution should be sample size minus one, so len(sample) - 1.

2. Step 2: Verify other parameters

   Scale can be a fixed number if it represents standard error; confidence level 0.90 is valid; mean calculation is correct.

3. Final Answer:

   Degrees of freedom should be len(sample) - 1, not len(sample) -> Option D

4. Quick Check:

   Degrees of freedom = sample size - 1 = D [OK]

Hint: Degrees of freedom = sample size minus one [OK]

Common Mistakes:

• Using sample size instead of sample size minus one for df
• Assuming scale must be computed, not fixed
• Misunderstanding confidence level values

5. You have two sets of exam scores from different classes. You want to compare their average scores but also understand how uncertain these averages are. Which approach using scipy best quantifies this uncertainty?

hard

A. Calculate the mean of each class and use stats.t.interval to get confidence intervals for both

B. Calculate the median of each class and compare them directly

C. Use stats.ttest_ind without checking confidence intervals

D. Just compare the highest scores from each class

Solution

1. Step 1: Understand the goal

   You want to compare averages and also quantify uncertainty around those averages.

2. Step 2: Evaluate options for quantifying uncertainty

   Calculating means and confidence intervals with stats.t.interval directly shows uncertainty. Medians or highest scores don't quantify uncertainty. t-test compares means but does not show intervals.

3. Final Answer:

   Calculate the mean of each class and use stats.t.interval to get confidence intervals for both -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty best = A [OK]

Hint: Confidence intervals show uncertainty around averages [OK]

Common Mistakes:

• Using median without uncertainty measures
• Ignoring confidence intervals in comparisons
• Relying only on highest scores