Why statistics quantifies uncertainty in SciPy

Introduction

Statistics helps us understand how sure or unsure we are about data and results. It puts numbers on uncertainty so we can make better decisions.

When you want to know how reliable a survey result is.

When you need to predict outcomes but data has natural randomness.

When comparing two groups and want to see if differences are real or by chance.

When measuring quality control in manufacturing to detect problems.

When estimating the chance of an event happening based on past data.

Syntax

SciPy

import scipy.stats as stats

# Example: Calculate confidence interval for a sample mean
confidence_interval = stats.norm.interval(alpha=0.95, loc=sample_mean, scale=sample_std / (n**0.5))

The interval function gives a range where the true value likely lies.

The alpha parameter sets the confidence level (e.g., 0.95 means 95%).

Examples

This shows the range where the true average likely falls with 95% confidence.

SciPy

import scipy.stats as stats

# 95% confidence interval for mean 50, std 10, sample size 25
ci = stats.norm.interval(0.95, loc=50, scale=10 / (25**0.5))
print(ci)

The p-value tells how likely the observed data would happen if the true mean was zero.

SciPy

import scipy.stats as stats

# Calculate p-value for a t-test comparing sample mean to 0
t_stat, p_value = stats.ttest_1samp([2,3,5,6,9], 0)
print(f"p-value: {p_value}")

Sample Program

This program calculates the average height and shows a range where the true average height likely lies with 95% confidence. It uses statistics to quantify uncertainty in the average.

SciPy

import scipy.stats as stats

# Sample data: heights in cm
data = [170, 172, 168, 165, 174, 169, 171, 173, 167, 170]

# Calculate sample mean and standard deviation
sample_mean = sum(data) / len(data)
sample_std = (sum((x - sample_mean)**2 for x in data) / (len(data) - 1))**0.5

# Calculate 95% confidence interval for the mean
confidence_interval = stats.norm.interval(0.95, loc=sample_mean, scale=sample_std / (len(data)**0.5))

print(f"Sample mean: {sample_mean:.2f} cm")
print(f"95% confidence interval: ({confidence_interval[0]:.2f}, {confidence_interval[1]:.2f}) cm")

Important Notes

Uncertainty is natural in data because of randomness and measurement limits.

Statistics gives tools to measure and communicate this uncertainty clearly.

Summary

Statistics helps us put numbers on how uncertain we are about data.

Confidence intervals and p-values are common ways to show uncertainty.

Using these tools helps make better, informed decisions.

Practice

1. Why do statisticians use confidence intervals when analyzing data?

easy

A. To show a range where the true value likely lies

B. To find the exact value of a measurement

C. To ignore uncertainty in data

D. To make data look more complex

Solution

1. Step 1: Understand the purpose of confidence intervals

   Confidence intervals provide a range of values that likely contain the true population parameter, showing uncertainty.

2. Step 2: Compare options to this purpose

   Only To show a range where the true value likely lies correctly describes this purpose; others misunderstand or ignore uncertainty.

3. Final Answer:

   To show a range where the true value likely lies -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty = C [OK]

Hint: Confidence intervals give a range, not exact values [OK]

Common Mistakes:

• Thinking confidence intervals give exact values
• Ignoring uncertainty in data
• Confusing confidence intervals with p-values

2. Which of the following is the correct way to import the function for calculating a confidence interval from scipy.stats?

easy

A. from scipy.stats import conf_interval

B. from scipy.stats import t

C. from scipy.stats import tconfint

D. from scipy.stats import t.interval

Solution

1. Step 1: Recall scipy.stats syntax for confidence intervals

   The function to calculate confidence intervals for t-distribution is accessed as t.interval.

2. Step 2: Check import statements

   from scipy.stats import t correctly imports t; others are invalid or incorrect syntax.

3. Final Answer:

   from scipy.stats import t -> Option B

4. Quick Check:

   Correct scipy.stats import syntax = B [OK]

Hint: Use dot notation for submodules like t.interval [OK]

Common Mistakes:

• Trying to import functions that don't exist
• Using wrong function names
• Confusing import syntax with function calls

3. What will be the output of this code snippet?

import numpy as np
from scipy import stats

data = np.array([5, 7, 8, 9, 10])
mean = np.mean(data)
conf_int = stats.t.interval(0.95, len(data)-1, loc=mean, scale=stats.sem(data))
print(conf_int)

medium

A. An error because stats.sem is not defined

B. A single number representing the mean

C. A tuple with two numbers showing the 95% confidence interval

D. A list of all data points

Solution

1. Step 1: Understand the code's purpose

   The code calculates the mean and then the 95% confidence interval using t-distribution and standard error of the mean.

2. Step 2: Analyze the output of stats.t.interval

   This function returns a tuple with lower and upper bounds of the confidence interval, so the print statement outputs a tuple of two numbers.

3. Final Answer:

   A tuple with two numbers showing the 95% confidence interval -> Option C

4. Quick Check:

   stats.t.interval returns confidence bounds = A [OK]

Hint: t.interval returns a tuple (low, high) for confidence [OK]

Common Mistakes:

• Expecting a single number instead of a tuple
• Confusing stats.sem with undefined function
• Thinking output is the raw data list

4. Identify the error in this code that tries to calculate a 90% confidence interval:

from scipy.stats import t

sample = [12, 15, 14, 10, 13]
mean = sum(sample) / len(sample)
interval = t.interval(0.90, len(sample), loc=mean, scale=2)
print(interval)

medium

A. The mean calculation is incorrect

B. The scale parameter cannot be a fixed number like 2

C. The confidence level 0.90 is invalid

D. Degrees of freedom should be len(sample) - 1, not len(sample)

Solution

1. Step 1: Check degrees of freedom parameter

   The degrees of freedom for t-distribution should be sample size minus one, so len(sample) - 1.

2. Step 2: Verify other parameters

   Scale can be a fixed number if it represents standard error; confidence level 0.90 is valid; mean calculation is correct.

3. Final Answer:

   Degrees of freedom should be len(sample) - 1, not len(sample) -> Option D

4. Quick Check:

   Degrees of freedom = sample size - 1 = D [OK]

Hint: Degrees of freedom = sample size minus one [OK]

Common Mistakes:

• Using sample size instead of sample size minus one for df
• Assuming scale must be computed, not fixed
• Misunderstanding confidence level values

5. You have two sets of exam scores from different classes. You want to compare their average scores but also understand how uncertain these averages are. Which approach using scipy best quantifies this uncertainty?

hard

A. Calculate the mean of each class and use stats.t.interval to get confidence intervals for both

B. Calculate the median of each class and compare them directly

C. Use stats.ttest_ind without checking confidence intervals

D. Just compare the highest scores from each class

Solution

1. Step 1: Understand the goal

   You want to compare averages and also quantify uncertainty around those averages.

2. Step 2: Evaluate options for quantifying uncertainty

   Calculating means and confidence intervals with stats.t.interval directly shows uncertainty. Medians or highest scores don't quantify uncertainty. t-test compares means but does not show intervals.

3. Final Answer:

   Calculate the mean of each class and use stats.t.interval to get confidence intervals for both -> Option A

4. Quick Check:

   Confidence intervals quantify uncertainty best = A [OK]

Hint: Confidence intervals show uncertainty around averages [OK]

Common Mistakes:

• Using median without uncertainty measures
• Ignoring confidence intervals in comparisons
• Relying only on highest scores