Why statistics validates hypotheses in Data Analysis Python - Quick Recap

Recall & Review

beginner

What is the main purpose of hypothesis testing in statistics?

The main purpose is to decide if there is enough evidence in data to support a specific claim or idea about a population.

beginner

What role does a p-value play in validating hypotheses?

A p-value measures how likely the observed data would occur if the null hypothesis were true. A small p-value suggests strong evidence against the null hypothesis.

intermediate

Why do we use a significance level (alpha) in hypothesis testing?

The significance level sets a threshold to decide when to reject the null hypothesis. It controls the chance of wrongly rejecting a true null hypothesis.

beginner

How does sample data help in validating hypotheses?

Sample data provides evidence about the population. By analyzing it, we estimate if the hypothesis is likely true or false for the whole group.

intermediate

What does it mean if a hypothesis test fails to reject the null hypothesis?

It means there is not enough evidence from the data to support the alternative idea, but it does not prove the null hypothesis is true.

What is the null hypothesis in hypothesis testing?

A A statement that there is no effect or difference

B A statement that there is an effect or difference

C A random guess about the data

D A conclusion after testing

The null hypothesis assumes no effect or difference and is tested against the data.

What does a p-value less than the significance level indicate?

A Data is invalid

B Accept the null hypothesis

C Reject the null hypothesis

D Increase sample size

A p-value smaller than alpha means the data is unlikely under the null, so we reject it.

Why do we use samples instead of whole populations in hypothesis testing?

A Because samples are always more accurate

B Because samples are easier and cheaper to collect

C Because populations are always biased

D Because populations never change

Samples save time and resources while still providing useful information about populations.

What does it mean if the test fails to reject the null hypothesis?

A The null hypothesis is definitely true

B The alternative hypothesis is true

C The data is incorrect

D There is not enough evidence to support the alternative

Failing to reject means insufficient evidence, not proof of truth.

What is the significance level (alpha) used for?

A To set the threshold for rejecting the null hypothesis

B To calculate the p-value

C To collect sample data

D To prove the hypothesis is true

Alpha defines how strong the evidence must be to reject the null hypothesis.

Explain in your own words why statistics helps us decide if a hypothesis is valid.

Think about how data tells a story about the population.

Describe what happens when a hypothesis test rejects or fails to reject the null hypothesis.

Focus on what the test results mean for the hypothesis.

Practice

1. What does a small p-value indicate in hypothesis testing?

easy

A. The data is random and unimportant

B. Strong evidence against the null hypothesis

C. The hypothesis is definitely true

D. The sample size is too small

Solution

1. Step 1: Understand p-value meaning

   A p-value measures how likely the observed data would occur if the null hypothesis were true.

2. Step 2: Interpret small p-value

   A small p-value means the observed data is unlikely under the null hypothesis, so we have strong evidence against it.

3. Final Answer:

   Strong evidence against the null hypothesis -> Option B

4. Quick Check:

   Small p-value = reject null hypothesis [OK]

Hint: Small p-value means reject null hypothesis [OK]

Common Mistakes:

• Thinking small p-value proves hypothesis true
• Confusing p-value with sample size
• Assuming p-value shows data randomness

2. Which Python library is commonly used to perform hypothesis testing?

easy

A. matplotlib

B. seaborn

C. scipy.stats

D. pandas

Solution

1. Step 1: Identify libraries for statistics

   matplotlib and seaborn are for plotting; pandas is for data handling.

2. Step 2: Recognize scipy.stats role

   scipy.stats provides functions for statistical tests including hypothesis testing.

3. Final Answer:

   scipy.stats -> Option C

4. Quick Check:

   scipy.stats = stats tests [OK]

Hint: Use scipy.stats for hypothesis tests in Python [OK]

Common Mistakes:

• Choosing plotting libraries for testing
• Confusing data handling with testing
• Not knowing scipy.stats functions

3. What is the output of this Python code snippet?

from scipy import stats
sample = [5, 7, 8, 6, 9]
result = stats.ttest_1samp(sample, 7)
print(round(result.pvalue, 3))

medium

A. 0.317

B. 0.045

C. 0.500

D. 0.001

Solution

1. Step 1: Understand t-test function

   stats.ttest_1samp tests if sample mean differs from 7.

2. Step 2: Calculate p-value

   Running the code gives p-value approximately 0.317, meaning no strong evidence against mean=7.

3. Final Answer:

   0.317 -> Option A

4. Quick Check:

   ttest p-value ≈ 0.317 [OK]

Hint: Run code to get exact p-value [OK]

Common Mistakes:

• Assuming p-value is always below 0.05
• Mixing up test statistic and p-value
• Rounding errors in p-value

4. Identify the error in this hypothesis test code:

from scipy import stats
sample = [10, 12, 9, 11]
p_value = stats.ttest_1samp(sample, 10)
if p_value < 0.05:
    print("Reject null hypothesis")
else:
    print("Fail to reject null hypothesis")

medium

A. p_value is a tuple, should use p_value.pvalue

B. Comparison operator should be == not <

C. Sample size is too small for t-test

D. Missing import for numpy

Solution

1. Step 1: Check return type of ttest_1samp

   stats.ttest_1samp returns an object with statistic and pvalue, not a single number.

2. Step 2: Correct p-value access

   We must use p_value.pvalue to get the p-value number for comparison.

3. Final Answer:

   p_value is a tuple, should use p_value.pvalue -> Option A

4. Quick Check:

   Use .pvalue attribute to get p-value [OK]

Hint: Use .pvalue attribute from ttest result [OK]

Common Mistakes:

• Comparing whole result object directly
• Wrong comparison operator
• Assuming numpy import needed here

5. You want to test if a new teaching method improves scores. You collect scores from 30 students before and after. Which statistical test best validates your hypothesis?

hard

A. Independent two-sample t-test

B. Chi-square test

C. One-sample z-test

D. Paired t-test

Solution

1. Step 1: Identify data type and design

   Scores are from same students before and after, so data is paired.

2. Step 2: Choose correct test for paired data

   Paired t-test compares means of related samples to check improvement.

3. Final Answer:

   Paired t-test -> Option D

4. Quick Check:

   Paired data needs paired t-test [OK]

Hint: Use paired t-test for before-after same subjects [OK]

Common Mistakes:

• Using independent t-test for paired data
• Choosing chi-square for numeric scores
• Using z-test without population variance