Residual analysis in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a residual in machine learning?

A residual is the difference between the actual value and the predicted value from a model. It shows how much the model's prediction misses the true value.

beginner

Why do we analyze residuals after training a model?

We analyze residuals to check if the model fits the data well. Residual analysis helps find patterns that show if the model is biased or missing something important.

intermediate

What does it mean if residuals show a clear pattern when plotted?

If residuals show a pattern, it means the model is not capturing some structure in the data. This suggests the model may be too simple or missing key features.

intermediate

How can residual analysis help detect heteroscedasticity?

Heteroscedasticity means the residuals have changing spread or variance across predicted values. Residual plots can show this if residuals fan out or shrink as predictions change.

beginner

What is the ideal distribution of residuals for a good regression model?

The ideal residuals are randomly scattered around zero with no clear pattern and have constant variance. They should look like random noise.

What does a residual represent in a regression model?

A Difference between actual and predicted values

B Sum of all predicted values

C Average of actual values

D Product of actual and predicted values

Residuals measure how far off predictions are from actual values.

If residuals form a clear curve pattern, what does it indicate?

A Model fits perfectly

B Residuals are random noise

C Model misses some data structure

D Data has no variance

A pattern in residuals means the model is not capturing all relationships.

What is heteroscedasticity in residual analysis?

A Residuals have constant variance

B Residuals are negative

C Residuals are all zero

D Residuals have changing variance

Heteroscedasticity means residual spread changes with predicted values.

Why should residuals be randomly scattered around zero?

A To show model bias

B To indicate model errors are random

C To confirm data is noisy

D To prove model is complex

Random residuals mean errors are due to chance, not model flaws.

Which plot is commonly used for residual analysis?

A Scatter plot of residuals vs predicted values

B Histogram of predictions

C Line plot of actual values

D Bar chart of feature importance

Plotting residuals against predicted values helps detect patterns.

Explain what residual analysis is and why it is important in machine learning.

Think about how residuals show model errors and what patterns in them mean.

Describe how you would use a residual plot to check if a regression model is appropriate.

Consider what a good residual plot looks like and what problems it can reveal.

Practice

1. What does a residual represent in machine learning?

easy

A. The difference between the actual and predicted values

B. The predicted value itself

C. The average of all predicted values

D. The sum of all actual values

Solution

1. Step 1: Understand residual definition

   A residual is the error between what the model predicts and what actually happened.

2. Step 2: Match with options

   The difference between the actual and predicted values correctly states this difference, while others describe unrelated concepts.

3. Final Answer:

   The difference between the actual and predicted values -> Option A

4. Quick Check:

   Residual = Actual - Predicted [OK]

Hint: Residuals = Actual minus Predicted values [OK]

Common Mistakes:

• Confusing residual with predicted value
• Thinking residual is the average error
• Mixing residual with total sum of values

2. Which of the following is the correct formula to calculate a residual for a data point?

easy

A. Residual = Actual value + Predicted value

B. Residual = Predicted value - Actual value

C. Residual = Actual value - Predicted value

D. Residual = Predicted value / Actual value

Solution

1. Step 1: Recall residual calculation formula

   Residual is calculated as Actual value minus Predicted value.

2. Step 2: Identify correct option

   Residual = Actual value - Predicted value matches the formula exactly; others are incorrect operations.

3. Final Answer:

   Residual = Actual value - Predicted value -> Option C

4. Quick Check:

   Residual = Actual - Predicted [OK]

Hint: Subtract predicted from actual to get residual [OK]

Common Mistakes:

• Reversing the subtraction order
• Adding values instead of subtracting
• Dividing values instead of subtracting

3. Given the actual values [3, 5, 7] and predicted values [2, 5, 8], what is the residual for the third data point?

medium

A. 1

B. -1

C. 0

D. 2

Solution

1. Step 1: Identify actual and predicted values for third point

   Actual = 7, Predicted = 8 for the third data point.

2. Step 2: Calculate residual

   Residual = Actual - Predicted = 7 - 8 = -1.

3. Final Answer:

   -1 -> Option B

4. Quick Check:

   7 - 8 = -1 [OK]

Hint: Subtract predicted from actual for the point [OK]

Common Mistakes:

• Mixing up actual and predicted values
• Calculating predicted minus actual
• Using wrong index for data point

4. You have a residuals list: [2, -3, 4, -1]. Which code snippet correctly calculates the mean squared error (MSE)?

medium

A. mse = sum([r**2 for r in residuals]) / len(residuals)

B. mse = sum([abs(r) for r in residuals]) / len(residuals)

C. mse = max(residuals) - min(residuals)

D. mse = sum(residuals) / len(residuals)

Solution

1. Step 1: Understand MSE formula

   MSE is the average of squared residuals, so square each residual and average them.

2. Step 2: Match code to formula

   mse = sum([r**2 for r in residuals]) / len(residuals) squares each residual and divides by count, matching MSE calculation.

3. Final Answer:

   mse = sum([r**2 for r in residuals]) / len(residuals) -> Option A

4. Quick Check:

   MSE = average of squared residuals [OK]

Hint: Square residuals then average for MSE [OK]

Common Mistakes:

• Using sum instead of sum of squares
• Calculating mean absolute error instead
• Using max-min difference instead of average

5. A model's residual plot shows a clear curve pattern instead of random scatter. What does this indicate about the model?

hard

A. The model fits the data perfectly

B. The model has no bias

C. The residuals are normally distributed

D. The model misses a non-linear pattern in data

Solution

1. Step 1: Interpret residual plot pattern

   A curve pattern in residuals suggests systematic error, meaning the model misses some pattern.

2. Step 2: Identify what pattern means

   This usually means the model is too simple and misses non-linear relationships.

3. Final Answer:

   The model misses a non-linear pattern in data -> Option D

4. Quick Check:

   Curved residuals = missed non-linear pattern [OK]

Hint: Curved residuals mean model misses pattern [OK]

Common Mistakes:

• Assuming perfect fit from residual pattern
• Confusing residual distribution with residual pattern
• Ignoring bias presence in model