Residual analysis in ML Python

Introduction

Residual analysis helps us check how well a model fits data by looking at the differences between actual and predicted values.

After training a regression model to see if predictions are accurate.

To find patterns in errors that suggest the model is missing something.

When deciding if a model is good enough for making decisions.

To check if assumptions about data (like constant error size) hold true.

When comparing different models to pick the best one.

Syntax

ML Python

residuals = actual_values - predicted_values

Residuals are simply the difference between what really happened and what the model guessed.

They help us find if the model is making consistent mistakes.

Examples

This example calculates residuals for three points and prints them.

ML Python

actual = [3, 5, 7]
predicted = [2.5, 5.5, 6.8]
residuals = [a - p for a, p in zip(actual, predicted)]
print(residuals)

Using numpy arrays to find residuals for faster calculations on bigger data.

ML Python

import numpy as np
actual = np.array([10, 15, 20])
predicted = np.array([9, 14, 22])
residuals = actual - predicted
print(residuals)

Sample Model

This program trains a simple linear regression model, predicts values, calculates residuals, and shows the mean squared error to measure overall error size.

ML Python

import numpy as np
from sklearn.linear_model import LinearRegression
from sklearn.metrics import mean_squared_error

# Sample data
X = np.array([[1], [2], [3], [4], [5]])
y = np.array([3, 4, 2, 5, 6])

# Train a simple linear regression model
model = LinearRegression()
model.fit(X, y)

# Predict values
predictions = model.predict(X)

# Calculate residuals
residuals = y - predictions

# Calculate mean squared error
mse = mean_squared_error(y, predictions)

print(f"Predictions: {predictions}")
print(f"Residuals: {residuals}")
print(f"Mean Squared Error: {mse:.3f}")

Important Notes

Residuals close to zero mean the model predicts well for those points.

Look for patterns in residuals; random scatter means good fit, patterns mean problems.

Residual analysis is mostly used for regression, not classification.

Summary

Residuals show the difference between actual and predicted values.

They help check if a model fits data well or misses patterns.

Mean squared error summarizes the average size of residuals.

Practice

1. What does a residual represent in machine learning?

easy

A. The difference between the actual and predicted values

B. The predicted value itself

C. The average of all predicted values

D. The sum of all actual values

Solution

1. Step 1: Understand residual definition

   A residual is the error between what the model predicts and what actually happened.

2. Step 2: Match with options

   The difference between the actual and predicted values correctly states this difference, while others describe unrelated concepts.

3. Final Answer:

   The difference between the actual and predicted values -> Option A

4. Quick Check:

   Residual = Actual - Predicted [OK]

Hint: Residuals = Actual minus Predicted values [OK]

Common Mistakes:

• Confusing residual with predicted value
• Thinking residual is the average error
• Mixing residual with total sum of values

2. Which of the following is the correct formula to calculate a residual for a data point?

easy

A. Residual = Actual value + Predicted value

B. Residual = Predicted value - Actual value

C. Residual = Actual value - Predicted value

D. Residual = Predicted value / Actual value

Solution

1. Step 1: Recall residual calculation formula

   Residual is calculated as Actual value minus Predicted value.

2. Step 2: Identify correct option

   Residual = Actual value - Predicted value matches the formula exactly; others are incorrect operations.

3. Final Answer:

   Residual = Actual value - Predicted value -> Option C

4. Quick Check:

   Residual = Actual - Predicted [OK]

Hint: Subtract predicted from actual to get residual [OK]

Common Mistakes:

• Reversing the subtraction order
• Adding values instead of subtracting
• Dividing values instead of subtracting

3. Given the actual values [3, 5, 7] and predicted values [2, 5, 8], what is the residual for the third data point?

medium

A. 1

B. -1

C. 0

D. 2

Solution

1. Step 1: Identify actual and predicted values for third point

   Actual = 7, Predicted = 8 for the third data point.

2. Step 2: Calculate residual

   Residual = Actual - Predicted = 7 - 8 = -1.

3. Final Answer:

   -1 -> Option B

4. Quick Check:

   7 - 8 = -1 [OK]

Hint: Subtract predicted from actual for the point [OK]

Common Mistakes:

• Mixing up actual and predicted values
• Calculating predicted minus actual
• Using wrong index for data point

4. You have a residuals list: [2, -3, 4, -1]. Which code snippet correctly calculates the mean squared error (MSE)?

medium

A. mse = sum([r**2 for r in residuals]) / len(residuals)

B. mse = sum([abs(r) for r in residuals]) / len(residuals)

C. mse = max(residuals) - min(residuals)

D. mse = sum(residuals) / len(residuals)

Solution

1. Step 1: Understand MSE formula

   MSE is the average of squared residuals, so square each residual and average them.

2. Step 2: Match code to formula

   mse = sum([r**2 for r in residuals]) / len(residuals) squares each residual and divides by count, matching MSE calculation.

3. Final Answer:

   mse = sum([r**2 for r in residuals]) / len(residuals) -> Option A

4. Quick Check:

   MSE = average of squared residuals [OK]

Hint: Square residuals then average for MSE [OK]

Common Mistakes:

• Using sum instead of sum of squares
• Calculating mean absolute error instead
• Using max-min difference instead of average

5. A model's residual plot shows a clear curve pattern instead of random scatter. What does this indicate about the model?

hard

A. The model fits the data perfectly

B. The model has no bias

C. The residuals are normally distributed

D. The model misses a non-linear pattern in data

Solution

1. Step 1: Interpret residual plot pattern

   A curve pattern in residuals suggests systematic error, meaning the model misses some pattern.

2. Step 2: Identify what pattern means

   This usually means the model is too simple and misses non-linear relationships.

3. Final Answer:

   The model misses a non-linear pattern in data -> Option D

4. Quick Check:

   Curved residuals = missed non-linear pattern [OK]

Hint: Curved residuals mean model misses pattern [OK]

Common Mistakes:

• Assuming perfect fit from residual pattern
• Confusing residual distribution with residual pattern
• Ignoring bias presence in model