Confusion matrix in ML Python - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a confusion matrix in machine learning?

A confusion matrix is a table that shows the performance of a classification model by comparing actual labels with predicted labels. It helps us see how many predictions were correct or wrong for each class.

beginner

What do the terms True Positive (TP), False Positive (FP), True Negative (TN), and False Negative (FN) mean in a confusion matrix?

TP: Model correctly predicted positive.
FP: Model predicted positive but it was negative.
TN: Model correctly predicted negative.
FN: Model predicted negative but it was positive.

intermediate

How can a confusion matrix help in understanding model errors?

It shows exactly where the model makes mistakes by counting wrong predictions for each class. This helps us know if the model confuses certain classes more than others.

intermediate

What is the difference between accuracy and precision using confusion matrix terms?

Accuracy = (TP + TN) / Total predictions, shows overall correctness.
Precision = TP / (TP + FP), shows how many predicted positives are actually positive.

advanced

Why is a confusion matrix especially useful for imbalanced datasets?

Because accuracy can be misleading when classes are imbalanced, the confusion matrix shows detailed counts of each type of error, helping us understand model performance on minority classes.

What does the cell in the confusion matrix representing False Negative (FN) indicate?

A Model predicted negative but actual was positive

B Model predicted negative and actual was negative

C Model predicted positive and actual was positive

D Model predicted positive but actual was negative

False Negative means the model missed a positive case by predicting it as negative.

Which metric can be directly calculated from a confusion matrix?

A Learning rate

B Accuracy

C Number of features

D Epoch count

Accuracy is calculated as (TP + TN) divided by total predictions, all values found in the confusion matrix.

If a confusion matrix has high False Positives, what does it mean?

A Model predicts all cases correctly

B Model often misses positive cases

C Model often wrongly predicts positive when it is negative

D Model has no errors

High False Positives means the model wrongly labels negative cases as positive.

Why might accuracy be misleading on imbalanced datasets?

A Because it ignores the number of features

B Because it only counts True Positives

C Because it depends on the learning rate

D Because it can be high even if the model ignores minority class

Accuracy can be high if the model predicts the majority class well but fails on minority classes, hiding poor performance.

Which of these is NOT part of a confusion matrix?

A Learning Rate

B True Positive

C False Negative

D True Negative

Learning rate is a training parameter, not part of the confusion matrix.

Explain what a confusion matrix is and how it helps evaluate a classification model.

Think about how a table can show correct and wrong predictions.

Describe the four parts of a confusion matrix and what each part means.

Consider what happens when the model guesses right or wrong for positive and negative cases.

Practice

1.

What does a confusion matrix primarily show in machine learning?

easy

A. The number of correct and incorrect predictions for each class

B. The speed of the model training process

C. The size of the dataset used for training

D. The number of features in the dataset

Solution

1. Step 1: Understand the purpose of a confusion matrix

   A confusion matrix shows how many times a model predicted each class correctly or incorrectly.

2. Step 2: Identify what it displays

   It displays counts of true positives, true negatives, false positives, and false negatives for each class.

3. Final Answer:

   The number of correct and incorrect predictions for each class -> Option A

4. Quick Check:

   Confusion matrix = correct and incorrect counts [OK]

Hint: Confusion matrix counts correct and wrong guesses per class [OK]

Common Mistakes:

• Thinking it shows training speed
• Confusing it with dataset size
• Assuming it shows feature count

2.

Which of the following is the correct way to represent a confusion matrix for a binary classifier?

[[TP, FP],
 [FN, TN]]

easy

A. true Positives, false Positives in first row; false Negatives, true Negatives in second row

B. true Negatives, false Negatives in first row; false Positives, true Positives in second row

C. false Positives, true Positives in first row; true Negatives, false Negatives in second row

D. false Negatives, true Negatives in first row; true Positives, false Positives in second row

Solution

1. Step 1: Recall confusion matrix layout for binary classification

   The standard layout is: first row has true Positives (TP) and false Positives (FP), second row has false Negatives (FN) and true Negatives (TN).

2. Step 2: Match the given matrix to the layout

   The given matrix [[TP, FP], [FN, TN]] matches the standard layout exactly.

3. Final Answer:

   true Positives, false Positives in first row; false Negatives, true Negatives in second row -> Option A

4. Quick Check:

   Binary confusion matrix = [[TP, FP], [FN, TN]] [OK]

Hint: Remember TP and FP are in the first row [OK]

Common Mistakes:

• Swapping rows and columns
• Confusing FP with FN positions
• Mixing up TP and TN placement

3.

Given the confusion matrix for a 3-class classifier:

[[5, 2, 0],
 [1, 7, 1],
 [0, 2, 6]]

What is the total number of correct predictions?

medium

A. 22

B. 20

C. 21

D. 18

Solution

1. Step 1: Identify correct predictions in confusion matrix

   Correct predictions are on the diagonal: 5 (class 1), 7 (class 2), and 6 (class 3).

2. Step 2: Sum the diagonal values

   5 + 7 + 6 = 18 correct predictions in total.

3. Final Answer:

   18 -> Option D

4. Quick Check:

   Sum diagonal = 18 correct predictions [OK]

Hint: Sum diagonal elements for correct predictions [OK]

Common Mistakes:

• Summing all matrix elements instead of diagonal
• Adding off-diagonal values by mistake
• Ignoring one of the diagonal values

4.

Consider this confusion matrix for a binary classifier:

[[50, 10],
 [5, 35]]

There is a mistake in interpreting the false Positives (FP). Which is the correct FP count?

medium

A. 50

B. 5

C. 10

D. 35

Solution

1. Step 1: Recall FP position in confusion matrix

   In a binary confusion matrix [[TP, FP], [FN, TN]], FP is at position [0][1].

2. Step 2: Identify FP value in given matrix

   Value at [0][1] is 10, so FP = 10.

3. Final Answer:

   10 -> Option C

4. Quick Check:

   FP = matrix[0][1] = 10 [OK]

Hint: FP is always top-right in binary confusion matrix [OK]

Common Mistakes:

• Confusing FP with FN
• Taking FP as bottom-left value
• Mixing FP with TN or TP

5.

A model's confusion matrix for a 3-class problem is:

[[40, 5, 0],
 [3, 30, 7],
 [0, 2, 38]]

Calculate the overall accuracy of the model.

hard

A. 0.82

B. 0.85

C. 0.88

D. 0.90

Solution

1. Step 1: Calculate total correct predictions

   Sum diagonal: 40 + 30 + 38 = 108 correct predictions.

2. Step 2: Calculate total predictions

   Sum all elements: (40+5+0) + (3+30+7) + (0+2+38) = 45 + 40 + 40 = 125 total predictions.

3. Step 3: Compute accuracy

   Accuracy = correct / total = 108 / 125 = 0.864, rounded to 0.86.

4. Final Answer:

   0.86 -> Option B

5. Quick Check:

   Accuracy = 108/125 ≈ 0.86 [OK]

Hint: Accuracy = sum diagonal / sum all elements [OK]

Common Mistakes:

• Using only one class's correct count
• Forgetting to sum all matrix elements
• Rounding incorrectly