Classification reports in TensorFlow - Model Pipeline Trace

Model Pipeline - Classification reports

This pipeline trains a simple neural network to classify images into categories. After training, it evaluates the model using a classification report that shows precision, recall, and F1-score for each class.

Data Flow - 5 Stages

1Data Loading

60000 rows x 28 x 28 pixels→Load grayscale images of handwritten digits (0-9)→60000 rows x 28 x 28 pixels

Image of digit '5' represented as 28x28 pixel matrix

↓

2Preprocessing

60000 rows x 28 x 28 pixels→Normalize pixel values to range 0-1 and flatten images→60000 rows x 784 columns

Pixel values scaled from 0-255 to 0-1, flattened to 784 features

↓

3Train/Test Split

60000 rows x 784 columns→Split data into training (50000) and testing (10000) sets→50000 rows x 784 columns (train), 10000 rows x 784 columns (test)

Training set contains images and labels for model learning

↓

4Model Training

50000 rows x 784 columns→Train neural network with 1 hidden layer and softmax output→Model weights updated for 10 output classes

Model learns to map input features to digit classes 0-9

↓

5Evaluation

10000 rows x 784 columns→Predict classes and generate classification report→Classification report with precision, recall, F1-score per class

Class '3': precision=0.95, recall=0.93, F1-score=0.94

Training Trace - Epoch by Epoch

Loss
0.5 |****
0.4 |****
0.3 |***
0.2 |**
0.1 |*
    +---------
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.45	0.85	Model starts learning, accuracy improves quickly
2	0.30	0.91	Loss decreases, accuracy continues to improve
3	0.22	0.94	Model converges with good accuracy
4	0.18	0.95	Loss decreases slightly, accuracy stabilizes
5	0.15	0.96	Final epoch shows best performance

Prediction Trace - 4 Layers

Layer 1: Input Layer

Layer 2: Hidden Layer (ReLU activation)

Layer 3: Output Layer (Softmax)

Layer 4: Prediction

Model Quiz - 3 Questions

What does the classification report show after model evaluation?

A Precision, recall, and F1-score for each class

B Only the overall accuracy of the model

C The number of training epochs completed

D The input image size

Key Insight

Classification reports provide detailed insight into how well a model performs on each class, beyond just overall accuracy. They help identify strengths and weaknesses in classification tasks.

Practice

1. What does a classification report in TensorFlow typically show?

easy

A. Precision, recall, and F1-score for each class

B. The model's training time

C. The number of layers in the model

D. The size of the input data

Solution

1. Step 1: Understand classification report contents

   A classification report summarizes key metrics like precision, recall, and F1-score for each class predicted by the model.

2. Step 2: Identify what is NOT included

   Training time, model layers, and input size are not part of the classification report.

3. Final Answer:

   Precision, recall, and F1-score for each class -> Option A

4. Quick Check:

   Classification report = precision, recall, F1-score [OK]

Hint: Look for metrics per class, not model structure or time [OK]

Common Mistakes:

• Confusing training time with performance metrics
• Thinking model architecture details are in the report
• Assuming input data size is shown

2. Which code snippet correctly imports the function to generate a classification report in TensorFlow's ecosystem?

easy

A. import classification_report from tensorflow

B. import tensorflow.classification_report as cr

C. from sklearn.metrics import classification_report

D. from tensorflow.metrics import classification_report

Solution

1. Step 1: Recall the source of classification_report

   The classification_report function is part of scikit-learn, not TensorFlow directly.

2. Step 2: Check import syntax correctness

   from sklearn.metrics import classification_report uses correct Python import syntax from sklearn.metrics. Other options are invalid or incorrect.

3. Final Answer:

   from sklearn.metrics import classification_report -> Option C

4. Quick Check:

   Import classification_report from sklearn.metrics [OK]

Hint: classification_report is from sklearn, not tensorflow [OK]

Common Mistakes:

• Trying to import classification_report directly from tensorflow
• Using incorrect import syntax
• Confusing TensorFlow metrics with sklearn metrics

3. Given the following code, what will be the printed output?

from sklearn.metrics import classification_report
true_labels = [0, 1, 0, 1]
pred_labels = [0, 0, 0, 1]
print(classification_report(true_labels, pred_labels))

medium

A. Empty output with no metrics

B. A report showing precision, recall, and F1-score for classes 0 and 1

C. An error because labels are integers

D. Only accuracy score printed

Solution

1. Step 1: Understand input labels and predictions

   Labels are valid integers representing two classes: 0 and 1. Predictions have one mistake at index 1.

2. Step 2: What classification_report prints

   The function prints precision, recall, F1-score, and support for each class, not just accuracy or errors.

3. Final Answer:

   A report showing precision, recall, and F1-score for classes 0 and 1 -> Option B

4. Quick Check:

   classification_report outputs metrics per class [OK]

Hint: classification_report prints detailed metrics, not just accuracy [OK]

Common Mistakes:

• Expecting an error due to integer labels
• Thinking only accuracy is printed
• Assuming no output if predictions differ

4. Identify the error in this code snippet that tries to print a classification report:

from sklearn.metrics import classification_report
true = [1, 0, 1]
pred = [1, 0]
print(classification_report(true, pred))

medium

A. print statement syntax is wrong

B. classification_report is not imported correctly

C. Labels must be strings, not integers

D. The true and pred lists have different lengths

Solution

1. Step 1: Check input list lengths

   True labels list has 3 elements, predicted labels list has 2 elements. They must be the same length.

2. Step 2: Verify other code parts

   Import and print syntax are correct. Labels can be integers.

3. Final Answer:

   The true and pred lists have different lengths -> Option D

4. Quick Check:

   Input lists must match in length [OK]

Hint: Check if true and predicted label lists have same length [OK]

Common Mistakes:

• Ignoring length mismatch
• Thinking labels must be strings
• Assuming import or print is wrong

5. You trained a TensorFlow model for 3 classes: cat, dog, and rabbit. After predictions, you get this classification report:

              precision    recall  f1-score   support

         cat       0.90      0.95      0.92       100
         dog       0.70      0.60      0.65       100
      rabbit       0.50      0.40      0.44       100

    accuracy                           0.68       300
   macro avg       0.70      0.65      0.67       300
weighted avg       0.70      0.68      0.68       300

What should you focus on to improve your model?

hard

A. Improve the model's performance on the rabbit class

B. Increase the support for the cat class

C. Reduce the number of classes

D. Ignore the dog class since it has moderate scores

Solution

1. Step 1: Analyze class-wise metrics

   Rabbit class has the lowest precision (0.50), recall (0.40), and F1-score (0.44), indicating poor performance.

2. Step 2: Decide improvement focus

   Improving rabbit predictions will raise overall accuracy and balance. Increasing support or ignoring classes is not helpful.

3. Final Answer:

   Improve the model's performance on the rabbit class -> Option A

4. Quick Check:

   Lowest metrics class needs improvement [OK]

Hint: Focus on class with lowest F1-score to improve model [OK]

Common Mistakes:

• Trying to increase support instead of improving metrics
• Ignoring poorly performing classes
• Reducing classes without reason