Training history and visualization in TensorFlow - ML Experiment: Train & Evaluate

Experiment - Training history and visualization

Problem:You trained a neural network on a small image dataset to classify images into 3 categories. The model runs for 20 epochs.

Current Metrics:Training accuracy: 95%, Validation accuracy: 80%, Training loss: 0.15, Validation loss: 0.45

Issue:The model shows signs of overfitting: training accuracy is much higher than validation accuracy, and validation loss is higher than training loss.

Your Task

Visualize the training and validation accuracy and loss over epochs to better understand the model's learning behavior.

Use TensorFlow and Matplotlib only.

Plot both accuracy and loss on separate graphs.

Include legends and axis labels for clarity.

Hint 1

Hint 2

Hint 3

Solution

TensorFlow

import tensorflow as tf
import matplotlib.pyplot as plt

# Load example dataset
mnist = tf.keras.datasets.mnist
(x_train, y_train), (x_test, y_test) = mnist.load_data()

# Preprocess data
x_train, x_test = x_train / 255.0, x_test / 255.0

# Use only 3 classes for simplicity
train_filter = y_train < 3
test_filter = y_test < 3
x_train, y_train = x_train[train_filter], y_train[train_filter]
x_test, y_test = x_test[test_filter], y_test[test_filter]

# Build simple model
model = tf.keras.Sequential([
    tf.keras.layers.Flatten(input_shape=(28, 28)),
    tf.keras.layers.Dense(64, activation='relu'),
    tf.keras.layers.Dense(3, activation='softmax')
])

model.compile(optimizer='adam',
              loss='sparse_categorical_crossentropy',
              metrics=['accuracy'])

# Train model and save history
history = model.fit(x_train, y_train, epochs=20, validation_data=(x_test, y_test))

# Plot training & validation accuracy values
plt.figure(figsize=(12, 5))
plt.subplot(1, 2, 1)
plt.plot(history.history['accuracy'], label='Train Accuracy')
plt.plot(history.history['val_accuracy'], label='Validation Accuracy')
plt.title('Model Accuracy')
plt.xlabel('Epoch')
plt.ylabel('Accuracy')
plt.legend()

# Plot training & validation loss values
plt.subplot(1, 2, 2)
plt.plot(history.history['loss'], label='Train Loss')
plt.plot(history.history['val_loss'], label='Validation Loss')
plt.title('Model Loss')
plt.xlabel('Epoch')
plt.ylabel('Loss')
plt.legend()

plt.tight_layout()
plt.show()

Added code to plot training and validation accuracy over epochs.

Added code to plot training and validation loss over epochs.

Used matplotlib to create clear, labeled graphs for visualization.

Results Interpretation

Before visualization: You only had numbers showing training and validation accuracy and loss.

After visualization: You see clear graphs showing training accuracy steadily increasing and validation accuracy plateauing or fluctuating, indicating overfitting. Loss graphs show training loss decreasing smoothly while validation loss decreases less or increases.

Visualizing training history helps you understand how your model learns over time and identify issues like overfitting or underfitting. This guides you to improve your model effectively.

Bonus Experiment

Try adding dropout layers to the model and visualize the new training history to see if overfitting reduces.

💡 Hint

Add tf.keras.layers.Dropout(0.5) after the Dense layer and retrain the model.

Practice

1. What does the history.history object store after training a TensorFlow model?

easy

A. The dataset used for training

B. The model's architecture details

C. Loss and accuracy values for each epoch during training

D. The optimizer's internal state

Solution

1. Step 1: Understand what history.history contains

   After training, TensorFlow's model.fit() returns a history object that stores metrics like loss and accuracy for each epoch.

2. Step 2: Identify the correct stored data

   The history.history dictionary holds lists of loss and accuracy values recorded at each epoch for training and validation.

3. Final Answer:

   Loss and accuracy values for each epoch during training -> Option C

4. Quick Check:

   Training metrics stored in history.history = Loss and accuracy values for each epoch during training [OK]

Hint: Remember: history stores metrics per epoch, not model or data [OK]

Common Mistakes:

• Confusing history with model architecture
• Thinking history stores the dataset
• Assuming history holds optimizer state

2. Which of the following is the correct way to plot training and validation accuracy from a TensorFlow history object using matplotlib?

easy

A. plt.plot(history.history['accuracy']); plt.plot(history.history['val_accuracy'])

B. plt.plot(history['accuracy']); plt.plot(history['val_accuracy'])

C. plt.plot(history.accuracy); plt.plot(history.val_accuracy)

D. plt.plot(history.accuracy()); plt.plot(history.val_accuracy())

Solution

1. Step 1: Recall how to access metrics in history object

   The history object stores metrics in a dictionary under history.history. Access keys like 'accuracy' and 'val_accuracy' as dictionary keys.

2. Step 2: Use matplotlib to plot lists from the dictionary

   Use plt.plot() with history.history['accuracy'] and history.history['val_accuracy'] to plot training and validation accuracy.

3. Final Answer:

   plt.plot(history.history['accuracy']); plt.plot(history.history['val_accuracy']) -> Option A

4. Quick Check:

   Access metrics via history.history['key'] for plotting [OK]

Hint: Always access metrics with history.history['metric_name'] [OK]

Common Mistakes:

• Using dot notation instead of dictionary keys
• Calling metrics as functions
• Accessing history directly without .history

3. Given the following code snippet, what will be the output of print(history.history['loss']) after training for 3 epochs?

model.compile(optimizer='adam', loss='sparse_categorical_crossentropy', metrics=['accuracy'])
history = model.fit(x_train, y_train, epochs=3, validation_data=(x_val, y_val))
print(history.history['loss'])

medium

A. A list of 3 loss values, one per epoch

B. An error because 'loss' key does not exist

C. A single float value of final loss

D. [0.8, 0.6, 0.4]

Solution

1. Step 1: Understand what history.history['loss'] contains

   It stores the loss values recorded at the end of each epoch during training as a list.

2. Step 2: Predict the output after 3 epochs

   Since training runs for 3 epochs, the list will have 3 float values representing loss per epoch, not just one or a fixed list.

3. Final Answer:

   A list of 3 loss values, one per epoch -> Option A

4. Quick Check:

   Loss per epoch stored as list = A list of 3 loss values, one per epoch [OK]

Hint: Loss history is a list with one value per epoch [OK]

Common Mistakes:

• Expecting a single float instead of a list
• Assuming fixed loss values without training
• Thinking 'loss' key is missing

4. Identify the error in this code snippet that tries to plot training and validation loss:

import matplotlib.pyplot as plt
plt.plot(history['loss'])
plt.plot(history['val_loss'])
plt.show()

medium

A. plt.plot() cannot plot lists

B. history should be accessed as history.history, not directly

C. Missing plt.title() causes error

D. No error, code runs fine

Solution

1. Step 1: Check how history metrics are accessed

   The history object stores metrics inside the history attribute, so direct access like history['loss'] is incorrect.

2. Step 2: Correct the access to history.history['loss']

   To fix, use history.history['loss'] and history.history['val_loss'] for plotting.

3. Final Answer:

   history should be accessed as history.history, not directly -> Option B

4. Quick Check:

   Access metrics via history.history, not history [OK]

Hint: Use history.history to access metrics, not history alone [OK]

Common Mistakes:

• Accessing history metrics directly
• Assuming plt.plot can't plot lists
• Thinking missing title causes error

5. You trained a model for 10 epochs but notice the validation loss increases after epoch 5 while training loss decreases. How can visualizing the training history help you decide the next step?

hard

A. It suggests increasing the learning rate to fix validation loss

B. It confirms the model is perfect, so no changes needed

C. It means the training data is incorrect and should be discarded

D. It shows overfitting, so you might stop training early or add regularization

Solution

1. Step 1: Interpret the training and validation loss curves

   When training loss decreases but validation loss increases, it indicates the model is overfitting the training data.

2. Step 2: Decide actions based on visualization

   Visualizing history helps identify overfitting, suggesting to stop early, add dropout, or use regularization to improve generalization.

3. Final Answer:

   It shows overfitting, so you might stop training early or add regularization -> Option D

4. Quick Check:

   Increasing validation loss with decreasing training loss = overfitting [OK]

Hint: Watch for validation loss rising while training loss falls [OK]

Common Mistakes:

• Ignoring validation loss trends
• Increasing learning rate without reason
• Assuming data is wrong without checking