Data augmentation for images in TensorFlow - Model Metrics & Evaluation

Metrics & Evaluation - Data augmentation for images

Which metric matters for Data Augmentation and WHY

When using data augmentation for images, the main goal is to improve the model's ability to generalize. This means the model should perform well on new, unseen images. The key metrics to watch are validation accuracy and validation loss. These show how well the model works on data it has not seen during training.

Data augmentation helps by creating new, varied images from the original ones. This reduces overfitting, where the model only memorizes training images. So, a good sign of effective augmentation is when validation accuracy improves or stays stable while training accuracy grows.

Confusion Matrix Example

For image classification, a confusion matrix helps us see how well the model predicts each class. Here is an example for a 3-class problem:

      | Predicted: Cat | Predicted: Dog | Predicted: Bird |
      |----------------|----------------|-----------------|
      | True Cat: 45   | 3              | 2               |
      | True Dog: 4    | 40             | 6               |
      | True Bird: 1   | 5              | 44              |
    

This matrix shows the model's correct and wrong guesses. Data augmentation aims to improve these numbers by making the model more robust.

Precision vs Recall Tradeoff with Data Augmentation

In image tasks, precision and recall matter depending on the goal:

• Precision means when the model says an image is a certain class, it is usually right.
• Recall means the model finds most images of that class.

Data augmentation can help balance these by exposing the model to varied images. For example, in medical image diagnosis, high recall is critical to catch all cases. Augmentation helps the model not miss rare patterns.

Good vs Bad Metric Values for Data Augmentation

Good:

• Validation accuracy close to or improving over training accuracy.
• Validation loss decreasing or stable, not increasing.
• Balanced precision and recall for important classes.

Bad:

• Validation accuracy much lower than training accuracy (overfitting).
• Validation loss increasing while training loss decreases.
• Very low recall on important classes, meaning many missed detections.

Common Pitfalls in Metrics with Data Augmentation

• Data Leakage: Augmented images leaking into validation set can falsely boost validation accuracy.
• Overfitting: If augmentation is too weak, model still memorizes training images.
• Underfitting: Too strong augmentation can make images unrealistic, hurting learning.
• Ignoring Class Imbalance: Metrics like accuracy can be misleading if some classes dominate.

Self Check

Your image classifier trained with data augmentation has 98% training accuracy but only 70% validation accuracy. What does this mean?

Answer: This suggests overfitting. The model learned training images well but does not generalize to new images. Data augmentation might be too weak or not diverse enough. You should try stronger or different augmentation techniques and check for data leakage.

Key Result

Validation accuracy and loss are key to check if data augmentation helps the model generalize better.

Practice

1. What is the main purpose of data augmentation in image training with TensorFlow?

easy

A. To create new images by modifying existing ones to improve model learning

B. To reduce the size of the training dataset

C. To convert images into text format

D. To remove noise from images before training

Solution

1. Step 1: Understand data augmentation concept

   Data augmentation means making new images by changing existing images, like flipping or rotating.

2. Step 2: Connect augmentation to model training

   This helps the model see more variety and learn better, improving accuracy.

3. Final Answer:

   To create new images by modifying existing ones to improve model learning -> Option A

4. Quick Check:

   Data augmentation = create new images [OK]

Hint: Augmentation means making new images from old ones [OK]

Common Mistakes:

• Thinking augmentation reduces dataset size
• Confusing augmentation with noise removal
• Believing augmentation converts images to text

2. Which TensorFlow layer is correctly used to flip images horizontally during training?

easy

A. tf.keras.layers.RandomFlip('horizontal')

B. tf.keras.layers.RandomFlip('vertical')

C. tf.keras.layers.RandomRotation(0.5)

D. tf.keras.layers.RandomZoom(0.2)

Solution

1. Step 1: Identify the correct flip direction

   To flip images horizontally, use 'horizontal' as the argument in RandomFlip.

2. Step 2: Match the correct TensorFlow syntax

   RandomFlip('horizontal') flips images left to right, which is the correct usage.

3. Final Answer:

   tf.keras.layers.RandomFlip('horizontal') -> Option A

4. Quick Check:

   Horizontal flip = RandomFlip('horizontal') [OK]

Hint: Use 'horizontal' string inside RandomFlip for left-right flip [OK]

Common Mistakes:

• Using 'vertical' instead of 'horizontal' for horizontal flip
• Confusing RandomFlip with RandomRotation
• Passing numeric values instead of strings to RandomFlip

3. What will be the output shape after applying this augmentation layer to a batch of 32 images of size 64x64x3?

augmentation = tf.keras.Sequential([
  tf.keras.layers.RandomFlip('horizontal'),
  tf.keras.layers.RandomRotation(0.1)
])
augmented_images = augmentation(tf.random.uniform([32, 64, 64, 3]))
print(augmented_images.shape)

medium

A. (32, 128, 128, 3)

B. (64, 64, 3)

C. (32, 64, 64, 3)

D. (32, 64, 64)

Solution

1. Step 1: Understand input shape and augmentation effect

   The input batch has shape (32, 64, 64, 3), meaning 32 images, each 64x64 pixels with 3 color channels.

2. Step 2: Check if augmentation changes shape

   RandomFlip and RandomRotation only modify image content, not size or batch count, so output shape stays the same.

3. Final Answer:

   (32, 64, 64, 3) -> Option C

4. Quick Check:

   Augmentation keeps shape same = (32, 64, 64, 3) [OK]

Hint: Augmentation changes pixels, not image shape [OK]

Common Mistakes:

• Assuming rotation changes image size
• Confusing batch size with image dimensions
• Expecting channel count to change

4. Identify the error in this TensorFlow augmentation code snippet:

augmentation = tf.keras.Sequential([
  tf.keras.layers.RandomFlip(horizontal),
  tf.keras.layers.RandomRotation(0.2)
])

medium

A. Missing input shape in Sequential

B. RandomRotation cannot take float values

C. Sequential cannot contain augmentation layers

D. RandomFlip requires a string argument like 'horizontal', not a variable

Solution

1. Step 1: Check RandomFlip argument type

   RandomFlip expects a string such as 'horizontal' or 'vertical', but here horizontal is used without quotes, treated as a variable.

2. Step 2: Confirm other parts are correct

   RandomRotation accepts float values; Sequential can contain augmentation layers; input shape is optional here.

3. Final Answer:

   RandomFlip requires a string argument like 'horizontal', not a variable -> Option D

4. Quick Check:

   RandomFlip argument must be string [OK]

Hint: Put flip direction in quotes: 'horizontal' [OK]

Common Mistakes:

• Passing variable without quotes to RandomFlip
• Thinking RandomRotation disallows floats
• Believing Sequential can't hold augmentation layers

5. You want to augment only the training images but not validation or test images. Which is the best way to apply augmentation in TensorFlow?

hard

A. Apply augmentation layers inside the model and use them for all data

B. Apply augmentation only on the training dataset pipeline before feeding to the model

C. Augment validation and test data to increase evaluation accuracy

D. Apply augmentation after model prediction to improve results

Solution

1. Step 1: Understand augmentation purpose

   Augmentation is used to increase training data variety to help model learn better.

2. Step 2: Decide where to apply augmentation

   Applying augmentation only on training data pipeline ensures validation and test data remain original for fair evaluation.

3. Final Answer:

   Apply augmentation only on the training dataset pipeline before feeding to the model -> Option B

4. Quick Check:

   Augment training data only = Apply augmentation only on the training dataset pipeline before feeding to the model [OK]

Hint: Augment only training data, not validation/test [OK]

Common Mistakes:

• Augmenting validation or test data
• Applying augmentation after prediction
• Using augmentation layers inside model for all data