Data augmentation in pipeline in TensorFlow - Model Pipeline Trace

Model Pipeline - Data augmentation in pipeline

This pipeline shows how data augmentation helps a model learn better by creating new, varied images from the original ones during training. It makes the model stronger by showing it many different versions of the same image.

Data Flow - 4 Stages

1Original dataset

1000 rows x 32x32x3 images→Load raw images and labels→1000 rows x 32x32x3 images

Image of a cat with label 'cat'

↓

2Data augmentation

1000 rows x 32x32x3 images→Apply random flips, rotations, and brightness changes→1000 rows x 32x32x3 images (augmented)

Flipped cat image, rotated cat image, brighter cat image

↓

3Batching and shuffling

1000 rows x 32x32x3 images→Shuffle data and group into batches of 32→32 rows x 32x32x3 images per batch

Batch of 32 augmented images with labels

↓

4Model input

32 rows x 32x32x3 images→Feed batch into CNN model→32 rows x 10 class probabilities

Batch predictions for 10 classes

Training Trace - Epoch by Epoch

Loss
1.2 |*       
1.0 | *      
0.8 |  *     
0.6 |   *    
0.4 |    *   
    +---------
     1 2 3 4 5
       Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.2	0.55	Model starts learning with augmented data
2	0.9	0.68	Loss decreases, accuracy improves
3	0.7	0.75	Model learns better features from augmented images
4	0.55	0.82	Training stabilizes with good accuracy
5	0.45	0.87	Model converges with augmented data

Prediction Trace - 4 Layers

Layer 1: Input image

Layer 2: Data augmentation

Layer 3: CNN layers

Layer 4: Dense layer with softmax

Model Quiz - 3 Questions

Why do we apply data augmentation in the training pipeline?

A To create more varied training images and improve model learning

B To reduce the size of the dataset

C To make the images black and white

D To speed up the training by skipping images

Key Insight

Data augmentation helps the model see many versions of the same image, which improves its ability to generalize and recognize objects better. This leads to lower loss and higher accuracy during training.

Practice

1. What is the main purpose of data augmentation in a TensorFlow training pipeline?

easy

A. To speed up the training process by skipping some images

B. To reduce the size of the training dataset

C. To create more varied training data by randomly changing original images

D. To convert images into grayscale only

Solution

1. Step 1: Understand data augmentation concept

   Data augmentation creates new training images by applying random changes like flips or rotations to original images.

2. Step 2: Identify the purpose in training pipeline

   This helps the model see more varied examples, improving learning and reducing overfitting.

3. Final Answer:

   To create more varied training data by randomly changing original images -> Option C

4. Quick Check:

   Data augmentation = varied training data [OK]

Hint: Augmentation adds variety to training images [OK]

Common Mistakes:

• Thinking augmentation reduces dataset size
• Believing augmentation speeds training by skipping data
• Assuming augmentation only converts images to grayscale

2. Which of the following is the correct way to add a random flip augmentation layer in a TensorFlow Sequential pipeline?

easy

A. tf.keras.Sequential([tf.keras.layers.RandomFlip('horizontal')])

B. tf.keras.Sequential([tf.keras.layers.FlipRandom('horizontal')])

C. tf.keras.Sequential([tf.keras.layers.RandomFlip(mode='vertical')])

D. tf.keras.Sequential([tf.keras.layers.RandomFlip('diagonal')])

Solution

1. Step 1: Recall TensorFlow augmentation syntax

   The correct layer is RandomFlip with argument 'horizontal' or 'vertical' as a string.

2. Step 2: Check each option

   tf.keras.Sequential([tf.keras.layers.RandomFlip('horizontal')]) uses correct class and argument. tf.keras.Sequential([tf.keras.layers.FlipRandom('horizontal')]) uses wrong class name. tf.keras.Sequential([tf.keras.layers.RandomFlip(mode='vertical')]) uses keyword argument 'mode' which is invalid. tf.keras.Sequential([tf.keras.layers.RandomFlip('diagonal')]) uses unsupported flip mode 'diagonal'.

3. Final Answer:

   tf.keras.Sequential([tf.keras.layers.RandomFlip('horizontal')]) -> Option A

4. Quick Check:

   Correct layer and argument = tf.keras.Sequential([tf.keras.layers.RandomFlip('horizontal')]) [OK]

Hint: Use RandomFlip('horizontal') exactly as named [OK]

Common Mistakes:

• Using wrong layer class name
• Passing arguments with wrong keywords
• Using unsupported flip modes

3. Given the following TensorFlow code snippet, what will be the output shape of the augmented images?

import tensorflow as tf
aug = tf.keras.Sequential([
  tf.keras.layers.RandomFlip('horizontal'),
  tf.keras.layers.RandomRotation(0.1)
])
input_image = tf.random.uniform([1, 128, 128, 3])
output_image = aug(input_image)
print(output_image.shape)

medium

A. (1, 128, 128, 3)

B. (128, 128, 3)

C. (1, 256, 256, 3)

D. (1, 128, 128)

Solution

1. Step 1: Understand input and augmentation layers

   Input shape is (1, 128, 128, 3) meaning batch size 1, 128x128 image with 3 color channels. RandomFlip and RandomRotation do not change image size.

2. Step 2: Check output shape after augmentation

   Augmentation layers keep the shape same, so output shape remains (1, 128, 128, 3).

3. Final Answer:

   (1, 128, 128, 3) -> Option A

4. Quick Check:

   Augmentation keeps shape = (1, 128, 128, 3) [OK]

Hint: Augmentation layers keep input shape unchanged [OK]

Common Mistakes:

• Assuming rotation changes image size
• Ignoring batch dimension in output
• Dropping color channels

4. Identify the error in this TensorFlow data augmentation pipeline code:

import tensorflow as tf
aug = tf.keras.Sequential([
  tf.keras.layers.RandomFlip('horizontal'),
  tf.keras.layers.RandomRotation(0.2, 0.3)
])

medium

A. Missing input shape in Sequential

B. RandomFlip does not accept 'horizontal' as argument

C. Sequential cannot contain augmentation layers

D. RandomRotation requires a single float or tuple, not two separate floats

Solution

1. Step 1: Check RandomRotation layer arguments

   RandomRotation expects either a single float or a tuple like (min_factor, max_factor). Passing two separate floats is invalid.

2. Step 2: Verify other parts

   RandomFlip('horizontal') is valid. Sequential can contain augmentation layers. Input shape is optional here.

3. Final Answer:

   RandomRotation requires a single float or tuple, not two separate floats -> Option D

4. Quick Check:

   RandomRotation argument format error = RandomRotation requires a single float or tuple, not two separate floats [OK]

Hint: RandomRotation needs one float or tuple, not two floats [OK]

Common Mistakes:

• Passing multiple floats instead of tuple to RandomRotation
• Thinking RandomFlip argument is invalid
• Believing Sequential can't hold augmentation layers

5. You want to build a TensorFlow data augmentation pipeline that randomly flips images horizontally, rotates them by up to 20%, and zooms in or out by up to 10%. Which of the following code snippets correctly implements this pipeline?

hard

A. tf.keras.Sequential([
tf.keras.layers.RandomFlip('horizontal'),
tf.keras.layers.RandomRotation(0.2),
tf.keras.layers.RandomZoom((0.1, 0.2))
])

B. tf.keras.Sequential([
tf.keras.layers.RandomFlip('horizontal'),
tf.keras.layers.RandomRotation(0.2),
tf.keras.layers.RandomZoom(0.1)
])

C. tf.keras.Sequential([
tf.keras.layers.RandomFlip('horizontal'),
tf.keras.layers.RandomRotation(0.02),
tf.keras.layers.RandomZoom(10)
])

D. tf.keras.Sequential([
tf.keras.layers.RandomFlip('vertical'),
tf.keras.layers.RandomRotation(20),
tf.keras.layers.RandomZoom((0.1, 0.1))
])

Solution

1. Step 1: Check flip and rotation parameters

   RandomFlip('horizontal') is correct. RandomRotation expects a float fraction (0.2 means 20%).

2. Step 2: Check zoom parameters

   RandomZoom(0.1) means zoom in/out by 10%. tf.keras.Sequential([ tf.keras.layers.RandomFlip('horizontal'), tf.keras.layers.RandomRotation(0.2), tf.keras.layers.RandomZoom((0.1, 0.2)) ]) uses zoom (0.1, 0.2) which is uneven zoom, not requested.

3. Final Answer:

   tf.keras.Sequential([ tf.keras.layers.RandomFlip('horizontal'), tf.keras.layers.RandomRotation(0.2), tf.keras.layers.RandomZoom(0.1) ]) -> Option B

4. Quick Check:

   Correct flip, rotation fraction, and zoom float = tf.keras.Sequential([ tf.keras.layers.RandomFlip('horizontal'), tf.keras.layers.RandomRotation(0.2), tf.keras.layers.RandomZoom(0.1) ]) [OK]

Hint: Use fractions for rotation and single float for zoom [OK]

Common Mistakes:

• Using degrees instead of fraction for rotation
• Passing large numbers to zoom
• Choosing wrong flip direction