Image generation basics in TensorFlow - ML Experiment: Train & Evaluate

Experiment - Image generation basics

Problem:We want to train a simple neural network to classify small grayscale images of handwritten digits from the MNIST dataset.

Current Metrics:Training loss: 0.05, Validation loss: 0.20, Training accuracy: 98%, Validation accuracy: 75%

Issue:The model overfits: training accuracy is very high but validation accuracy is much lower, showing poor generalization.

Your Task

Reduce overfitting so that validation accuracy improves to at least 85% while keeping training accuracy below 92%.

You can only modify the model architecture and training hyperparameters.

Do not change the dataset or input image size.

Use TensorFlow and Keras only.

Hint 1

Hint 2

Hint 3

Hint 4

Solution

TensorFlow

import tensorflow as tf
from tensorflow.keras import layers, models

# Load MNIST dataset
(train_images, train_labels), (test_images, test_labels) = tf.keras.datasets.mnist.load_data()

# Normalize images
train_images = train_images.astype('float32') / 255.0
test_images = test_images.astype('float32') / 255.0

# Expand dims for channel
train_images = train_images[..., tf.newaxis]
test_images = test_images[..., tf.newaxis]

# Build a simple CNN with dropout and batch normalization
model = models.Sequential([
    layers.Conv2D(32, (3,3), activation='relu', input_shape=(28,28,1)),
    layers.BatchNormalization(),
    layers.MaxPooling2D((2,2)),
    layers.Dropout(0.25),

    layers.Conv2D(64, (3,3), activation='relu'),
    layers.BatchNormalization(),
    layers.MaxPooling2D((2,2)),
    layers.Dropout(0.25),

    layers.Flatten(),
    layers.Dense(64, activation='relu'),
    layers.BatchNormalization(),
    layers.Dropout(0.5),
    layers.Dense(10, activation='softmax')
])

model.compile(optimizer=tf.keras.optimizers.Adam(learning_rate=0.001),
              loss='sparse_categorical_crossentropy',
              metrics=['accuracy'])

history = model.fit(train_images, train_labels, epochs=15, batch_size=64, validation_split=0.2)

# Evaluate on test set
test_loss, test_acc = model.evaluate(test_images, test_labels)

print(f'Test loss: {test_loss:.4f}, Test accuracy: {test_acc:.4f}')

Added dropout layers after convolution and dense layers to reduce overfitting.

Added batch normalization layers to stabilize and speed up training.

Reduced dense layer size to 64 neurons to simplify model.

Used Adam optimizer with learning rate 0.001 and batch size 64 for better convergence.

Results Interpretation

Before: Training accuracy 98%, Validation accuracy 75% (overfitting)

After: Training accuracy 90%, Validation accuracy 87% (better generalization)

Adding dropout and batch normalization helps reduce overfitting by preventing the model from memorizing training data and stabilizing learning, leading to improved validation accuracy.

Bonus Experiment

Try using a simple Generative Adversarial Network (GAN) to generate handwritten digit images instead of a classifier.

💡 Hint

Start with a small generator and discriminator network, train them alternately, and observe generated images improving over epochs.

Practice

1. What is the main role of a generator model in image generation using TensorFlow?

easy

A. To classify images into categories

B. To label images with tags

C. To reduce the size of images

D. To create new images from random noise inputs

Solution

1. Step 1: Understand the generator's purpose

   The generator model takes random noise as input and learns to produce new images that look like real data.

2. Step 2: Differentiate from other models

   Unlike classifiers or reducers, the generator's job is to create images, not to label or compress them.

3. Final Answer:

   To create new images from random noise inputs -> Option D

4. Quick Check:

   Generator creates images = B [OK]

Hint: Generator turns noise into images step-by-step [OK]

Common Mistakes:

• Confusing generator with classifier
• Thinking generator compresses images
• Assuming generator labels images

2. Which of the following TensorFlow code snippets correctly defines a simple generator model layer that upsamples noise to a 7x7x128 feature map?

easy

A. tf.keras.layers.MaxPooling2D((2,2))

B. tf.keras.layers.Dense(7*7*128, use_bias=False, input_shape=(100,))

C. tf.keras.layers.Conv2D(128, (3,3), activation='relu')

D. tf.keras.layers.Flatten()

Solution

1. Step 1: Identify the layer that creates a 7x7x128 feature map from noise

   The Dense layer with units 7*7*128 reshapes noise vector into a flat feature map for upsampling.

2. Step 2: Check other options

   Conv2D applies convolution but does not reshape noise directly; MaxPooling2D reduces size; Flatten converts to 1D.

3. Final Answer:

   tf.keras.layers.Dense(7*7*128, use_bias=False, input_shape=(100,)) -> Option B

4. Quick Check:

   Dense layer reshapes noise = C [OK]

Hint: Dense layer with units = 7*7*128 reshapes noise [OK]

Common Mistakes:

• Using Conv2D before reshaping noise
• Choosing pooling layers for upsampling
• Flattening noise vector instead of reshaping

3. Given the following TensorFlow code snippet for generating an image, what will be the shape of the output image tensor?

noise = tf.random.normal([1, 100])
generated_image = generator(noise, training=False)

Assume the generator outputs images of shape (28, 28, 1).

medium

A. (1, 28, 28, 1)

B. (28, 28, 1)

C. (100, 28, 28, 1)

D. (1, 100)

Solution

1. Step 1: Understand input noise shape

   The noise tensor has shape (1, 100), where 1 is batch size and 100 is noise dimension.

2. Step 2: Check generator output shape

   The generator outputs images shaped (28, 28, 1) per input sample, so output shape includes batch size: (1, 28, 28, 1).

3. Final Answer:

   (1, 28, 28, 1) -> Option A

4. Quick Check:

   Batch size + image shape = (1, 28, 28, 1) [OK]

Hint: Output shape includes batch size from input noise [OK]

Common Mistakes:

• Ignoring batch size dimension
• Confusing noise dimension with image size
• Assuming output shape matches noise shape

4. You wrote this TensorFlow code to generate images but get an error:

noise = tf.random.normal([100])
generated_image = generator(noise, training=False)

What is the likely cause of the error?

medium

A. Noise input is missing batch dimension

B. Generator model is not compiled

C. Noise tensor has wrong data type

D. Training flag must be True for generation

Solution

1. Step 1: Check noise input shape

   The noise tensor shape is (100,), missing batch dimension which should be (1, 100) or more.

2. Step 2: Understand generator input requirements

   Generator expects batch dimension to process inputs; missing it causes shape mismatch error.

3. Final Answer:

   Noise input is missing batch dimension -> Option A

4. Quick Check:

   Batch dimension required in noise input = A [OK]

Hint: Add batch size dimension to noise input shape [OK]

Common Mistakes:

• Passing 1D noise without batch size
• Assuming training flag affects input shape
• Ignoring model compilation errors

5. You want to generate 5 new images using a trained TensorFlow generator model. Which code snippet correctly generates and displays these images using matplotlib?

hard

A. noise = tf.random.normal([5, 100])
generated_images = generator(noise)
plt.imshow(generated_images, cmap='gray')
plt.show()

B. noise = tf.random.normal([1, 100])
generated_images = generator(noise, training=False)
plt.imshow(generated_images, cmap='gray')
plt.show()

C. noise = tf.random.normal([5, 100])
generated_images = generator(noise, training=False)
for i in range(5):
plt.subplot(1, 5, i+1)
plt.imshow(generated_images[i, :, :, 0], cmap='gray')
plt.axis('off')
plt.show()

D. noise = tf.random.normal([5])
generated_images = generator(noise, training=True)
plt.imshow(generated_images[0], cmap='gray')
plt.show()

Solution

1. Step 1: Generate noise for 5 images

   Noise shape [5, 100] creates batch of 5 inputs for generator.

2. Step 2: Generate images and plot each

   Loop over generated_images to plot each image separately with plt.subplot and plt.imshow.

3. Step 3: Check other options

   noise = tf.random.normal([1, 100]) generated_images = generator(noise, training=False) plt.imshow(generated_images, cmap='gray') plt.show() generates only 1 image; another misses training=False and plots batch incorrectly; another has wrong noise shape and training mode.

4. Final Answer:

   noise = tf.random.normal([5, 100]) generated_images = generator(noise, training=False) for i in range(5): plt.subplot(1, 5, i+1) plt.imshow(generated_images[i, :, :, 0], cmap='gray') plt.axis('off') plt.show() -> Option C

5. Quick Check:

   Batch noise + loop display = A [OK]

Hint: Use batch noise and loop to display images with matplotlib [OK]

Common Mistakes:

• Using wrong noise shape for batch
• Not looping to display each image
• Forgetting training=False during generation