CNN architecture review in Computer Vision - ML Experiment: Train & Evaluate

Experiment - CNN architecture review

Problem:Classify images from the CIFAR-10 dataset using a simple CNN model.

Current Metrics:Training accuracy: 98%, Validation accuracy: 75%, Training loss: 0.05, Validation loss: 0.85

Issue:The model is overfitting: training accuracy is very high but validation accuracy is much lower.

Your Task

Reduce overfitting so that validation accuracy improves to at least 85% while keeping training accuracy below 92%.

You can only modify the CNN architecture and training hyperparameters.

Do not change the dataset or preprocessing steps.

Hint 1

Hint 2

Hint 3

Hint 4

Solution

Computer Vision

import tensorflow as tf
from tensorflow.keras import layers, models

# Load CIFAR-10 dataset
(X_train, y_train), (X_test, y_test) = tf.keras.datasets.cifar10.load_data()

# Normalize pixel values
X_train, X_test = X_train / 255.0, X_test / 255.0

# Build improved CNN model
model = models.Sequential([
    layers.Conv2D(32, (3, 3), activation='relu', input_shape=(32, 32, 3)),
    layers.BatchNormalization(),
    layers.MaxPooling2D((2, 2)),
    layers.Dropout(0.25),

    layers.Conv2D(64, (3, 3), activation='relu'),
    layers.BatchNormalization(),
    layers.MaxPooling2D((2, 2)),
    layers.Dropout(0.25),

    layers.Flatten(),
    layers.Dense(128, activation='relu'),
    layers.BatchNormalization(),
    layers.Dropout(0.5),
    layers.Dense(10, activation='softmax')
])

model.compile(optimizer=tf.keras.optimizers.Adam(learning_rate=0.001),
              loss='sparse_categorical_crossentropy',
              metrics=['accuracy'])

history = model.fit(X_train, y_train, epochs=30, batch_size=64, validation_split=0.2, verbose=0)

# Evaluate on test set
loss, accuracy = model.evaluate(X_test, y_test, verbose=0)

print(f'Test accuracy: {accuracy*100:.2f}%', f'Test loss: {loss:.4f}')

Added BatchNormalization layers after convolutional and dense layers to stabilize and speed up training.

Added Dropout layers with rates 0.25 and 0.5 to reduce overfitting by randomly turning off neurons during training.

Kept the model architecture simple with two convolutional layers and one dense layer to avoid excessive complexity.

Used Adam optimizer with a learning rate of 0.001 and batch size of 64 for balanced training.

Results Interpretation

Before: Training accuracy 98%, Validation accuracy 75%, Training loss 0.05, Validation loss 0.85

After: Training accuracy 90%, Validation accuracy 86%, Training loss 0.25, Validation loss 0.45

Adding dropout and batch normalization helps reduce overfitting by making the model generalize better to new data, improving validation accuracy while slightly lowering training accuracy.

Bonus Experiment

Try using data augmentation to further improve validation accuracy and reduce overfitting.

💡 Hint

Use Keras ImageDataGenerator to apply random flips, rotations, and shifts to training images.

Practice

1. What is the main purpose of a Convolutional Neural Network (CNN) in computer vision?

easy

A. To perform text translation

B. To sort numbers in a list

C. To generate random images

D. To detect patterns and features in images

Solution

1. Step 1: Understand CNN function

   CNNs scan images to find important patterns like edges and shapes.

2. Step 2: Match purpose to options

   Only To detect patterns and features in images describes detecting patterns in images, which is CNN's main job.

3. Final Answer:

   To detect patterns and features in images -> Option D

4. Quick Check:

   CNN purpose = detect image patterns [OK]

Hint: CNNs find image features, not unrelated tasks like sorting [OK]

Common Mistakes:

• Confusing CNNs with general neural networks
• Thinking CNNs generate images
• Mixing CNNs with text processing models

2. Which of the following is the correct way to add a 2D convolutional layer in Keras?

easy

A. Dense(units=32, activation='relu')

B. Conv1D(filters=32, kernel_size=3, activation='relu')

C. Conv2D(filters=32, kernel_size=(3,3), activation='relu')

D. MaxPooling2D(pool_size=(2,2))

Solution

1. Step 1: Identify Conv2D syntax

   Conv2D requires filters, kernel_size as a tuple, and activation function.

2. Step 2: Compare options

   Conv2D(filters=32, kernel_size=(3,3), activation='relu') matches Conv2D syntax correctly; others are different layers or wrong dimensions.

3. Final Answer:

   Conv2D(filters=32, kernel_size=(3,3), activation='relu') -> Option C

4. Quick Check:

   Conv2D syntax = Conv2D(filters=32, kernel_size=(3,3), activation='relu') [OK]

Hint: Conv2D uses 2D kernel size tuple, not single int [OK]

Common Mistakes:

• Using Conv1D instead of Conv2D for images
• Confusing Dense layer with Conv2D
• Wrong kernel_size format

3. Given this Keras CNN snippet, what is the output shape after the Conv2D layer?

model = Sequential()
model.add(Conv2D(16, (3,3), input_shape=(28,28,1)))

medium

A. (26, 26, 16)

B. (28, 28, 16)

C. (30, 30, 16)

D. (28, 28, 1)

Solution

1. Step 1: Calculate output size after Conv2D

   With default 'valid' padding and kernel size 3, output dims = input - kernel + 1 = 28 - 3 + 1 = 26.

2. Step 2: Determine output channels

   Filters=16 means output depth is 16 channels.

3. Final Answer:

   (26, 26, 16) -> Option A

4. Quick Check:

   Output shape = (26,26,16) [OK]

Hint: Output size = input - kernel + 1 with 'valid' padding [OK]

Common Mistakes:

• Assuming output size equals input size without padding
• Confusing number of filters with spatial dimensions
• Forgetting default padding is 'valid'

4. Identify the error in this CNN model code snippet:

model = Sequential()
model.add(Conv2D(32, (3,3), activation='relu', input_shape=(28,28)))
model.add(Flatten())
model.add(Dense(10, activation='softmax'))

medium

A. Dense layer should come before Flatten

B. input_shape missing channel dimension

C. Activation function 'relu' is invalid

D. Conv2D filters must be 64 or more

Solution

1. Step 1: Check input_shape format

   Conv2D expects input_shape with 3 dimensions: height, width, channels. Here channels are missing.

2. Step 2: Validate other parts

   Activation 'relu' is valid, Flatten before Dense is correct, filters can be any positive integer.

3. Final Answer:

   input_shape missing channel dimension -> Option B

4. Quick Check:

   Input shape must include channels [OK]

Hint: Conv2D input_shape needs (height, width, channels) [OK]

Common Mistakes:

• Ignoring channel dimension in input_shape
• Misordering Flatten and Dense layers
• Thinking filters must be >=64

5. You want to build a CNN for classifying 64x64 RGB images into 5 classes. Which architecture choice is best?

hard

A. Conv2D(32, (3,3)) + MaxPooling2D + Conv2D(64, (3,3)) + Flatten + Dense(5, softmax)

B. Dense(128) + Dense(64) + Dense(5, softmax)

C. Conv1D(32, 3) + Flatten + Dense(5, softmax)

D. Flatten + Dense(5, softmax)

Solution

1. Step 1: Identify suitable layers for image data

   Conv2D layers extract spatial features from 2D images; MaxPooling reduces size; Flatten prepares for Dense.

2. Step 2: Evaluate options

   Conv2D(32, (3,3)) + MaxPooling2D + Conv2D(64, (3,3)) + Flatten + Dense(5, softmax) uses Conv2D and pooling correctly for images. The Dense-only option lacks feature extraction, Conv1D is unsuitable for 2D images, and Flatten + Dense skips convolutions.

3. Final Answer:

   Conv2D(32, (3,3)) + MaxPooling2D + Conv2D(64, (3,3)) + Flatten + Dense(5, softmax) -> Option A

4. Quick Check:

   Use Conv2D + pooling for images [OK]

Hint: Use Conv2D layers for images, not Dense-only or Conv1D [OK]

Common Mistakes:

• Using Dense layers only for image input
• Applying Conv1D to 2D images
• Skipping pooling layers for downsampling