Conv2D layers in TensorFlow - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

Output shape of Conv2D layer

Given the following Conv2D layer in TensorFlow, what is the output shape when the input shape is (32, 32, 3)?

TensorFlow

import tensorflow as tf
layer = tf.keras.layers.Conv2D(filters=16, kernel_size=3, strides=1, padding='valid')
input_shape = (1, 32, 32, 3)
output = layer(tf.random.uniform(input_shape))
print(output.shape)

A (1, 30, 30, 16)

B (1, 32, 32, 16)

C (1, 31, 31, 16)

D (1, 29, 29, 16)

💡 Hint

Remember that 'valid' padding means no padding is added, so output size shrinks by kernel_size - 1.

With 'valid' padding and kernel size 3, the output height and width are input_size - kernel_size + 1 = 32 - 3 + 1 = 30. The number of filters is 16, so output shape is (1, 30, 30, 16).

❓ Model Choice

intermediate

Choosing padding for same output size

You want a Conv2D layer that keeps the input height and width unchanged after convolution. Which padding option should you use?

A 'same'

B 'valid'

C 'causal'

D 'full'

💡 Hint

Padding adds pixels around the input to keep output size same as input.

'same' padding adds zeros around the input so the output height and width remain the same as input when stride is 1.

❓ Hyperparameter

advanced

Effect of stride on output size

If you apply a Conv2D layer with kernel_size=5, padding='valid', and stride=2 on an input of shape (64, 64, 3), what will be the output height and width?

A 31 x 31

B 30 x 30

C 32 x 32

D 29 x 29

💡 Hint

Output size formula: floor((input_size - kernel_size)/stride) + 1

Output size = floor((64 - 5)/2) + 1 = floor(59/2) + 1 = 29 + 1 = 30. The output height and width are 30 x 30.

❓ Metrics

advanced

Calculating number of parameters in Conv2D

How many trainable parameters does a Conv2D layer have with 10 filters, kernel size 3x3, input channels 3, and use_bias=True?

A 300

B 290

C 270

D 280

💡 Hint

Parameters = (kernel_height * kernel_width * input_channels * filters) + filters (if bias used).

Parameters = (3*3*3*10) + 10 = 270 + 10 = 280.

🔧 Debug

expert

Identifying error in Conv2D input shape

What error will this code raise? import tensorflow as tf layer = tf.keras.layers.Conv2D(8, 3) input_data = tf.random.uniform((32, 3, 32, 3)) output = layer(input_data)

A No error, runs successfully

B ValueError: Input rank must be 4, got 4 with wrong dimension order

C TypeError: Conv2D expects input shape (batch, height, width, channels)

D ValueError: Input tensor has wrong shape, expected channels last

💡 Hint

TensorFlow Conv2D expects input shape with channels last by default.

The input shape (32, 3, 32, 3) is invalid for the default 'channels_last' data format because the height and width dimensions are swapped. TensorFlow expects input shape (batch, height, width, channels). This will raise a TypeError indicating the expected input shape.

Practice

1. What does a Conv2D layer primarily do in a neural network?

easy

A. It scans images with small windows to find features.

B. It reduces the size of the input image by half.

C. It converts images into text descriptions.

D. It sorts images based on color.

Solution

1. Step 1: Understand the role of Conv2D

   A Conv2D layer uses small filters to scan over images and detect patterns like edges or textures.

2. Step 2: Compare options with Conv2D function

   Only It scans images with small windows to find features. correctly describes this scanning and feature detection process.

3. Final Answer:

   It scans images with small windows to find features. -> Option A

4. Quick Check:

   Conv2D = feature scanning [OK]

Hint: Conv2D finds image features using small filters [OK]

Common Mistakes:

• Thinking Conv2D reduces image size directly
• Confusing Conv2D with image captioning
• Assuming Conv2D sorts images

2. Which of the following is the correct way to create a Conv2D layer with 32 filters and a 3x3 kernel in TensorFlow?

easy

A. tf.keras.layers.Conv2D(32, kernel=3)

B. tf.keras.layers.Conv2D(filters=32, kernel_size=(3,3))

C. tf.keras.layers.Conv2D(filters=3, kernel_size=32)

D. tf.keras.layers.Conv2D(32, size=(3,3))

Solution

1. Step 1: Recall Conv2D syntax

   The correct syntax uses filters for number of filters and kernel_size as a tuple for filter size.

2. Step 2: Check each option

   tf.keras.layers.Conv2D(filters=32, kernel_size=(3,3)) matches the correct syntax. Options B, C, and D use wrong parameter names or values.

3. Final Answer:

   tf.keras.layers.Conv2D(filters=32, kernel_size=(3,3)) -> Option B

4. Quick Check:

   Correct parameters = tf.keras.layers.Conv2D(filters=32, kernel_size=(3,3)) [OK]

Hint: Use filters= and kernel_size=(h,w) in Conv2D [OK]

Common Mistakes:

• Using wrong parameter names like kernel or size
• Swapping filters and kernel_size values
• Passing kernel_size as a single integer without tuple

3. What will be the output shape of this Conv2D layer in TensorFlow?

layer = tf.keras.layers.Conv2D(filters=16, kernel_size=(3,3), padding='valid')
input_shape = (None, 28, 28, 1)
output_shape = layer.compute_output_shape(input_shape)

medium

A. (None, 30, 30, 16)

B. (None, 28, 28, 16)

C. (None, 26, 26, 16)

D. (None, 25, 25, 16)

Solution

1. Step 1: Understand padding='valid'

   Valid padding means no padding, so output size shrinks by kernel_size - 1 in height and width.

2. Step 2: Calculate output dimensions

   Input is 28x28, kernel is 3x3, so output height and width = 28 - 3 + 1 = 26. Filters = 16.

3. Final Answer:

   (None, 26, 26, 16) -> Option C

4. Quick Check:

   Output size = input - kernel + 1 [OK]

Hint: Valid padding shrinks output by kernel_size - 1 [OK]

Common Mistakes:

• Assuming output size stays same with valid padding
• Confusing padding='same' with 'valid'
• Forgetting to apply kernel size reduction

4. Identify the error in this Conv2D layer code:

model = tf.keras.Sequential([
  tf.keras.layers.Conv2D(64, kernel_size=3, input_shape=(28,28)),
  tf.keras.layers.Flatten(),
  tf.keras.layers.Dense(10, activation='softmax')
])

medium

A. Missing channel dimension in input_shape

B. kernel_size should be a tuple, not an integer

C. Dense layer should come before Flatten

D. Activation function 'softmax' is invalid here

Solution

1. Step 1: Check input_shape format

   Conv2D expects input_shape with 3 dimensions: height, width, and channels. Here channels are missing.

2. Step 2: Validate other parts

   kernel_size=3 is valid (interpreted as (3,3)), Dense after Flatten is correct, softmax is valid for classification.

3. Final Answer:

   Missing channel dimension in input_shape -> Option A

4. Quick Check:

   Input shape must include channels [OK]

Hint: Input shape for Conv2D needs channels (e.g., (28,28,1)) [OK]

Common Mistakes:

• Ignoring channel dimension in input_shape
• Thinking kernel_size must be tuple always
• Misordering Flatten and Dense layers

5. You want to build a Conv2D model that keeps the input image size unchanged after convolution. Which setting should you use for the padding parameter?

hard

A. 'valid' to avoid padding

B. 'none' to disable convolution

C. 'full' to increase output size

D. 'same' to keep output size equal to input size

Solution

1. Step 1: Understand padding options

   'valid' means no padding, output shrinks; 'same' adds padding to keep output size same as input.

2. Step 2: Choose padding to keep size

   To keep input and output size equal, use padding='same'. Options 'full' and 'none' are invalid in TensorFlow Conv2D.

3. Final Answer:

   'same' to keep output size equal to input size -> Option D

4. Quick Check:

   Padding='same' keeps size [OK]

Hint: Use padding='same' to keep image size after Conv2D [OK]

Common Mistakes:

• Choosing 'valid' and expecting same size
• Using unsupported padding values like 'full' or 'none'
• Confusing padding effect on output size