Feature map visualization in PyTorch - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a feature map in a convolutional neural network?

A feature map is the output of a convolutional layer that shows how the network detects specific features like edges or textures in the input image.

beginner

Why do we visualize feature maps?

Visualizing feature maps helps us understand what the neural network is learning and which parts of the input image activate certain filters.

intermediate

How can you extract feature maps from a PyTorch model during a forward pass?

You can register a forward hook on a layer to capture its output (feature map) during the forward pass without changing the model's structure.

beginner

What does a high activation in a feature map indicate?

A high activation means the filter strongly detected a specific pattern or feature in that region of the input image.

beginner

Name a simple way to visualize feature maps in PyTorch.

Convert the feature map tensor to a NumPy array, normalize it, and use matplotlib's imshow to display the activations as images.

What does a feature map represent in a CNN?

A The input image after resizing

B The weights of the neural network

C The loss value during training

D The output of a convolutional layer showing detected features

Feature maps are the outputs of convolutional layers that highlight detected features.

Which PyTorch tool helps capture intermediate outputs like feature maps?

A optimizers

B backward hooks

C forward hooks

D loss functions

Forward hooks allow capturing outputs during the forward pass.

Why normalize feature maps before visualization?

A To scale activations between 0 and 1 for better image display

B To increase the size of the feature map

C To change the model weights

D To reduce the number of channels

Normalization scales values so they can be shown clearly as images.

What does a bright spot in a feature map image usually mean?

A Low activation

B Strong activation indicating detected feature

C Input noise

D Model error

Bright spots show where the filter strongly detected a feature.

Which library is commonly used to display feature maps in Python?

A matplotlib

B pandas

C scikit-learn

D numpy

Matplotlib's imshow function is used to visualize images and feature maps.

Explain how to extract and visualize feature maps from a convolutional layer in PyTorch.

Think about how to get intermediate outputs without changing the model.

Why is feature map visualization useful when training convolutional neural networks?

Consider how visualization helps you 'see' what the model focuses on.