Feature extraction strategy in PyTorch - Model Pipeline Trace

Model Pipeline - Feature extraction strategy

This pipeline shows how a model uses feature extraction to learn from images. It takes raw images, extracts important features using a pre-trained network, then trains a simple classifier on these features to recognize new images.

Data Flow - 5 Stages

1Raw Image Input

1000 images x 3 channels x 64 height x 64 width→Collect raw color images→1000 images x 3 channels x 64 height x 64 width

An image of a cat represented as 3 color channels with 64x64 pixels

↓

2Preprocessing

1000 images x 3 channels x 64 height x 64 width→Normalize pixel values to range 0-1→1000 images x 3 channels x 64 height x 64 width

Pixel values scaled from 0-255 to 0.0-1.0

↓

3Feature Extraction

1000 images x 3 channels x 64 height x 64 width→Pass images through pre-trained CNN (e.g., ResNet18) without final layer→1000 images x 512 features

Each image converted to a 512-length feature vector summarizing important patterns

↓

4Classifier Training

800 images x 512 features→Train a simple linear layer on extracted features→800 images x 10 classes

Model learns to map features to one of 10 categories

↓

5Validation

200 images x 512 features→Evaluate classifier on unseen features→200 images x 10 classes

Model predicts class probabilities for new images

Training Trace - Epoch by Epoch

Loss
2.0 |****
1.5 |*** 
1.0 |**  
0.5 |*   
0.0 +----
      1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.8	0.40	Model starts learning, accuracy is low
2	1.2	0.60	Loss decreases, accuracy improves
3	0.9	0.72	Model learns better features for classification
4	0.7	0.80	Training converges, accuracy stabilizes
5	0.6	0.83	Final epoch with good accuracy

Prediction Trace - 4 Layers

Layer 1: Input Image

Layer 2: Feature Extractor (Pre-trained CNN)

Layer 3: Classifier Linear Layer

Layer 4: Softmax Activation

Model Quiz - 3 Questions

What is the main purpose of the feature extraction step?

A To randomly shuffle image pixels

B To increase the image size for better training

C To convert images into a smaller set of meaningful features

D To directly predict the class labels

Key Insight

Feature extraction uses a pre-trained network to turn complex images into simpler feature vectors. Training a small classifier on these features is faster and effective, showing how reusing learned knowledge helps new tasks.