Why pre-trained models save time in Computer Vision - Challenge Your Understanding

Challenge - 5 Problems

🧠 Conceptual

intermediate

Why do pre-trained models reduce training time?

Imagine you want to teach a robot to recognize objects. You can start from scratch or use a robot that already knows some objects. Why does using a pre-trained model save time?

A Because pre-trained models use less memory, making training quicker.

B Because pre-trained models use simpler algorithms that run faster.

C Because pre-trained models skip the training process entirely and only do testing.

D Because the model already learned useful features, so it needs less data and time to adapt to the new task.

💡 Hint

Think about how learning basics first helps you learn new things faster.

Pre-trained models have already learned general features from large datasets. This means they start with useful knowledge, so they need less time and data to learn a new but related task.

❓ Predict Output

intermediate

Output of fine-tuning a pre-trained model

Consider this Python code that loads a pre-trained model and fine-tunes it on a small dataset. What will be the printed output?

Computer Vision

from tensorflow.keras.applications import MobileNetV2
from tensorflow.keras.layers import Dense, GlobalAveragePooling2D
from tensorflow.keras.models import Model
import numpy as np

base_model = MobileNetV2(weights='imagenet', include_top=False, input_shape=(96,96,3))

x = base_model.output
x = GlobalAveragePooling2D()(x)
predictions = Dense(10, activation='softmax')(x)
model = Model(inputs=base_model.input, outputs=predictions)

for layer in base_model.layers:
    layer.trainable = False

model.compile(optimizer='adam', loss='categorical_crossentropy', metrics=['accuracy'])

# Dummy data
X_train = np.random.random((5,96,96,3))
y_train = np.eye(10)[np.random.choice(10,5)]

history = model.fit(X_train, y_train, epochs=1, verbose=0)

print(f"Training accuracy: {history.history['accuracy'][0]:.2f}")

A Training accuracy: 0.20

B Training accuracy: 0.00

C Training accuracy: 1.00

D Training accuracy: 0.50

💡 Hint

Think about training on random data with frozen base layers.

The base model layers are frozen, so only the new dense layer learns. With random data and one epoch, accuracy will be low, close to random guessing (around 0.2 for 10 classes).

❓ Model Choice

advanced

Choosing a pre-trained model for fast training

You want to train a model quickly on a small image dataset. Which pre-trained model choice will save the most training time?

A A large model like ResNet152 with many layers and parameters.

B A small model like MobileNetV2 designed for efficiency.

C A model trained from scratch with random weights.

D A model with no pre-trained weights but fewer layers.

💡 Hint

Think about model size and pre-training impact on training speed.

MobileNetV2 is a smaller, efficient model with pre-trained weights, so it requires less time and resources to fine-tune compared to large models or training from scratch.

❓ Hyperparameter

advanced

Effect of freezing layers on training time

When using a pre-trained model, how does freezing more layers affect training time?

A Freezing layers has no effect on training time.

B Freezing more layers increases training time because the model becomes unstable.

C Freezing more layers reduces training time because fewer parameters are updated.

D Freezing layers causes the model to train slower due to extra computations.

💡 Hint

Think about how many parts of the model need to learn during training.

Freezing layers means those layers do not update their weights, so the training process updates fewer parameters, making training faster.

❓ Metrics

expert

Interpreting training speed and accuracy with pre-trained models

You fine-tune two pre-trained models on the same small dataset. Model A trains faster but has lower accuracy. Model B trains slower but achieves higher accuracy. What is the best explanation?

A Model A is smaller and less complex, so it trains faster but may not capture all features, leading to lower accuracy.

B Model B uses random weights, so it trains slower but learns better.

C Model B has fewer layers, so it trains slower but is more accurate.

D Model A uses a worse optimizer causing faster training but lower accuracy.

💡 Hint

Consider model size, complexity, and training speed trade-offs.

Smaller models train faster but may lack capacity to learn complex features, resulting in lower accuracy. Larger models take longer but can achieve better accuracy.