torchvision pre-trained models in PyTorch - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a pre-trained model in torchvision?

A pre-trained model in torchvision is a neural network model that has already been trained on a large dataset like ImageNet. It can be used directly or fine-tuned for new tasks, saving time and resources.

beginner

Name two popular pre-trained models available in torchvision.

Two popular pre-trained models in torchvision are ResNet (e.g., ResNet-50) and VGG (e.g., VGG-16). Both are widely used for image classification tasks.

beginner

How do you load a pre-trained ResNet-18 model in PyTorch using torchvision?

You can load it with: <pre>import torchvision.models as models
model = models.resnet18(weights=models.ResNet18_Weights.DEFAULT)</pre> This downloads the weights trained on ImageNet.

intermediate

Why might you want to fine-tune a pre-trained model instead of training from scratch?

Fine-tuning uses the learned features from a large dataset and adapts them to your specific task. It requires less data and training time, and often improves performance on small datasets.

beginner

What is the role of the pretrained=True argument when loading models in torchvision?

The pretrained=True argument tells torchvision to load the model with weights trained on a large dataset (usually ImageNet). Without it, the model has random weights.

What dataset are torchvision pre-trained models commonly trained on?

A CIFAR-10

B ImageNet

C MNIST

D COCO

Most torchvision pre-trained models are trained on ImageNet, a large dataset with millions of labeled images.

Which of the following is NOT a torchvision pre-trained model?

A BERT

B VGG

C ResNet

D AlexNet

BERT is a language model, not an image model, so it is not part of torchvision pre-trained models.

What does setting pretrained=True do when loading a model?

A Loads random weights

B Changes model architecture

C Loads weights trained on a large dataset

D Disables training

It loads the model with weights trained on a large dataset like ImageNet.

Why is fine-tuning useful?

A It increases model size

B It trains a model from scratch

C It removes all pre-trained weights

D It uses learned features to adapt to new tasks quickly

Fine-tuning adapts pre-trained features to new tasks, saving time and improving performance.

Which PyTorch module provides access to pre-trained models?

A torchvision.models

B torch.nn

C torch.optim

D torch.utils.data

The torchvision.models module contains pre-trained models for computer vision.

Explain what a torchvision pre-trained model is and why it is useful.

Think about how using a model trained on many images helps with new tasks.

Describe the steps to load and use a pre-trained ResNet model in PyTorch.

Focus on the code and what pretrained=True means.