forward method in PyTorch - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to define the forward method input parameter.

PyTorch

def forward(self, [1]):
    return x * 2

Drag options to blanks, or click blank then click option'

Ainput

Bself

Coutput

Dx

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'self' as the input parameter instead of 'x'.

Using 'output' or 'input' which are not standard names here.

The forward method takes the input tensor as a parameter, commonly named x.

2fill in blank

medium

Complete the code to apply a linear layer inside the forward method.

PyTorch

def forward(self, x):
    out = self.[1](x)
    return out

Drag options to blanks, or click blank then click option'

Alinear

Brelu

Cconv

Ddropout

Attempts:

3 left

💡 Hint

Common Mistakes

Using activation functions like 'relu' instead of the layer.

Using 'conv' or 'dropout' which are different layer types.

The linear layer is applied by calling self.linear(x) inside the forward method.

3fill in blank

hard

Fix the error in the forward method to correctly apply ReLU activation.

PyTorch

def forward(self, x):
    out = self.linear(x)
    out = [1](out)
    return out

Drag options to blanks, or click blank then click option'

Ann.ReLU

Brelu

Cself.relu

DReLU

Attempts:

3 left

💡 Hint

Common Mistakes

Using 'relu(out)' without 'self.' causes a NameError.

Using the class name 'nn.ReLU' without instantiation.

The ReLU activation is applied as self.relu(out) if self.relu is defined in __init__.

4fill in blank

hard

Fill both blanks to complete the forward method with two layers and activation.

PyTorch

def forward(self, x):
    out = self.[1](x)
    out = self.[2](out)
    return out

Drag options to blanks, or click blank then click option'

Alinear1

Blinear2

Crelu

Ddropout

Attempts:

3 left

💡 Hint

Common Mistakes

Using linear2 first instead of linear1.

Using dropout instead of activation.

The input is passed through linear1 then activated by relu.

5fill in blank

hard

Fill all three blanks to complete the forward method with two linear layers and activation.

PyTorch

def forward(self, x):
    out = self.[1](x)
    out = self.[2](out)
    out = self.[3](out)
    return out

Drag options to blanks, or click blank then click option'

Alinear1

Brelu

Clinear2

Ddropout

Attempts:

3 left

💡 Hint

Common Mistakes

Mixing the order of layers and activation.

Using dropout instead of linear2.

The input goes through linear1, then relu activation, then linear2 layer.

Practice

1. What is the main purpose of the forward method in a PyTorch model?

easy

A. To define how input data passes through the model layers

B. To initialize model weights

C. To save the model to disk

D. To load data from a dataset

Solution

1. Step 1: Understand the role of forward in PyTorch

   The forward method specifies the computation performed on input data as it passes through the model.

2. Step 2: Differentiate from other methods

   Initialization and saving/loading are handled by other methods, not forward.

3. Final Answer:

   To define how input data passes through the model layers -> Option A

4. Quick Check:

   forward defines data flow [OK]

Hint: Remember: forward = data flow through model [OK]

Common Mistakes:

• Confusing forward with initialization
• Thinking forward saves or loads data
• Assuming forward is called manually

2. Which of the following is the correct way to define the forward method inside a PyTorch nn.Module subclass?

easy

A. def Forward(self, x): return x * 2

B. def forward(self, x): return x * 2

C. def forward(x): return x * 2

D. def forward(self): return x * 2

Solution

1. Step 1: Check method signature requirements

   The forward method must have self as the first argument and input data as the second.

2. Step 2: Validate method name and parameters

   def forward(self, x): return x * 2 correctly uses lowercase forward and includes self and x. Others have wrong case, missing self, or missing input.

3. Final Answer:

   def forward(self, x): return x * 2 -> Option B

4. Quick Check:

   Correct method name and parameters = def forward(self, x): return x * 2 [OK]

Hint: Always use lowercase 'forward' with self and input args [OK]

Common Mistakes:

• Capitalizing 'Forward' instead of 'forward'
• Omitting 'self' parameter
• Missing input argument in method

3. Given the following PyTorch model code, what will be the output when calling model(torch.tensor([2.0]))?

import torch
import torch.nn as nn

class SimpleModel(nn.Module):
    def __init__(self):
        super().__init__()
        self.linear = nn.Linear(1, 1)
        self.linear.weight.data.fill_(2.0)
        self.linear.bias.data.fill_(1.0)
    def forward(self, x):
        return self.linear(x)

model = SimpleModel()

medium

A. tensor([5.0])

B. tensor([4.0])

C. tensor([2.0])

D. tensor([1.0])

Solution

1. Step 1: Calculate linear layer output

   The linear layer output is weight * input + bias = 2.0 * 2.0 + 1.0 = 5.0.

2. Step 2: Confirm output tensor

   The model returns tensor([5.0]) as output.

3. Final Answer:

   tensor([5.0]) -> Option A

4. Quick Check:

   Output = 2*2 + 1 = 5 [OK]

Hint: Output = weight * input + bias in linear layer [OK]

Common Mistakes:

• Ignoring bias term
• Using wrong weight value
• Confusing input tensor shape

4. Identify the error in this PyTorch model's forward method:

class MyModel(nn.Module):
    def __init__(self):
        super().__init__()
        self.fc = nn.Linear(3, 1)
    def forward(self, x):
        x = self.fc
        return x

medium

A. Input tensor shape is incorrect

B. Missing call to super().__init__() in __init__

C. The forward method should not have a return statement

D. The forward method returns the layer object, not the output

Solution

1. Step 1: Analyze the forward method code

   The line x = self.fc assigns the layer object to x instead of calling it.

2. Step 2: Identify correct usage

   To get output, the layer must be called with input: x = self.fc(x).

3. Final Answer:

   The forward method returns the layer object, not the output -> Option D

4. Quick Check:

   Layer must be called with input, not assigned [OK]

Hint: Call layers with input inside forward, don't assign layer itself [OK]

Common Mistakes:

• Assigning layer instead of calling it
• Forgetting to call super().__init__()
• Ignoring input tensor shape

5. You want to create a PyTorch model that applies two linear layers sequentially in the forward method, with a ReLU activation in between. Which forward method implementation is correct?

class TwoLayerModel(nn.Module):
    def __init__(self):
        super().__init__()
        self.fc1 = nn.Linear(4, 3)
        self.fc2 = nn.Linear(3, 2)
        self.relu = nn.ReLU()

    def forward(self, x):
        ?

hard

A. x = self.fc1(x)
x = self.fc2(x)
x = self.relu(x)
return x

B. x = self.relu(self.fc1(x))
return self.fc2(x)

C. x = self.fc1(x)
x = self.relu(x)
x = self.fc2(x)
return x

D. x = self.fc1(x)
return self.fc2(self.relu(x))

Solution

1. Step 1: Understand the desired layer order

   The model should apply fc1, then ReLU, then fc2 in sequence.

2. Step 2: Check each option's order

   x = self.fc1(x) x = self.relu(x) x = self.fc2(x) return x correctly applies fc1, then ReLU, then fc2. Others change the order or skip activation between layers.

3. Final Answer:

   x = self.fc1(x) x = self.relu(x) x = self.fc2(x) return x -> Option C

4. Quick Check:

   Layer1 -> ReLU -> Layer2 sequence = x = self.fc1(x) x = self.relu(x) x = self.fc2(x) return x [OK]

Hint: Apply activation between layers, not after last layer [OK]

Common Mistakes:

• Applying activation after last layer
• Skipping activation between layers
• Incorrect order of operations