Why detection localizes objects in PyTorch - Test Your Understanding

Practice - 5 Tasks

1fill in blank

easy

Complete the code to create a bounding box tensor for an object detection model.

PyTorch

bbox = torch.tensor([[1], 50, 150, 200])

Drag options to blanks, or click blank then click option'

A30

B'30'

C(30)

D[30]

Attempts:

3 left

💡 Hint

Common Mistakes

Using quotes around numbers, which makes them strings.

Using list or tuple instead of a number.

The bounding box coordinates must be numeric values, so 30 without quotes is correct.

2fill in blank

medium

Complete the code to calculate the Intersection over Union (IoU) between two boxes.

PyTorch

iou = intersection_area / [1]

Drag options to blanks, or click blank then click option'

Abox1_area

Bintersection_area

Cunion_area

Dbox2_area

Attempts:

3 left

💡 Hint

Common Mistakes

Dividing by intersection area instead of union area.

Using only one box's area.

IoU is the ratio of intersection area over union area of two boxes.

3fill in blank

hard

Fix the error in the code that extracts predicted bounding boxes from model output.

PyTorch

pred_boxes = outputs['boxes'][1]

Drag options to blanks, or click blank then click option'

A(0)

B[0]

C{0}

D<0>

Attempts:

3 left

💡 Hint

Common Mistakes

Using parentheses instead of brackets for indexing.

Using curly braces or angle brackets.

To index a tensor in PyTorch, square brackets [] are used, so [0] is correct.

4fill in blank

hard

Fill both blanks to complete the code that filters detections by confidence score.

PyTorch

filtered = [box for box in detections if box['score'] [1] [2]]

Drag options to blanks, or click blank then click option'

A>

B0.5

C<

D1.0

Attempts:

3 left

💡 Hint

Common Mistakes

Using less than instead of greater than.

Using threshold 1.0 which is too strict.

We keep boxes with score greater than 0.5 to filter confident detections.

5fill in blank

hard

Fill all three blanks to complete the code that creates a dictionary of detected object labels and their bounding boxes.

PyTorch

results = [1]((label, [2]) for label, box in zip(labels, [3]))

Drag options to blanks, or click blank then click option'

Adict

Bbox

Cboxes

Dlist

Attempts:

3 left

💡 Hint

Common Mistakes

Using list instead of dict.

Using wrong variable names for boxes.

We use dict() to create a dictionary mapping each label to its bounding box from the boxes list.

Practice

1. Why do object detection models predict bounding boxes along with class labels?

easy

A. To find the exact location of objects in the image

B. To increase the number of classes detected

C. To reduce the image size

D. To improve color accuracy

Solution

1. Step 1: Understand the role of bounding boxes

   Bounding boxes are used to mark the position and size of objects in an image.

2. Step 2: Connect bounding boxes to localization

   Predicting bounding boxes helps the model know where each object is located, not just what it is.

3. Final Answer:

   To find the exact location of objects in the image -> Option A

4. Quick Check:

   Bounding boxes = object location [OK]

Hint: Bounding boxes = object location in image [OK]

Common Mistakes:

• Thinking bounding boxes change image size
• Confusing bounding boxes with class labels
• Believing bounding boxes improve color

2. Which PyTorch output format correctly represents detection results with localization?

easy

A. (class_scores, bounding_boxes)

B. (image_tensor, class_labels)

C. (loss_value, optimizer_state)

D. (feature_maps, activation_maps)

Solution

1. Step 1: Identify detection output components

   Detection models output class scores and bounding boxes to classify and locate objects.

2. Step 2: Match output format to detection results

   The tuple (class_scores, bounding_boxes) correctly represents both classification and localization.

3. Final Answer:

   (class_scores, bounding_boxes) -> Option A

4. Quick Check:

   Detection output = (scores, boxes) [OK]

Hint: Detection outputs = class scores + bounding boxes [OK]

Common Mistakes:

• Confusing detection output with training loss
• Mixing input tensors with output results
• Using feature maps as final detection output

3. Given this PyTorch detection output code, what is the shape of boxes if batch size is 2 and max 3 detections per image?

class_scores, boxes = model(images)
print(boxes.shape)

medium

A. torch.Size([2, 4, 3])

B. torch.Size([3, 2, 4])

C. torch.Size([2, 3, 4])

D. torch.Size([4, 2, 3])

Solution

1. Step 1: Understand bounding box tensor shape

   Boxes are usually stored as (batch_size, max_detections, 4) where 4 = (x_min, y_min, x_max, y_max).

2. Step 2: Apply given values

   Batch size is 2, max detections 3, so shape is (2, 3, 4).

3. Final Answer:

   torch.Size([2, 3, 4]) -> Option C

4. Quick Check:

   Boxes shape = (batch, detections, 4) [OK]

Hint: Boxes shape = batch x detections x 4 coords [OK]

Common Mistakes:

• Swapping batch and detection dimensions
• Confusing coordinate count with detection count
• Assuming boxes shape matches class scores shape

4. You run a detection model but notice all predicted boxes are the same size and location. What is the likely cause?

medium

A. Batch size is too large

B. Bounding box regression layer is not trained properly

C. Input images are grayscale

D. Class scores are too low

Solution

1. Step 1: Identify the problem with bounding boxes

   If all boxes are identical, the model likely failed to learn how to adjust box coordinates.

2. Step 2: Connect to bounding box regression training

   The bounding box regression layer predicts box coordinates; if not trained well, outputs won't vary.

3. Final Answer:

   Bounding box regression layer is not trained properly -> Option B

4. Quick Check:

   Same boxes = bad box regression training [OK]

Hint: Same boxes mean box regression failed [OK]

Common Mistakes:

• Blaming class scores for box size issues
• Thinking grayscale images cause box errors
• Assuming batch size affects box variety

5. In a PyTorch object detection model, why is it important to predict both class scores and bounding boxes instead of only class scores?

hard

A. Because bounding boxes improve image resolution

B. Because bounding boxes reduce model size

C. Because class scores are not used in detection

D. Because class scores alone cannot tell where objects are located

Solution

1. Step 1: Understand the role of class scores

   Class scores tell what object is present but not its position in the image.

2. Step 2: Understand the role of bounding boxes

   Bounding boxes provide the exact location and size of the object, enabling localization.

3. Step 3: Combine both for full detection

   Detection requires knowing both what the object is and where it is, so both outputs are needed.

4. Final Answer:

   Because class scores alone cannot tell where objects are located -> Option D

5. Quick Check:

   Class scores = what, boxes = where [OK]

Hint: Class scores = what, boxes = where [OK]

Common Mistakes:

• Thinking bounding boxes affect image quality
• Believing class scores are unused in detection
• Assuming bounding boxes reduce model size