Bounding box representation in Computer Vision - Model Pipeline Trace

Model Pipeline - Bounding box representation

This pipeline shows how images with objects are processed to detect and represent objects using bounding boxes. Bounding boxes are rectangles that mark where objects are in the image.

Data Flow - 5 Stages

1Input Image

1 image of 640 x 480 pixels x 3 color channels→Raw image loaded for object detection→1 image of 640 x 480 pixels x 3 color channels

A photo showing a dog and a cat

↓

2Preprocessing

1 image of 640 x 480 x 3→Resize image to 320 x 320 and normalize pixel values to 0-1→1 image of 320 x 320 x 3

Resized and normalized image ready for model input

↓

3Feature Extraction

1 image of 320 x 320 x 3→Extract features using convolutional layers→1 tensor of 20 x 20 x 256 features

Feature map highlighting edges and shapes

↓

4Bounding Box Prediction

1 tensor of 20 x 20 x 256→Predict bounding box coordinates and class scores→1 tensor of 20 x 20 x 6 (4 box coords + 2 class scores)

Predicted boxes like [x_center, y_center, width, height] and scores for dog/cat

↓

5Postprocessing

1 tensor of 20 x 20 x 6→Apply threshold and non-maximum suppression to filter boxes→List of 3 bounding boxes with coordinates and class labels

Boxes: Dog at (150, 200, 100, 80), Cat at (300, 220, 90, 70)

Training Trace - Epoch by Epoch

Loss
2.5 |*****
2.0 |**** 
1.5 |***  
1.0 |**   
0.5 |*    
0.0 +-----
      1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	2.5	0.30	High loss and low accuracy as model starts learning
2	1.8	0.45	Loss decreases, accuracy improves with initial learning
3	1.2	0.60	Model learns bounding box locations better
4	0.8	0.75	Good improvement in detecting objects
5	0.5	0.85	Model converges with low loss and high accuracy

Prediction Trace - 4 Layers

Layer 1: Input Image

Layer 2: Feature Extraction

Layer 3: Bounding Box Prediction

Layer 4: Postprocessing

Model Quiz - 3 Questions

What does a bounding box represent in object detection?

A A color filter applied to the image

B A rectangle marking where an object is in the image

C A label describing the whole image

D A pixel brightness adjustment

Key Insight

Bounding box representation helps the model locate objects by predicting rectangles around them. Training improves the model's ability to predict accurate boxes, shown by decreasing loss and increasing accuracy.

Practice

1. What does a bounding box represent in computer vision?

easy

A. The location of an object in an image using four numbers

B. The color of an object in an image

C. The texture pattern of an object

D. The size of the entire image

Solution

1. Step 1: Understand bounding box purpose

   A bounding box is used to locate objects visually in an image.

2. Step 2: Identify bounding box representation

   It uses four numbers to mark the top-left and bottom-right corners of the object.

3. Final Answer:

   The location of an object in an image using four numbers -> Option A

4. Quick Check:

   Bounding box = object location [OK]

Hint: Bounding box = 4 numbers marking object edges [OK]

Common Mistakes:

• Confusing bounding box with color or texture
• Thinking bounding box covers the whole image
• Believing bounding box uses only two numbers

2. Which of the following is the correct order of values in a bounding box representation?

easy

A. (bottom-left x, bottom-left y, top-right x, top-right y)

B. (center x, center y, width, height)

C. (width, height, top-left x, top-left y)

D. (top-left x, top-left y, bottom-right x, bottom-right y)

Solution

1. Step 1: Recall bounding box corner points

   The bounding box is defined by the top-left and bottom-right corners.

2. Step 2: Match the correct order

   The order is (top-left x, top-left y, bottom-right x, bottom-right y).

3. Final Answer:

   (top-left x, top-left y, bottom-right x, bottom-right y) -> Option D

4. Quick Check:

   Bounding box corners = top-left and bottom-right [OK]

Hint: Bounding box uses top-left then bottom-right coordinates [OK]

Common Mistakes:

• Mixing center coordinates with corner points
• Swapping bottom-left with top-left
• Using width and height before coordinates

3. Given a bounding box with coordinates (10, 20, 50, 80), what is the width and height of the box?

medium

A. Width = 40, Height = 60

B. Width = 60, Height = 40

C. Width = 50, Height = 80

D. Width = 30, Height = 50

Solution

1. Step 1: Calculate width from x-coordinates

   Width = bottom-right x - top-left x = 50 - 10 = 40.

2. Step 2: Calculate height from y-coordinates

   Height = bottom-right y - top-left y = 80 - 20 = 60.

3. Final Answer:

   Width = 40, Height = 60 -> Option A

4. Quick Check:

   Width = 50-10, Height = 80-20 [OK]

Hint: Width = x2 - x1, Height = y2 - y1 [OK]

Common Mistakes:

• Swapping width and height values
• Adding coordinates instead of subtracting
• Using top-left y for width calculation

4. Identify the error in this bounding box definition: bbox = (x1=30, y1=40, x2=20, y2=70)

medium

A. y2 should be less than y1

B. x2 is less than x1, which is invalid for bounding boxes

C. Coordinates must be strings, not integers

D. Bounding box must have five values, not four

Solution

1. Step 1: Check coordinate order validity

   Bounding box requires bottom-right x (x2) to be greater than top-left x (x1).

2. Step 2: Identify the error

   Here, x2=20 is less than x1=30, which is invalid and would cause errors in drawing or calculations.

3. Final Answer:

   x2 is less than x1, which is invalid for bounding boxes -> Option B

4. Quick Check:

   x2 must be > x1 for valid box [OK]

Hint: Bottom-right x must be greater than top-left x [OK]

Common Mistakes:

• Ignoring coordinate order rules
• Thinking y2 must be less than y1
• Assuming bounding box needs 5 values

5. You have bounding boxes in the format (center_x, center_y, width, height). How do you convert them to (top-left x, top-left y, bottom-right x, bottom-right y)?

hard

A. top-left x = center_x; top-left y = center_y; bottom-right x = width; bottom-right y = height

B. top-left x = center_x + width/2; top-left y = center_y + height/2; bottom-right x = center_x - width/2; bottom-right y = center_y - height/2

C. top-left x = center_x - width/2; top-left y = center_y - height/2; bottom-right x = center_x + width/2; bottom-right y = center_y + height/2

D. top-left x = width/2; top-left y = height/2; bottom-right x = center_x; bottom-right y = center_y

Solution

1. Step 1: Understand center to corner conversion

   Center coordinates are in the middle of the box; to get corners, subtract half width/height for top-left.

2. Step 2: Calculate corners from center and size

   Top-left x = center_x - width/2; top-left y = center_y - height/2; bottom-right x = center_x + width/2; bottom-right y = center_y + height/2.

3. Final Answer:

   top-left x = center_x - width/2; top-left y = center_y - height/2; bottom-right x = center_x + width/2; bottom-right y = center_y + height/2 -> Option C

4. Quick Check:

   Center ± half size = corners [OK]

Hint: Corners = center ± half width/height [OK]

Common Mistakes:

• Adding half width to top-left instead of subtracting
• Swapping top-left and bottom-right calculations
• Using width and height as coordinates directly