Geometric transforms (rotate, flip, crop) in Computer Vision - Model Pipeline Trace

Model Pipeline - Geometric transforms (rotate, flip, crop)

This pipeline shows how images are changed step-by-step using geometric transforms like rotate, flip, and crop. These changes help models learn better by seeing different views of the same image.

Data Flow - 4 Stages

1Input Image

1 image x 256 height x 256 width x 3 channels→Original image loaded→1 image x 256 height x 256 width x 3 channels

A colorful photo of a cat

↓

2Rotate

1 image x 256 height x 256 width x 3 channels→Rotate image 90 degrees clockwise→1 image x 256 height x 256 width x 3 channels

Cat image rotated so head points right instead of up

↓

3Flip

1 image x 256 height x 256 width x 3 channels→Flip image horizontally (left to right)→1 image x 256 height x 256 width x 3 channels

Cat image mirrored so left ear is now on right

↓

4Crop

1 image x 256 height x 256 width x 3 channels→Crop center 128x128 pixels→1 image x 128 height x 128 width x 3 channels

Zoomed-in cat face in center of image

Training Trace - Epoch by Epoch

Loss
1.0 |          *
0.8 |         * 
0.6 |       *   
0.4 |     *     
0.2 |   *       
0.0 +-----------
      1 2 3 4 5
       Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.85	0.55	Model starts learning with high loss and low accuracy
2	0.65	0.70	Loss decreases and accuracy improves after seeing transformed images
3	0.50	0.80	Model learns better features from augmented images
4	0.40	0.85	Loss continues to drop, accuracy rises steadily
5	0.35	0.88	Model converges with good accuracy using geometric transforms

Prediction Trace - 5 Layers

Layer 1: Input Image

Layer 2: Rotate 90 degrees clockwise

Layer 3: Flip horizontally

Layer 4: Crop center 128x128

Layer 5: Model prediction

Model Quiz - 3 Questions

What happens to the image size after cropping?

A It becomes larger

B It stays the same size

C It becomes smaller in height and width

D It loses color channels

Key Insight

Using geometric transforms like rotate, flip, and crop helps the model see different views of the same image. This variety teaches the model to recognize objects better, improving accuracy and reducing overfitting.

Practice

1. Which geometric transform flips an image horizontally, like looking in a mirror?

easy

A. Horizontal flip

B. Rotate 90 degrees

C. Crop center

D. Vertical flip

Solution

1. Step 1: Understand horizontal flip

   Horizontal flip reverses the image left to right, like a mirror reflection.

2. Step 2: Compare with other transforms

   Rotate changes orientation, crop cuts part of image, vertical flip flips top to bottom.

3. Final Answer:

   Horizontal flip -> Option A

4. Quick Check:

   Mirror image = Horizontal flip [OK]

Hint: Mirror effect means horizontal flip [OK]

Common Mistakes:

• Confusing vertical flip with horizontal flip
• Thinking rotate is flipping
• Mixing crop with flip

2. Which Python code correctly rotates an image by 90 degrees clockwise using OpenCV?

easy

A. rotated = cv2.crop(image, (0,0,100,100))

B. rotated = cv2.flip(image, 1)

C. rotated = cv2.rotate(image, cv2.ROTATE_90_CLOCKWISE)

D. rotated = cv2.rotate(image, cv2.ROTATE_180)

Solution

1. Step 1: Identify OpenCV rotate syntax

   cv2.rotate(image, cv2.ROTATE_90_CLOCKWISE) rotates image 90 degrees clockwise.

2. Step 2: Check other options

   Flip flips image, crop is not a cv2 function, ROTATE_180 rotates 180 degrees, not 90.

3. Final Answer:

   rotated = cv2.rotate(image, cv2.ROTATE_90_CLOCKWISE) -> Option C

4. Quick Check:

   Rotate 90 clockwise = cv2.ROTATE_90_CLOCKWISE [OK]

Hint: Use cv2.rotate with ROTATE_90_CLOCKWISE for 90° turn [OK]

Common Mistakes:

• Using flip instead of rotate
• Wrong rotate constant
• Trying crop as a cv2 function

3. What will be the shape of the image after applying this code?

import cv2
image = cv2.imread('img.jpg')
cropped = image[50:150, 30:130]

medium

A. (100, 100, 3)

B. (150, 130, 3)

C. (80, 100, 3)

D. (100, 80, 3)

Solution

1. Step 1: Calculate crop height

   Height = 150 - 50 = 100 pixels.

2. Step 2: Calculate crop width

   Width = 130 - 30 = 100 pixels.

3. Step 3: Confirm channels

   Image has 3 color channels (RGB/BGR).

4. Final Answer:

   (100, 100, 3) -> Option A

5. Quick Check:

   Crop size = (height, width, channels) = (100, 100, 3) [OK]

Hint: Subtract start from end index for height and width [OK]

Common Mistakes:

• Mixing width and height order
• Forgetting zero-based indexing
• Ignoring color channels

4. This code tries to flip an image vertically but causes an error. What is wrong?

import cv2
image = cv2.imread('img.jpg')
flipped = cv2.flip(image, 2)

medium

A. image must be grayscale for flip

B. Flip code 2 is invalid; use 0 for vertical flip

C. cv2.flip requires three arguments

D. cv2.flip does not flip images

Solution

1. Step 1: Check cv2.flip flipCode values

   flipCode=0 flips vertically, 1 flips horizontally, -1 flips both axes.

2. Step 2: Identify invalid flipCode

   flipCode=2 is invalid and causes error.

3. Final Answer:

   Flip code 2 is invalid; use 0 for vertical flip -> Option B

4. Quick Check:

   Vertical flip = flipCode 0 [OK]

Hint: Use flipCode 0 for vertical flip in cv2.flip [OK]

Common Mistakes:

• Using wrong flipCode values
• Thinking flip needs grayscale
• Assuming cv2.flip needs extra args

5. You want to rotate an image 90 degrees clockwise and then crop the central 100x100 pixels. Which code correctly does this?

hard

A. crop = img[50:150, 50:150]
rot = cv2.rotate(crop, cv2.ROTATE_90_CLOCKWISE)

B. rot = cv2.flip(img, 1)
crop = rot[rot.shape[0]//2-50:rot.shape[0]//2+50, rot.shape[1]//2-50:rot.shape[1]//2+50]

C. rot = cv2.rotate(img, cv2.ROTATE_180)
crop = rot[0:100, 0:100]

D. rot = cv2.rotate(img, cv2.ROTATE_90_CLOCKWISE)
crop = rot[rot.shape[0]//2-50:rot.shape[0]//2+50, rot.shape[1]//2-50:rot.shape[1]//2+50]

Solution

1. Step 1: Rotate image 90 degrees clockwise

   Use cv2.rotate with ROTATE_90_CLOCKWISE on original image.

2. Step 2: Crop center 100x100 pixels

   Calculate center indices and slice 50 pixels before and after center in both dimensions.

3. Step 3: Verify order and correctness

   Rotation first, then crop center; other options rotate wrong angle or crop before rotate.

4. Final Answer:

   Rotate then crop center 100x100 -> Option D

5. Quick Check:

   Rotate 90° clockwise then center crop = rot = cv2.rotate(img, cv2.ROTATE_90_CLOCKWISE) crop = rot[rot.shape[0]//2-50:rot.shape[0]//2+50, rot.shape[1]//2-50:rot.shape[1]//2+50] [OK]

Hint: Rotate first, then crop center using shape indices [OK]

Common Mistakes:

• Cropping before rotating changes crop area
• Using wrong rotate angle
• Using flip instead of rotate