Motion detection basics in Computer Vision - Model Pipeline Trace

Model Pipeline - Motion detection basics

This pipeline detects motion by comparing video frames to find changes. It helps identify moving objects in a video stream.

Data Flow - 5 Stages

1Input video frames

30 frames x 480 rows x 640 columns x 3 color channels→Capture video frames from camera or file→30 frames x 480 rows x 640 columns x 3 color channels

Frame 1: RGB image of a room

↓

2Convert to grayscale

30 frames x 480 rows x 640 columns x 3 color channels→Change color images to single channel grayscale→30 frames x 480 rows x 640 columns

Frame 1 grayscale: pixel values 0-255

↓

3Frame differencing

30 frames x 480 rows x 640 columns→Subtract each frame from previous frame to find changes→29 frames x 480 rows x 640 columns

Difference frame 2: pixels showing movement areas

↓

4Thresholding

29 frames x 480 rows x 640 columns→Convert difference to binary mask (motion/no motion)→29 frames x 480 rows x 640 columns (binary)

Binary mask: 1 where motion detected, 0 elsewhere

↓

5Motion detection output

29 frames x 480 rows x 640 columns (binary)→Identify regions with motion and mark bounding boxes→29 frames with bounding box coordinates

Frame 2: bounding box around moving person

Training Trace - Epoch by Epoch

Loss
0.5 |****
0.4 |***
0.3 |**
0.2 |*
0.1 | 
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.45	0.60	Model starts learning to detect motion areas
2	0.30	0.75	Loss decreases, accuracy improves as model learns
3	0.20	0.85	Model detects motion more accurately
4	0.15	0.90	Training converges with good motion detection
5	0.12	0.92	Final epoch with stable loss and high accuracy

Prediction Trace - 5 Layers

Layer 1: Input frame

Layer 2: Convert to grayscale

Layer 3: Frame differencing

Layer 4: Thresholding

Layer 5: Bounding box detection

Model Quiz - 3 Questions

What is the main purpose of frame differencing in motion detection?

A To apply bounding boxes on motion areas

B To convert color images to grayscale

C To find changes between consecutive frames

D To capture video frames from camera

Key Insight

Motion detection works by finding differences between video frames and marking where changes happen. Converting to grayscale simplifies the process, and thresholding helps focus on real motion. Training improves the model's ability to detect motion accurately over time.

Practice

1. What is the main goal of motion detection in computer vision?

easy

A. To increase the brightness of images

B. To find changes between video frames indicating movement

C. To convert color images to grayscale

D. To compress video files for storage

Solution

1. Step 1: Understand motion detection purpose

   Motion detection compares video frames to identify changes that show movement.

2. Step 2: Eliminate unrelated options

   Brightness increase, grayscale conversion, and compression are not about detecting motion.

3. Final Answer:

   To find changes between video frames indicating movement -> Option B

4. Quick Check:

   Motion detection = find changes [OK]

Hint: Motion detection = spotting changes between frames [OK]

Common Mistakes:

• Confusing motion detection with image enhancement
• Thinking motion detection compresses videos
• Mixing grayscale conversion with motion detection

2. Which of the following is the correct order of steps in basic motion detection?

easy

A. Blur, grayscale, difference, threshold, contours

B. Difference, blur, grayscale, contours, threshold

C. Grayscale, blur, difference, threshold, contours

D. Contours, threshold, difference, blur, grayscale

Solution

1. Step 1: Recall typical motion detection steps

   First convert to grayscale, then blur to reduce noise, find difference between frames, apply threshold to highlight changes, and finally find contours.

2. Step 2: Match the correct sequence

   Grayscale, blur, difference, threshold, contours matches this exact order.

3. Final Answer:

   Grayscale, blur, difference, threshold, contours -> Option C

4. Quick Check:

   Step order = grayscale -> blur -> difference -> threshold -> contours [OK]

Hint: Remember: grayscale first, then blur, difference, threshold, contours [OK]

Common Mistakes:

• Mixing up the order of blur and difference
• Applying contours before threshold
• Skipping grayscale conversion

3. Given the following Python code snippet for motion detection, what will be the output type of thresh?

import cv2
frame1 = cv2.imread('frame1.jpg')
frame2 = cv2.imread('frame2.jpg')
gray1 = cv2.cvtColor(frame1, cv2.COLOR_BGR2GRAY)
gray2 = cv2.cvtColor(frame2, cv2.COLOR_BGR2GRAY)
diff = cv2.absdiff(gray1, gray2)
thresh = cv2.threshold(diff, 25, 255, cv2.THRESH_BINARY)[1]

medium

A. A grayscale image with pixel values 0 or 255

B. A color image with three channels

C. A single integer threshold value

D. A list of contour points

Solution

1. Step 1: Understand cv2.threshold output

   The function returns a tuple; the second element is the thresholded image, which is a grayscale image with pixels either 0 or max value (255).

2. Step 2: Analyze the code

   Since diff is grayscale, thresholding produces a binary grayscale image, not color or contours.

3. Final Answer:

   A grayscale image with pixel values 0 or 255 -> Option A

4. Quick Check:

   Threshold output = binary grayscale image [OK]

Hint: cv2.threshold returns binary grayscale image, not color or contours [OK]

Common Mistakes:

• Thinking threshold returns contours
• Assuming output is color image
• Confusing threshold value with output image

4. You wrote this code for motion detection but it raises an error:

diff = cv2.absdiff(frame1, frame2)
thresh = cv2.threshold(diff, 30, 255, cv2.THRESH_BINARY)[1]
contours, _ = cv2.findContours(thresh, cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE)

What is the likely cause of the error?

medium

A. cv2.RETR_EXTERNAL is an invalid flag

B. Threshold function returns only one value, not a tuple

C. findContours requires color images, not binary

D. Frames are color images; absdiff needs grayscale images

Solution

1. Step 1: Check input types for absdiff

   cv2.absdiff expects images of the same type and single channel for motion detection, usually grayscale.

2. Step 2: Identify missing grayscale conversion

   Frames are likely color images; missing conversion to grayscale causes error in absdiff.

3. Final Answer:

   Frames are color images; absdiff needs grayscale images -> Option D

4. Quick Check:

   absdiff input = grayscale images [OK]

Hint: Convert frames to grayscale before absdiff to avoid errors [OK]

Common Mistakes:

• Assuming threshold returns single value only
• Thinking findContours needs color images
• Using invalid flags for findContours

5. You want to detect motion only when a moving object covers at least 500 pixels in the frame. Which step should you add after finding contours to achieve this?

hard

A. Filter contours by area and ignore those smaller than 500 pixels

B. Apply a stronger blur to the grayscale image

C. Increase the threshold value to 500

D. Convert the frame to color before contour detection

Solution

1. Step 1: Understand contour filtering

   Contours represent detected shapes; filtering by area removes small noise.

2. Step 2: Apply area filter after contours

   Ignoring contours smaller than 500 pixels ensures only significant motion is detected.

3. Final Answer:

   Filter contours by area and ignore those smaller than 500 pixels -> Option A

4. Quick Check:

   Filter contours by area ≥ 500 pixels [OK]

Hint: Filter contours by size to detect significant motion only [OK]

Common Mistakes:

• Confusing threshold value with pixel area
• Applying blur instead of filtering contours
• Converting to color unnecessarily