Face detection with deep learning in Computer Vision - Model Pipeline Trace

Model Pipeline - Face detection with deep learning

This pipeline detects faces in images using a deep learning model. It takes an image, processes it to find face features, trains a model to recognize faces, and then predicts face locations in new images.

Data Flow - 6 Stages

1Input Image

1 image x 640 x 480 x 3 channels→Load and resize image to fixed size→1 image x 224 x 224 x 3 channels

A photo of a person resized to 224x224 pixels with RGB colors

↓

2Preprocessing

1 image x 224 x 224 x 3 channels→Normalize pixel values to range 0-1→1 image x 224 x 224 x 3 channels

Pixel values changed from 0-255 to 0.0-1.0

↓

3Feature Extraction

1 image x 224 x 224 x 3 channels→Pass image through convolutional layers to extract features→1 image x 14 x 14 x 256 feature maps

Edges and shapes detected in the image

↓

4Face Region Proposal

1 image x 14 x 14 x 256 feature maps→Generate candidate face boxes using region proposal network→1 image x 300 candidate boxes x 4 coordinates

300 boxes with coordinates like [x_min, y_min, x_max, y_max]

↓

5Classification and Bounding Box Regression

1 image x 300 candidate boxes x features→Classify each box as face or background and refine box coordinates→1 image x 300 boxes with class scores and refined coordinates

Box 1: face score 0.95, coordinates refined to better fit face

↓

6Non-Maximum Suppression (NMS)

1 image x 300 boxes with scores→Remove overlapping boxes to keep best face detections→1 image x 5 final face boxes

5 boxes left with highest confidence and no large overlap

Training Trace - Epoch by Epoch

Epochs
1 |************
2 |**************
3 |****************
4 |********************
5 |**********************
Loss
1.2 0.9 0.7 0.5 0.4
Accuracy
0.60 0.72 0.80 0.87 0.91

Epoch	Loss ↓	Accuracy ↑	Observation
1	1.2	0.60	Model starts learning basic face features
2	0.9	0.72	Loss decreases as model improves face detection
3	0.7	0.80	Model learns better bounding box predictions
4	0.5	0.87	Face classification accuracy improves
5	0.4	0.91	Model converges with high accuracy and low loss

Prediction Trace - 6 Layers

Layer 1: Input Image

Layer 2: Preprocessing

Layer 3: Feature Extraction (Conv Layers)

Layer 4: Region Proposal Network

Layer 5: Classification and Box Refinement

Layer 6: Non-Maximum Suppression

Model Quiz - 3 Questions

What is the purpose of the Non-Maximum Suppression step?

A To resize the input image to a fixed size

B To normalize pixel values between 0 and 1

C To remove overlapping boxes and keep the best face detections

D To extract features from the image using convolution

Key Insight

This visualization shows how a deep learning model learns to detect faces by extracting features, proposing candidate face regions, and refining predictions. Training improves accuracy while reducing loss, and post-processing like Non-Maximum Suppression helps produce clear final face detections.

Practice

1. What is the main purpose of face detection in deep learning?

easy

A. To find and locate faces in images or videos

B. To recognize the identity of a person

C. To generate new face images

D. To remove faces from images

Solution

1. Step 1: Understand face detection

   Face detection means finding where faces are in an image, not who they belong to.

2. Step 2: Differentiate from face recognition

   Face recognition identifies who the face belongs to, which is different from detection.

3. Final Answer:

   To find and locate faces in images or videos -> Option A

4. Quick Check:

   Face detection = Find faces [OK]

Hint: Face detection locates faces, recognition identifies them [OK]

Common Mistakes:

• Confusing detection with recognition
• Thinking detection creates new images
• Assuming detection removes faces

2. Which of the following is the correct way to load a Haar Cascade face detector in OpenCV (Python)?

easy

A. face_cascade = cv2.FaceDetector('haarcascade_frontalface_default.xml')

B. face_cascade = cv2.loadCascade('haarcascade_frontalface_default.xml')

C. face_cascade = cv2.Cascade('haarcascade_frontalface_default.xml')

D. face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml')

Solution

1. Step 1: Recall OpenCV syntax for Haar Cascade

   OpenCV uses cv2.CascadeClassifier to load Haar Cascade XML files.

2. Step 2: Check each option's method name

   Only cv2.CascadeClassifier is correct; others are invalid or do not exist.

3. Final Answer:

   face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml') -> Option D

4. Quick Check:

   Use CascadeClassifier to load Haar cascades [OK]

Hint: Use CascadeClassifier to load Haar cascades in OpenCV [OK]

Common Mistakes:

• Using wrong method names like loadCascade or Cascade
• Confusing face detector with face recognizer
• Missing the .xml file extension

3. Given this code snippet, what will be the output if the image contains two faces?

import cv2
face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml')
img = cv2.imread('group_photo.jpg')
gray = cv2.cvtColor(img, cv2.COLOR_BGR2GRAY)
faces = face_cascade.detectMultiScale(gray, scaleFactor=1.1, minNeighbors=5)
print(len(faces))

medium

A. 2

B. 1

C. 0

D. Error

Solution

1. Step 1: Understand detectMultiScale output

   detectMultiScale returns a list of rectangles for each detected face.

2. Step 2: Count detected faces in the image

   Since the image has two faces, len(faces) will be 2.

3. Final Answer:

   2 -> Option A

4. Quick Check:

   Faces detected = 2 [OK]

Hint: detectMultiScale returns all faces found; count them [OK]

Common Mistakes:

• Assuming detectMultiScale returns a boolean
• Confusing number of faces with confidence scores
• Forgetting to convert image to grayscale

4. What is wrong with this face detection code snippet?

import cv2
face_cascade = cv2.CascadeClassifier('haarcascade_frontalface_default.xml')
img = cv2.imread('photo.jpg')
faces = face_cascade.detectMultiScale(img)
print(len(faces))

medium

A. detectMultiScale requires a color image

B. The XML file path is incorrect

C. The image should be converted to grayscale before detection

D. print(len(faces)) should be print(faces)

Solution

1. Step 1: Check input type for detectMultiScale

   detectMultiScale expects a grayscale image, not a color image.

2. Step 2: Identify missing grayscale conversion

   The code misses converting img to grayscale before detection.

3. Final Answer:

   The image should be converted to grayscale before detection -> Option C

4. Quick Check:

   detectMultiScale needs grayscale input [OK]

Hint: Always convert images to grayscale before face detection [OK]

Common Mistakes:

• Passing color images directly to detectMultiScale
• Assuming detectMultiScale works on any image format
• Confusing print(len(faces)) with print(faces)

5. You want to improve face detection accuracy in a crowded photo using Haar Cascades. Which approach is best?

hard

A. Increase minNeighbors parameter to reduce false positives

B. Decrease scaleFactor to detect smaller faces more precisely

C. Use color images instead of grayscale for detection

D. Skip preprocessing and use raw images directly

Solution

1. Step 1: Understand scaleFactor effect

   Lower scaleFactor means the detector checks more scales, helping find smaller faces.

2. Step 2: Compare with other options

   Increasing minNeighbors reduces false positives but may miss faces; color images and skipping preprocessing reduce accuracy.

3. Final Answer:

   Decrease scaleFactor to detect smaller faces more precisely -> Option B

4. Quick Check:

   Lower scaleFactor = better small face detection [OK]

Hint: Lower scaleFactor to catch smaller faces in crowded images [OK]

Common Mistakes:

• Increasing minNeighbors too much misses faces
• Using color images instead of grayscale
• Skipping image preprocessing steps