Feature extraction approach in Computer Vision - Model Metrics & Evaluation

Metrics & Evaluation - Feature extraction approach

Which metric matters for Feature Extraction and WHY

Feature extraction helps turn images into useful numbers for a model. To check if these features are good, we look at how well the model performs using them. Common metrics include accuracy for simple tasks, but more detailed metrics like precision, recall, and F1 score matter when classes are uneven or errors have different costs.

Why? Because good features help the model tell apart classes clearly. If features are poor, even the best model will struggle, so metrics show if the features capture important info.

Confusion Matrix Example

Imagine a model using extracted features to detect cats vs dogs. Here is a confusion matrix from 100 images:

      | Predicted Cat | Predicted Dog |
      |--------------|---------------|
      | True Cat: 40 | False Dog: 5  |
      | False Cat: 10| True Dog: 45  |
    

From this:

• True Positives (TP) = 40 (correct cat detections)
• False Positives (FP) = 10 (dogs wrongly called cats)
• True Negatives (TN) = 45 (correct dog detections)
• False Negatives (FN) = 5 (cats missed)

Precision vs Recall Tradeoff

Using features, the model can be tuned to catch more cats (high recall) or be more sure when it says "cat" (high precision).

High Precision: Few wrong cat labels, but might miss some cats (lower recall). Good if false alarms are costly.

High Recall: Finds most cats, but may include some dogs by mistake (lower precision). Good if missing cats is worse.

Example: For a wildlife camera, high recall helps find all cats. For a pet door that opens only for cats, high precision avoids letting dogs in.

Good vs Bad Metric Values for Feature Extraction

Good Features: Model shows balanced precision and recall above 80%, F1 score near 0.85 or higher, and accuracy above 85%. Confusion matrix has low false positives and false negatives.

Bad Features: Model struggles with precision or recall below 50%, F1 score below 0.6, and accuracy near random guessing (50% for two classes). Confusion matrix shows many mistakes.

Common Pitfalls in Metrics for Feature Extraction

• Accuracy Paradox: High accuracy can hide poor feature quality if classes are imbalanced.
• Data Leakage: Features accidentally include test info, inflating metrics falsely.
• Overfitting: Features too tuned to training data cause great training metrics but poor real-world results.
• Ignoring Class Balance: Not checking precision and recall can miss if features favor one class.

Self Check

Your model using extracted features has 98% accuracy but only 12% recall on the "cat" class. Is it good?

Answer: No. The model misses most cats (low recall), so features likely fail to capture cat traits well. High accuracy is misleading if most images are dogs. You need better features or balance the model.

Key Result

Good feature extraction leads to balanced precision and recall, ensuring the model captures key information for accurate predictions.

Practice

1. What is the main purpose of feature extraction in computer vision?

easy

A. To increase the size of image files

B. To change image colors randomly

C. To convert images into numbers that describe important parts

D. To delete parts of the image

Solution

1. Step 1: Understand feature extraction goal

   Feature extraction transforms images into numerical data representing key details.

2. Step 2: Compare options to this goal

   Only To convert images into numbers that describe important parts describes this process correctly; others describe unrelated actions.

3. Final Answer:

   To convert images into numbers that describe important parts -> Option C

4. Quick Check:

   Feature extraction = convert images to numbers [OK]

Hint: Feature extraction means turning images into numbers [OK]

Common Mistakes:

• Thinking feature extraction changes image colors
• Confusing feature extraction with image resizing
• Believing it deletes image parts

2. Which of the following is a correct way to describe SIFT in feature extraction?

easy

A. A way to convert images to grayscale

B. A method that detects and describes local features in images

C. A technique to increase image resolution

D. A method to compress image files

Solution

1. Step 1: Recall what SIFT does

   SIFT finds and describes important local features in images for matching and recognition.

2. Step 2: Match options to SIFT's function

   Only A method that detects and describes local features in images correctly describes SIFT; others describe unrelated image processes.

3. Final Answer:

   A method that detects and describes local features in images -> Option B

4. Quick Check:

   SIFT = local feature detection [OK]

Hint: SIFT finds key points and describes them [OK]

Common Mistakes:

• Confusing SIFT with image resizing
• Thinking SIFT changes image colors
• Believing SIFT compresses images

3. Given the following Python code using OpenCV, what will be the shape of the feature vector extracted by SIFT for an image with 500 keypoints?

import cv2
img = cv2.imread('image.jpg', cv2.IMREAD_GRAYSCALE)
sift = cv2.SIFT_create()
keypoints, descriptors = sift.detectAndCompute(img, None)
print(descriptors.shape)

medium

A. (null, 128)

B. (128, 500)

C. (500, 64)

D. (500, 128)

Solution

1. Step 1: Understand SIFT descriptor shape

   SIFT descriptors have 128 features per keypoint, so shape is (number_of_keypoints, 128).

2. Step 2: Apply to given keypoints

   With 500 keypoints, descriptors shape is (500, 128).

3. Final Answer:

   (500, 128) -> Option D

4. Quick Check:

   SIFT descriptors shape = (keypoints, 128) [OK]

Hint: SIFT descriptors = keypoints x 128 features [OK]

Common Mistakes:

• Swapping dimensions of descriptors
• Assuming 64 features per keypoint
• Thinking descriptors shape depends on image size

4. You wrote this code to extract features using SIFT but get an error:

import cv2
img = cv2.imread('image.jpg')
sift = cv2.SIFT_create()
keypoints, descriptors = sift.detectAndCompute(img, None)
print(len(keypoints))

What is the likely cause of the error?

medium

A. The image is not loaded in grayscale, causing SIFT to fail

B. SIFT_create() is not a valid OpenCV function

C. detectAndCompute requires a mask argument

D. print(len(keypoints)) is incorrect syntax

Solution

1. Step 1: Check image loading method

   The image is loaded in color by default; SIFT expects grayscale images.

2. Step 2: Identify error cause

   Not converting to grayscale can cause detectAndCompute to fail or return null.

3. Final Answer:

   The image is not loaded in grayscale, causing SIFT to fail -> Option A

4. Quick Check:

   Load image grayscale for SIFT [OK]

Hint: Always load images in grayscale for SIFT [OK]

Common Mistakes:

• Thinking SIFT_create() is invalid
• Believing mask argument is mandatory
• Assuming print syntax is wrong

5. You want to extract features from images for a complex object recognition task. Which approach is best to capture detailed and high-level features?

hard

A. Use a deep learning model like a convolutional neural network (CNN)

B. Use simple edge detection filters only

C. Use random pixel values as features

D. Use image resizing without feature extraction

Solution

1. Step 1: Understand feature needs for complex tasks

   Complex object recognition requires capturing detailed and abstract features.

2. Step 2: Compare methods for feature extraction

   Deep learning models like CNNs learn rich features automatically, outperforming simple filters or random values.

3. Final Answer:

   Use a deep learning model like a convolutional neural network (CNN) -> Option A

4. Quick Check:

   Complex features need CNNs [OK]

Hint: Deep models capture complex features best [OK]

Common Mistakes:

• Relying only on simple filters
• Using random pixels as features
• Skipping feature extraction by resizing only