Feature matching between images in Computer Vision

Introduction

Feature matching helps find similar points in two pictures. This is useful to understand how images relate or overlap.

When stitching photos to make a panorama.

To track objects moving between video frames.

To recognize places or objects from different views.

When aligning images for 3D reconstruction.

To compare two images for similarities or changes.

Syntax

Computer Vision

import cv2

# Detect features
feature_detector = cv2.SIFT_create()
keypoints1, descriptors1 = feature_detector.detectAndCompute(image1, None)
keypoints2, descriptors2 = feature_detector.detectAndCompute(image2, None)

# Match features
matcher = cv2.BFMatcher()
matches = matcher.knnMatch(descriptors1, descriptors2, k=2)

# Apply ratio test to keep good matches
good_matches = []
for m, n in matches:
    if m.distance < 0.75 * n.distance:
        good_matches.append(m)

Use a feature detector like SIFT or ORB to find keypoints and descriptors.

Use a matcher like BFMatcher or FLANN to find matching features between images.

Examples

Using ORB detector instead of SIFT for faster, free alternative.

Computer Vision

feature_detector = cv2.ORB_create()
keypoints1, descriptors1 = feature_detector.detectAndCompute(image1, None)
keypoints2, descriptors2 = feature_detector.detectAndCompute(image2, None)

Using BFMatcher with Hamming norm for ORB descriptors.

Computer Vision

matcher = cv2.BFMatcher(cv2.NORM_HAMMING)
matches = matcher.match(descriptors1, descriptors2)

Applying Lowe's ratio test to filter good matches.

Computer Vision

good_matches = []
for m, n in matches:
    if m.distance < 0.7 * n.distance:
        good_matches.append(m)

Sample Model

This program loads two images, finds keypoints and descriptors using SIFT, matches them with BFMatcher, applies Lowe's ratio test, and prints how many good matches were found.

Computer Vision

import cv2
import numpy as np

# Load two images in grayscale
image1 = cv2.imread('image1.jpg', cv2.IMREAD_GRAYSCALE)
image2 = cv2.imread('image2.jpg', cv2.IMREAD_GRAYSCALE)

# Check if images loaded
if image1 is None or image2 is None:
    print('Error loading images')
    exit()

# Create SIFT detector
sift = cv2.SIFT_create()

# Detect keypoints and descriptors
kp1, des1 = sift.detectAndCompute(image1, None)
kp2, des2 = sift.detectAndCompute(image2, None)

# Create BFMatcher object
bf = cv2.BFMatcher()

# Match descriptors using k-NN with k=2
matches = bf.knnMatch(des1, des2, k=2)

# Apply ratio test
good_matches = []
for m, n in matches:
    if m.distance < 0.75 * n.distance:
        good_matches.append(m)

# Print number of good matches
print(f'Number of good matches: {len(good_matches)}')

Important Notes

Good matches mean points that likely correspond to the same real-world spot in both images.

Ratio test helps remove false matches by comparing the best and second-best matches.

Feature matching works best on images with enough texture and distinct points.

Summary

Feature matching finds similar points between two images.

Use detectors like SIFT or ORB to get keypoints and descriptors.

Match descriptors and filter matches with ratio test for better accuracy.

Practice

1. What is the main purpose of feature matching between two images?

easy

A. To find similar points or patterns between the images

B. To change the colors of the images

C. To increase the image resolution

D. To crop the images automatically

Solution

1. Step 1: Understand feature matching concept

   Feature matching is used to find points in two images that look alike, such as corners or edges.

2. Step 2: Identify the main goal

   The goal is to find these similar points to compare or align images, not to change colors or resolution.

3. Final Answer:

   To find similar points or patterns between the images -> Option A

4. Quick Check:

   Feature matching = find similar points [OK]

Hint: Feature matching finds points that look alike in two images [OK]

Common Mistakes:

• Confusing feature matching with image editing
• Thinking it changes image size or colors
• Mixing feature matching with image cropping

2. Which of the following is the correct way to detect keypoints using ORB in OpenCV (Python)?

easy

A. orb = cv2.ORB_create(); keypoints = orb.getKeypoints(image)

B. orb = cv2.ORB(); keypoints = orb.find(image)

C. orb = cv2.ORB_create(); keypoints = orb.detect(image, None)

D. orb = cv2.ORB_create(); keypoints = orb.findKeypoints(image)

Solution

1. Step 1: Recall ORB keypoint detection syntax

   In OpenCV, ORB keypoints are detected using orb = cv2.ORB_create() and orb.detect(image, None).

2. Step 2: Check each option

   orb = cv2.ORB_create(); keypoints = orb.detect(image, None) matches the correct syntax; others use incorrect method names or constructors.

3. Final Answer:

   orb = cv2.ORB_create(); keypoints = orb.detect(image, None) -> Option C

4. Quick Check:

   Correct ORB syntax = orb = cv2.ORB_create(); keypoints = orb.detect(image, None) [OK]

Hint: Use ORB_create() and detect() to find keypoints [OK]

Common Mistakes:

• Using wrong method names like findKeypoints
• Calling ORB() instead of ORB_create()
• Passing wrong arguments to detect()

3. Given the following code snippet, what will be the output length of good_matches?

import cv2
orb = cv2.ORB_create()
kp1, des1 = orb.detectAndCompute(img1, None)
kp2, des2 = orb.detectAndCompute(img2, None)
matcher = cv2.BFMatcher(cv2.NORM_HAMMING)
matches = matcher.knnMatch(des1, des2, k=2)
good_matches = []
for m, n in matches:
    if m.distance < 0.75 * n.distance:
        good_matches.append(m)
print(len(good_matches))

medium

A. Total number of keypoints in img2

B. Number of matches passing the ratio test

C. Total number of keypoints in img1

D. Total number of all matches found

Solution

1. Step 1: Understand knnMatch and ratio test

   knnMatch finds the two best matches for each descriptor. The ratio test keeps matches where the best is significantly better than the second best.

2. Step 2: Analyze the code logic

   The loop filters matches by distance ratio, so good_matches contains only those passing the test, not all matches or keypoints.

3. Final Answer:

   Number of matches passing the ratio test -> Option B

4. Quick Check:

   good_matches length = matches passing ratio test [OK]

Hint: Ratio test filters matches; good_matches count = filtered matches [OK]

Common Mistakes:

• Confusing matches with keypoints count
• Thinking good_matches includes all matches
• Ignoring the ratio test condition

4. Identify the error in this feature matching code snippet:

import cv2
orb = cv2.ORB_create()
kp1, des1 = orb.detectAndCompute(img1, None)
kp2, des2 = orb.detectAndCompute(img2, None)
matcher = cv2.BFMatcher(cv2.NORM_L2)
matches = matcher.match(des1, des2)
print(len(matches))

medium

A. Using cv2.NORM_L2 with ORB descriptors is incorrect

B. Missing call to detect() before detectAndCompute()

C. BFMatcher should be replaced with FlannBasedMatcher

D. match() requires k parameter for ORB descriptors

Solution

1. Step 1: Check descriptor type and matcher norm

   ORB descriptors are binary, so BFMatcher should use cv2.NORM_HAMMING, not NORM_L2.

2. Step 2: Identify the error

   Using NORM_L2 causes incorrect distance calculation and poor matching for ORB.

3. Final Answer:

   Using cv2.NORM_L2 with ORB descriptors is incorrect -> Option A

4. Quick Check:

   ORB needs NORM_HAMMING, not NORM_L2 [OK]

Hint: Use NORM_HAMMING with ORB descriptors [OK]

Common Mistakes:

• Using wrong norm type for binary descriptors
• Thinking detect() is needed before detectAndCompute()
• Confusing BFMatcher with FlannBasedMatcher

5. You want to match features between two images taken from different angles. Which approach improves matching accuracy the most?

hard

A. Use ORB detector without any filtering on matches

B. Resize images to very small size before matching

C. Use random keypoints and brute force matching

D. Use SIFT detector and apply Lowe's ratio test on matches

Solution

1. Step 1: Consider feature detector choice

   SIFT is robust to scale and rotation changes, better for different angles than ORB or random points.

2. Step 2: Apply filtering for accuracy

   Lowe's ratio test filters out weak matches, improving accuracy significantly.

3. Step 3: Evaluate other options

   Using ORB without filtering or random points reduces accuracy; resizing too small loses details.

4. Final Answer:

   Use SIFT detector and apply Lowe's ratio test on matches -> Option D

5. Quick Check:

   SIFT + ratio test = best accuracy [OK]

Hint: SIFT + Lowe's ratio test improves matching accuracy [OK]

Common Mistakes:

• Skipping ratio test filtering
• Using random or weak keypoints
• Reducing image size too much