Blurring and smoothing (Gaussian, median, bilateral) in Computer Vision - Model Metrics & Evaluation

Metrics & Evaluation - Blurring and smoothing (Gaussian, median, bilateral)

Which metric matters for this concept and WHY

For blurring and smoothing in images, the key metric is Mean Squared Error (MSE) or Peak Signal-to-Noise Ratio (PSNR) when comparing the smoothed image to a clean reference. These metrics show how well noise is reduced without losing important details. Another important metric is Edge Preservation Index, which measures how well edges are kept sharp after smoothing. This matters because smoothing should reduce noise but keep edges clear for good image understanding.

Confusion matrix or equivalent visualization (ASCII)

Original Image:    Noisy Image:       Smoothed Image:
+---------+       +---------+       +---------+
|  Detail |       |  Noise  |       |  Smooth |
|  Edges  |       |  Added  |       |  Edges  |
+---------+       +---------+       +---------+

Metrics compare pixel differences:
MSE = sum((Original - Smoothed)^2) / total_pixels
PSNR = 10 * log10((MAX_pixel^2) / MSE)

Edge Preservation Index:
High value means edges kept sharp after smoothing.
    

Precision vs Recall (or equivalent tradeoff) with concrete examples

In smoothing, there is a tradeoff between noise removal and edge preservation:

• Gaussian blur removes noise well but can blur edges, losing details.
• Median blur removes salt-and-pepper noise and keeps edges better than Gaussian.
• Bilateral filter removes noise while preserving edges best but is slower.

Choosing a smoothing method depends on what matters more: clean image (noise removal) or sharp edges (details).

What "good" vs "bad" metric values look like for this use case

Good smoothing:

• Low MSE (close to zero) indicating noise is reduced.
• High PSNR (above 30 dB) showing good image quality.
• High Edge Preservation Index (close to 1) meaning edges are sharp.

Bad smoothing:

• High MSE showing noise or distortion remains.
• Low PSNR (below 20 dB) indicating poor quality.
• Low Edge Preservation Index (close to 0) meaning edges are blurred.

Metrics pitfalls (accuracy paradox, data leakage, overfitting indicators)

• Over-smoothing: Metrics like MSE may improve but image details are lost, hurting downstream tasks.
• Ignoring edge preservation: Only measuring noise reduction can miss that edges are blurred.
• Data leakage: Using the same noisy image as reference inflates quality metrics.
• Accuracy paradox: A very smooth but blurry image may score well on noise metrics but look worse to humans.

Self-check

Your smoothing model reduces noise well with a low MSE but the Edge Preservation Index is very low. Is it good for image tasks that need sharp edges? Why or why not?

Answer: No, because while noise is reduced, edges are blurred. This harms tasks like object detection that rely on clear edges. A balance is needed.

Key Result

Effective smoothing balances low noise (low MSE) with high edge preservation for best image quality.