Morphological operations (erosion, dilation, opening, closing) in Computer Vision - Model Pipeline Trace

Model Pipeline - Morphological operations (erosion, dilation, opening, closing)

This pipeline shows how morphological operations change images to highlight or remove small details. These operations help clean images or find shapes by shrinking or growing bright areas.

Data Flow - 5 Stages

1Input Image

1 image x 256 x 256 pixels (grayscale)→Load grayscale image with bright and dark areas→1 image x 256 x 256 pixels

A black and white photo of a leaf with noise spots

↓

2Erosion

1 image x 256 x 256 pixels→Shrink bright areas by sliding a small square kernel and keeping minimum pixel values→1 image x 256 x 256 pixels

Leaf edges become thinner, small white noise spots disappear

↓

3Dilation

1 image x 256 x 256 pixels→Grow bright areas by sliding a small square kernel and keeping maximum pixel values→1 image x 256 x 256 pixels

Leaf edges become thicker, small holes fill in

↓

4Opening

1 image x 256 x 256 pixels→Erosion followed by dilation to remove small bright noise→1 image x 256 x 256 pixels

Leaf image with small white noise removed but shape preserved

↓

5Closing

1 image x 256 x 256 pixels→Dilation followed by erosion to fill small dark holes→1 image x 256 x 256 pixels

Leaf image with small black holes filled in

Training Trace - Epoch by Epoch

Loss
0.5 |****
0.4 |*** 
0.3 |**  
0.2 |*   
0.1 |    
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.45	0.60	Initial morphological filter parameters applied, moderate noise removal
2	0.30	0.75	Kernel size adjusted, better noise removal and shape preservation
3	0.20	0.85	Optimal kernel size found, clear edges and minimal noise
4	0.18	0.88	Fine tuning morphological operations, slight improvement
5	0.15	0.90	Stable performance, good balance of noise removal and detail

Prediction Trace - 5 Layers

Layer 1: Input Image

Layer 2: Erosion

Layer 3: Dilation

Layer 4: Opening (Erosion + Dilation)

Layer 5: Closing (Dilation + Erosion)

Model Quiz - 3 Questions

What does erosion do to bright areas in an image?

A Fills small dark holes inside bright areas

B Shrinks bright areas by removing pixels at edges

C Grows bright areas by adding pixels at edges

D Removes small dark noise spots

Key Insight

Morphological operations like erosion and dilation help clean images by shrinking or growing bright areas. Combining them as opening or closing removes noise or fills holes while preserving important shapes. Adjusting kernel size improves results, shown by decreasing loss and increasing accuracy during training.

Practice

1. What does the erosion operation do to the white parts of a binary image?

easy

A. It grows the white parts by adding pixels at the edges.

B. It removes noise by smoothing the edges.

C. It fills small holes inside the white parts.

D. It shrinks the white parts by removing pixels at the edges.

Solution

1. Step 1: Understand erosion effect on white pixels

   Erosion removes pixels from the boundaries of white regions, making them smaller.

2. Step 2: Compare with other operations

   Dilation grows white parts, opening removes noise, closing fills holes, so erosion must shrink white parts.

3. Final Answer:

   It shrinks the white parts by removing pixels at the edges. -> Option D

4. Quick Check:

   Erosion = Shrinks white parts [OK]

Hint: Erosion shrinks white areas by cutting edges [OK]

Common Mistakes:

• Confusing erosion with dilation
• Thinking erosion fills holes
• Mixing erosion with noise removal

2. Which of the following is the correct syntax to perform dilation using OpenCV in Python on an image img with a 3x3 kernel?

easy

A. cv2.erode(img, np.ones((3,3), np.uint8))

B. cv2.dilate(img, np.ones((3,3), np.uint8))

C. cv2.dilate(img, (3,3))

D. cv2.dilate(img, kernel=3)

Solution

1. Step 1: Recall dilation syntax in OpenCV

   Dilation requires the image and a structuring element (kernel), usually created with np.ones of desired size and type.

2. Step 2: Check options for correct usage

   cv2.dilate(img, np.ones((3,3), np.uint8)) uses cv2.dilate with a 3x3 kernel created by np.ones and correct dtype, which is valid syntax.

3. Final Answer:

   cv2.dilate(img, np.ones((3,3), np.uint8)) -> Option B

4. Quick Check:

   Dilation syntax = cv2.dilate(image, kernel) [OK]

Hint: Use np.ones((3,3), np.uint8) as kernel for dilation [OK]

Common Mistakes:

• Using erode instead of dilate
• Passing kernel size tuple directly
• Using wrong kernel datatype

3. Given the following Python code using OpenCV:

import cv2
import numpy as np
img = np.array([[0,0,0,0,0],
                [0,255,255,255,0],
                [0,255,0,255,0],
                [0,255,255,255,0],
                [0,0,0,0,0]], dtype=np.uint8)
kernel = np.ones((3,3), np.uint8)
eroded = cv2.erode(img, kernel)
print(eroded)

What will be the printed output?

medium

A. [[ 0 0 0 0 0]
[ 0 255 0 255 0]
[ 0 0 0 0 0]
[ 0 255 0 255 0]
[ 0 0 0 0 0]]

B. [[ 0 0 0 0 0]
[ 0 255 255 255 0]
[ 0 255 255 255 0]
[ 0 255 255 255 0]
[ 0 0 0 0 0]]

C. [[ 0 0 0 0 0]
[ 0 0 0 0 0]
[ 0 0 0 0 0]
[ 0 0 0 0 0]
[ 0 0 0 0 0]]

D. [[255 255 255 255 255]
[255 255 255 255 255]
[255 255 255 255 255]
[255 255 255 255 255]
[255 255 255 255 255]]

Solution

1. Step 1: Understand erosion on the given image

   Erosion removes pixels at edges of white regions. The center pixel (0) surrounded by 255s will cause erosion to shrink the white area.

2. Step 2: Apply 3x3 kernel erosion

   Since the kernel covers neighbors, any pixel with a zero neighbor becomes zero. The white cross shape will erode to a smaller cross with zeros at the center and edges.

3. Final Answer:

   White cross with zeros at center and edges as shown in option A -> Option A

4. Quick Check:

   Erosion shrinks white, so edge pixels vanish but some inner pixels remain [OK]

Hint: Erosion removes edge pixels, shrinking white areas [OK]

Common Mistakes:

• Assuming erosion keeps center pixels
• Confusing erosion with dilation output
• Ignoring zero pixels in kernel neighborhood

4. You wrote this code to perform opening on an image img but it does not remove noise as expected:

kernel = np.ones((3,3), np.uint8)
opened = cv2.dilate(cv2.erode(img, kernel), kernel)

What is the error and how to fix it?

medium

A. Kernel size is too small; increase kernel size to remove noise.

B. The order is reversed; opening is dilation followed by erosion, so swap the calls.

C. Use cv2.morphologyEx with cv2.MORPH_OPEN instead for correct opening.

D. The order is reversed; opening is erosion followed by dilation, so code is correct.

Solution

1. Step 1: Check the definition of opening

   Opening is erosion followed by dilation. The code applies erosion then dilation, which is correct in order.

2. Step 2: Identify practical issue

   Manual calls may work but can be error-prone; using cv2.morphologyEx with MORPH_OPEN is recommended for correct and optimized opening.

3. Final Answer:

   Use cv2.morphologyEx with cv2.MORPH_OPEN instead for correct opening. -> Option C

4. Quick Check:

   Use built-in morphologyEx for opening [OK]

Hint: Use cv2.morphologyEx with MORPH_OPEN for opening [OK]

Common Mistakes:

• Swapping erosion and dilation order
• Not using built-in morphology functions
• Assuming kernel size fixes logic errors

5. You have a noisy binary image with small black holes inside white objects. Which morphological operation should you apply to fill these holes without changing the object shapes much?

hard

A. Closing

B. Dilation

C. Opening

D. Erosion

Solution

1. Step 1: Understand the problem of black holes inside white objects

   Black holes are small dark spots inside white regions that need to be filled.

2. Step 2: Choose operation that fills holes without shrinking objects

   Closing is dilation followed by erosion; it fills small holes and gaps while preserving object shape.

3. Final Answer:

   Closing -> Option A

4. Quick Check:

   Closing fills holes inside white objects [OK]

Hint: Closing fills holes inside white objects [OK]

Common Mistakes:

• Using erosion which shrinks objects
• Using opening which removes noise but not holes
• Confusing dilation alone with closing