Cutout and CutMix in Computer Vision - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

What is the main purpose of Cutout in image data augmentation?

Cutout is a popular data augmentation technique used in training image models. What is its main purpose?

A To rotate the image by a random angle to increase data diversity.

B To randomly erase a square patch from the input image to encourage the model to focus on less prominent features.

C To add Gaussian noise to the image pixels to simulate sensor noise.

D To blend two images together by mixing their pixel values and labels.

💡 Hint

Think about how Cutout modifies the image to prevent overfitting on specific parts.

Cutout works by masking out a random square region of the input image during training. This forces the model to learn from other parts of the image, improving robustness and reducing overfitting.

🧠 Conceptual

intermediate

How does CutMix differ from Cutout in data augmentation?

Both CutMix and Cutout modify images during training. What key difference distinguishes CutMix from Cutout?

A CutMix replaces a patch of one image with a patch from another image and mixes their labels, while Cutout only masks a patch with zeros.

B CutMix crops images to smaller sizes, Cutout enlarges images.

C CutMix adds noise to images, while Cutout changes brightness.

D CutMix rotates images randomly, whereas Cutout flips images horizontally.

💡 Hint

Consider how labels are handled in each technique.

CutMix cuts a patch from one image and pastes it onto another image, then mixes their labels proportionally. Cutout only masks a patch with zeros and keeps the original label unchanged.

❓ Predict Output

advanced

What is the output shape and label mix ratio after applying CutMix?

Given two images of shape (3, 32, 32) and labels one-hot encoded as vectors, after applying CutMix with a patch covering 25% of the area, what is the expected label mix ratio?

Computer Vision

import numpy as np

img1 = np.random.rand(3, 32, 32)
img2 = np.random.rand(3, 32, 32)
label1 = np.array([1, 0, 0])  # class A
label2 = np.array([0, 1, 0])  # class B

# CutMix patch covers 25% of image area
patch_area_ratio = 0.25

# Label mix ratio calculation
label_mix_ratio = 1 - patch_area_ratio

mixed_label = label1 * label_mix_ratio + label2 * patch_area_ratio

output_shape = img1.shape

A Output shape: (3, 32, 32), Label mix ratio: [0.75, 0.25, 0.0]

B Output shape: (32, 32, 3), Label mix ratio: [0.25, 0.75, 0.0]

C Output shape: (3, 32, 32), Label mix ratio: [0.5, 0.5, 0.0]

D Output shape: (3, 32, 32), Label mix ratio: [1.0, 0.0, 0.0]

💡 Hint

Remember the label mix ratio corresponds to the proportion of the original image area kept.

The output image shape remains the same as input images. The label mix ratio is calculated as the proportion of the original image area not replaced by the patch (1 - 0.25 = 0.75) for label1, and 0.25 for label2.

❓ Metrics

advanced

How does CutMix typically affect model accuracy and robustness compared to no augmentation?

When training an image classification model, what is the typical effect of using CutMix augmentation on accuracy and robustness?

A CutMix has no effect on accuracy or robustness compared to no augmentation.

B CutMix decreases accuracy but improves robustness by confusing the model with mixed labels.

C CutMix usually improves both accuracy and robustness by providing diverse training samples and smoother decision boundaries.

D CutMix improves accuracy but reduces robustness due to overfitting on mixed images.

💡 Hint

Think about how mixing images and labels helps the model generalize.

CutMix encourages the model to learn from combined features and labels, which improves generalization and robustness to occlusion or noise, often leading to better accuracy.

🔧 Debug

expert

Why does this CutMix implementation cause a label mismatch error?

Consider this simplified CutMix code snippet. Why does it raise an error when mixing labels?

Computer Vision

import numpy as np

def cutmix_labels(label1, label2, patch_ratio):
    mixed_label = label1 * patch_ratio + label2 * (1 - patch_ratio)
    return mixed_label

label1 = np.array([1, 0, 0])
label2 = np.array([0, 1, 0])
patch_ratio = 0.3

mixed = cutmix_labels(label1, label2, patch_ratio)
print(mixed)

A The labels are not one-hot encoded, causing a shape mismatch error.

B The patch_ratio must be an integer, not a float.

C The function is missing a return statement.

D The label mix formula is reversed; it should be label1 * (1 - patch_ratio) + label2 * patch_ratio.

💡 Hint

Check how the patch_ratio relates to the original and patched image areas.

The patch_ratio represents the area replaced by the second image, so label1 should be weighted by (1 - patch_ratio) and label2 by patch_ratio. The code reverses this, causing incorrect label mixing.