MixUp strategy in Computer Vision - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

What is the main purpose of the MixUp strategy in training neural networks?

MixUp is a data augmentation technique used in training neural networks. What is its primary goal?

A To reduce the model size by pruning neurons during training.

B To increase the size of the training dataset by duplicating existing samples without modification.

C To create new training samples by combining pairs of examples and their labels to improve model generalization.

D To speed up training by using lower precision arithmetic.

💡 Hint

Think about how MixUp changes the training data rather than the model or training speed.

MixUp creates new samples by mixing two inputs and their labels, which helps the model learn smoother decision boundaries and generalize better.

❓ Predict Output

intermediate

What is the output shape of mixed inputs using MixUp?

Given two batches of images X1 and X2 each with shape (32, 3, 64, 64), and a mixing coefficient lambda = 0.4, what is the shape of the mixed batch X_mix = lambda * X1 + (1 - lambda) * X2?

Computer Vision

import torch
X1 = torch.randn(32, 3, 64, 64)
X2 = torch.randn(32, 3, 64, 64)
lambda_ = 0.4
X_mix = lambda_ * X1 + (1 - lambda_) * X2
print(X_mix.shape)

A (32, 3)

B (64, 3, 64, 64)

C (32, 6, 64, 64)

D (32, 3, 64, 64)

💡 Hint

MixUp combines images element-wise without changing batch size or channels.

MixUp linearly combines two batches of the same shape, so the output shape remains the same as the input batches.

❓ Hyperparameter

advanced

Which hyperparameter controls the strength of mixing in MixUp?

In MixUp, a Beta distribution parameter alpha is used to sample the mixing coefficient lambda. What effect does increasing alpha have?

A Increasing <code>alpha</code> makes <code>lambda</code> values closer to 0 or 1, resulting in weaker mixing.

B Increasing <code>alpha</code> makes <code>lambda</code> values closer to 0.5, resulting in stronger mixing of samples.

C Increasing <code>alpha</code> reduces the batch size during training.

D Increasing <code>alpha</code> changes the learning rate dynamically.

💡 Hint

Recall properties of Beta distribution with parameters > 1.

Higher alpha values in Beta distribution concentrate lambda around 0.5, causing samples to mix more evenly.

❓ Metrics

advanced

How does MixUp affect the training loss curve compared to standard training?

When training a neural network with MixUp, how does the training loss curve typically behave compared to training without MixUp?

A The training loss decreases more slowly and is generally higher during training, but test accuracy improves.

B The training loss decreases faster and reaches a lower final value than standard training.

C The training loss oscillates wildly and never stabilizes.

D The training loss is identical to standard training since MixUp only affects test data.

💡 Hint

Think about how MixUp creates harder training examples.

MixUp creates blended samples that are harder to fit exactly, so training loss is higher and decreases slower, but this leads to better generalization and test accuracy.

🔧 Debug

expert

Why does this MixUp implementation cause a runtime error?

Consider this PyTorch MixUp code snippet:

def mixup_data(x, y, alpha=1.0):
    if alpha > 0:
        lam = np.random.beta(alpha, alpha)
    else:
        lam = 1
    batch_size = x.size()[0]
    index = torch.randperm(batch_size)
    mixed_x = lam * x + (1 - lam) * x[index, :]
    mixed_y = lam * y + (1 - lam) * y[index]
    return mixed_x, mixed_y

x = torch.randn(16, 3, 32, 32)
y = torch.randint(0, 10, (16,))
mixed_x, mixed_y = mixup_data(x, y, alpha=0.4)

What causes the runtime error?

A Trying to multiply integer labels <code>y</code> by float mixing coefficients causes a TypeError.

B The <code>index</code> tensor is not on the same device as <code>x</code> causing a device mismatch error.

C The Beta distribution sampling uses numpy but <code>lam</code> is not converted to a tensor before use.

D The batch size is incorrectly computed causing an index out of range error.

💡 Hint

Check the data types of y and how they interact with float multiplication.

Labels y are integer tensors. Multiplying them by floats causes a TypeError. They must be converted to float before mixing.