Diffusion model concept in Prompt Engineering / GenAI - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to add noise to the data in a diffusion model step.

Prompt Engineering / GenAI

noisy_data = data + [1] * noise

Drag options to blanks, or click blank then click option'

A0.1

B1.0

C0.5

D2.0

Attempts:

3 left

💡 Hint

Common Mistakes

Using noise scale too small like 0.1 which barely changes data

Using noise scale too large like 2.0 which overwhelms data

In diffusion models, noise is added gradually. A common noise scale is 0.5 for a moderate noise level.

2fill in blank

medium

Complete the code to reverse the diffusion process by denoising the noisy data.

Prompt Engineering / GenAI

denoised_data = model.predict([1])

Drag options to blanks, or click blank then click option'

Alabels

Bdata

Cnoise

Dnoisy_data

Attempts:

3 left

💡 Hint

Common Mistakes

Passing original data instead of noisy data

Passing noise directly to the model

The model predicts the clean data from the noisy input, so it takes noisy_data as input.

3fill in blank

hard

Fix the error in the training loss calculation for the diffusion model.

Prompt Engineering / GenAI

loss = loss_fn([1], predicted_noise)

Drag options to blanks, or click blank then click option'

Anoise

Bdenoised_data

Cnoisy_data

Ddata

Attempts:

3 left

💡 Hint

Common Mistakes

Using original data instead of noise in loss

Using noisy data instead of noise in loss

The loss compares the predicted noise to the actual noise added, so the first argument is noise.

4fill in blank

hard

Fill both blanks to create a dictionary comprehension that maps each step to its noise level if the noise level is less than 0.5.

Prompt Engineering / GenAI

noise_levels = {step: [1] for step, noise in steps.items() if noise [2] 0.5}

Drag options to blanks, or click blank then click option'

Anoise

B>

C<

Dstep

Attempts:

3 left

💡 Hint

Common Mistakes

Using step as value instead of noise

Using > instead of < in condition

The dictionary maps step to noise only if noise is less than 0.5, so we use noise and <.

5fill in blank

hard

Fill all three blanks to create a dictionary comprehension that maps each step's name in uppercase to its noise value if noise is greater than 0.3.

Prompt Engineering / GenAI

filtered_noise = { [1]: [2] for step, [3] in steps.items() if noise > 0.3 }

Drag options to blanks, or click blank then click option'

Astep.upper()

Bnoise

Dstep

Attempts:

3 left

💡 Hint

Common Mistakes

Using step instead of step.upper() as key

Using step instead of noise as value

Swapping variable names in the loop

The key is step.upper(), the value is noise, and the loop unpacks step and noise.

Practice

1. What is the main idea behind a diffusion model in AI?

easy

A. It sorts data into categories using labels.

B. It directly copies existing data without changes.

C. It creates data by gradually removing noise from random input.

D. It compresses data to save space.

Solution

1. Step 1: Understand diffusion model purpose

   Diffusion models generate new data by starting with noise and removing it step-by-step.

2. Step 2: Compare options to this idea

   Only It creates data by gradually removing noise from random input. describes this gradual noise removal process correctly.

3. Final Answer:

   It creates data by gradually removing noise from random input. -> Option C

4. Quick Check:

   Diffusion model = gradual noise removal [OK]

Hint: Diffusion means removing noise slowly to create data [OK]

Common Mistakes:

• Thinking diffusion copies data exactly
• Confusing diffusion with classification
• Believing diffusion compresses data

2. Which of the following best describes the training step of a diffusion model?

easy

A. Adding noise to data and training the model to remove it.

B. Removing noise from data and training the model to add it.

C. Training the model to classify noisy images.

D. Training the model to compress data efficiently.

Solution

1. Step 1: Recall diffusion model training

   Diffusion models learn by adding noise to clean data and training to reverse this process.

2. Step 2: Match options to training process

   Adding noise to data and training the model to remove it. correctly states adding noise then learning to remove it.

3. Final Answer:

   Adding noise to data and training the model to remove it. -> Option A

4. Quick Check:

   Training = add noise, learn to clean [OK]

Hint: Training adds noise, model learns to clean it [OK]

Common Mistakes:

• Confusing noise addition and removal steps
• Thinking model trains to add noise
• Mixing training with classification tasks

3. Consider this simplified pseudocode for a diffusion model step:

noise_level = 0.5
noisy_data = original_data + noise_level * random_noise
cleaned_data = model.predict(noisy_data)

What does cleaned_data represent here?

medium

A. The model's guess of the data with noise removed.

B. The noisy data after adding random noise.

C. The original data before noise was added.

D. Random noise generated by the model.

Solution

1. Step 1: Analyze code variables

   noisy_data is original data plus noise; cleaned_data is model output from noisy input.

2. Step 2: Understand model role

   The model tries to remove noise, so cleaned_data is the model's cleaned guess.

3. Final Answer:

   The model's guess of the data with noise removed. -> Option A

4. Quick Check:

   cleaned_data = model's denoised output [OK]

Hint: Model output after noise removal is cleaned data [OK]

Common Mistakes:

• Confusing noisy_data with cleaned_data
• Thinking cleaned_data is original data
• Assuming cleaned_data is noise

4. A diffusion model training code snippet has this error:

for step in range(1, 11):
    noisy = add_noise(data, step)
    loss = model.train(noisy, data)
    print('Loss:', loss)

The loss does not decrease as expected. What is the likely mistake?

medium

A. The loop range should start at 0, not 1.

B. Loss printing should be outside the loop.

C. The model should train on noisy data only, not original data.

D. Noise is added with increasing step, but the model expects decreasing noise.

Solution

1. Step 1: Understand noise schedule in diffusion

   Diffusion models add noise in training but expect noise level to decrease during denoising steps.

2. Step 2: Identify mismatch in noise and training

   Increasing noise each step conflicts with model learning to remove noise progressively.

3. Final Answer:

   Noise is added with increasing step, but the model expects decreasing noise. -> Option D

4. Quick Check:

   Noise schedule must match model expectation [OK]

Hint: Noise should decrease during denoising, not increase [OK]

Common Mistakes:

• Ignoring noise schedule direction
• Changing loop range without reason
• Misplacing loss print statement

5. You want to generate a clear image from random noise using a diffusion model. Which sequence of steps correctly describes this process?

hard

A. Start with noise, add more noise, then output noisy image.

B. Start with noise, apply model repeatedly to remove noise, get clear image.

C. Start with clear image, add noise repeatedly, then output noisy image.

D. Start with clear image, apply model to add noise, get noisy image.

Solution

1. Step 1: Recall diffusion model generation

   Generation starts from random noise and removes noise step-by-step to create clear data.

2. Step 2: Match options to generation steps

   Only Start with noise, apply model repeatedly to remove noise, get clear image. describes starting with noise and removing it repeatedly to get a clear image.

3. Final Answer:

   Start with noise, apply model repeatedly to remove noise, get clear image. -> Option B

4. Quick Check:

   Generation = noise to clear image [OK]

Hint: Generate by removing noise stepwise from random input [OK]

Common Mistakes:

• Thinking generation adds noise instead of removing
• Confusing training noise addition with generation
• Starting generation from clear image