Progress tracking and reporting in Agentic AI - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is progress tracking in machine learning?

Progress tracking is the process of monitoring how a machine learning model improves during training by recording metrics like loss and accuracy over time.

beginner

Why is reporting important in machine learning projects?

Reporting helps communicate the model's performance and training progress clearly to stakeholders, enabling informed decisions and improvements.

beginner

Name two common metrics used for progress tracking in classification tasks.

Accuracy and loss are two common metrics used to track progress in classification models.

intermediate

How can visualizing training progress help during model development?

Visualizing training progress, like plotting loss and accuracy graphs, helps spot issues such as overfitting or underfitting early and guides adjustments.

intermediate

What is a common tool or method to automate progress reporting?

Using dashboards or logging tools like TensorBoard automates progress reporting by showing real-time training metrics and graphs.

Which metric shows how often a model predicts correctly?

A Loss

B Accuracy

C Precision

D Recall

Accuracy measures the percentage of correct predictions out of all predictions.

What does a decreasing loss during training usually indicate?

A Model is learning and improving

B Model is overfitting

C Model is underfitting

D Model is not changing

A decreasing loss means the model's predictions are getting closer to the true values.

Which tool is commonly used to visualize training progress?

A PowerPoint

B Excel

C TensorBoard

D Notepad

TensorBoard is designed to visualize metrics like loss and accuracy during training.

Why is it important to report model progress to stakeholders?

A To hide poor performance

B To confuse them with technical details

C To delay the project

D To keep them informed and guide decisions

Clear reporting helps stakeholders understand progress and decide next steps.

Which of these is NOT a typical progress tracking metric?

A Model color

B Accuracy

C Training time

D Loss

Model color is unrelated to tracking progress.

Explain how progress tracking helps improve a machine learning model during training.

Think about how watching numbers change helps you fix problems.

Describe why clear reporting of training progress is important for a team working on a machine learning project.

Imagine explaining progress to someone who is not technical.

Practice

1. What is the main purpose of progress tracking during machine learning model training?

easy

A. To record how the model improves over time

B. To increase the size of the training data

C. To change the model architecture automatically

D. To speed up the training hardware

Solution

1. Step 1: Understand progress tracking

   Progress tracking means keeping a record of how well the model is learning as it trains.

2. Step 2: Identify the main goal

   The goal is to see improvements over time, not to change data size or hardware.

3. Final Answer:

   To record how the model improves over time -> Option A

4. Quick Check:

   Progress tracking = record improvement [OK]

Hint: Progress tracking = recording learning progress [OK]

Common Mistakes:

• Confusing progress tracking with data augmentation
• Thinking it changes model structure automatically
• Assuming it speeds up hardware

2. Which of the following is the correct way to log training loss after each epoch in Python?

easy

A. print('Loss:', loss)

B. log('Loss:' + loss)

C. print('Loss:' loss)

D. echo 'Loss:' loss

Solution

1. Step 1: Check Python print syntax

   In Python, print() requires arguments separated by commas or concatenated as strings.

2. Step 2: Validate each option

   print('Loss:', loss) uses print with a comma, which is correct. log('Loss:' + loss) uses undefined log function. print('Loss:' loss) misses a comma. echo 'Loss:' loss uses echo, which is not Python.

3. Final Answer:

   print('Loss:', loss) -> Option A

4. Quick Check:

   Correct print syntax = print('Loss:', loss) [OK]

Hint: Use print() with commas to separate text and variables [OK]

Common Mistakes:

• Missing commas in print statements
• Using non-Python functions like echo or log
• Concatenating strings without conversion

3. Given the code below, what will be printed after training for 3 epochs?

losses = []
for epoch in range(3):
    loss = 1 / (epoch + 1)
    losses.append(loss)
    print(f'Epoch {epoch+1}, Loss: {loss:.2f}')
print('Final losses:', losses)

medium

A. Epoch 1, Loss: 1.00
Epoch 2, Loss: 0.50
Epoch 3, Loss: 0.33
Final losses: [1, 2, 3]

B. Epoch 1, Loss: 0.00
Epoch 2, Loss: 0.50
Epoch 3, Loss: 0.33
Final losses: [0, 0.5, 0.3333333333333333]

C. Epoch 1, Loss: 1.00
Epoch 2, Loss: 0.50
Epoch 3, Loss: 0.33
Final losses: [1.0, 0.5, 0.3333333333333333]

D. Epoch 1, Loss: 1.00
Epoch 2, Loss: 0.50
Epoch 3, Loss: 0.33
Final losses: [1, 0.5, 0.33]

Solution

1. Step 1: Calculate loss values for each epoch

   Epoch 1: 1/(1) = 1.0, Epoch 2: 1/(2) = 0.5, Epoch 3: 1/(3) ≈ 0.3333

2. Step 2: Check printed output and final list

   Print shows formatted loss with 2 decimals. Final losses list stores full float values.

3. Final Answer:

   Epoch 1, Loss: 1.00 Epoch 2, Loss: 0.50 Epoch 3, Loss: 0.33 Final losses: [1.0, 0.5, 0.3333333333333333] -> Option C

4. Quick Check:

   Loss calculation and print formatting = Epoch 1, Loss: 1.00 Epoch 2, Loss: 0.50 Epoch 3, Loss: 0.33 Final losses: [1.0, 0.5, 0.3333333333333333] [OK]

Hint: Calculate loss per epoch and check print formatting carefully [OK]

Common Mistakes:

• Confusing integer division with float division
• Rounding losses in the list incorrectly
• Misreading the range function output

4. The following code is meant to track accuracy after each training epoch, but it throws an error. What is the error?

accuracies = []
for epoch in range(5):
    accuracy = 0.8 + epoch * 0.03
    accuracies.append(accuracy)
print('Accuracies:', accuracies)

medium

A. SyntaxError due to missing colon in for loop

B. No error; code runs correctly

C. TypeError because accuracy is not a number

D. IndexError from accessing out-of-range list element

Solution

1. Step 1: Review the code syntax and logic

   The for loop has a colon, accuracy is calculated as a float, and appended to the list.

2. Step 2: Check for runtime errors

   No invalid operations or out-of-range accesses occur.

3. Final Answer:

   No error; code runs correctly -> Option B

4. Quick Check:

   Code syntax and logic correct = No error; code runs correctly [OK]

Hint: Check for syntax and type errors carefully [OK]

Common Mistakes:

• Assuming missing colon when it is present
• Confusing variable types
• Expecting index errors without list access

5. You want to create a report that shows both training loss and accuracy after each epoch in a clear table format. Which approach best helps you track and report this progress effectively?

hard

A. Store losses and accuracies in separate lists and print them after training

B. Print loss and accuracy inside the training loop without storing values

C. Only track loss since accuracy is less important

D. Use a dictionary to store epoch as key and a tuple of (loss, accuracy) as value, then print a formatted table after training

Solution

1. Step 1: Understand the need for clear reporting

   Clear reports require organized data storage and formatted output.

2. Step 2: Evaluate each option

   Store losses and accuracies in separate lists and print them after training stores separately but may be harder to align epochs. Print loss and accuracy inside the training loop without storing values prints without storing, losing history. Use a dictionary to store epoch as key and a tuple of (loss, accuracy) as value, then print a formatted table after training uses a dictionary to link epochs with both metrics, enabling clear table printing. Only track loss since accuracy is less important ignores accuracy, which is important.

3. Final Answer:

   Use a dictionary to store epoch as key and a tuple of (loss, accuracy) as value, then print a formatted table after training -> Option D

4. Quick Check:

   Organized storage + formatted report = Use a dictionary to store epoch as key and a tuple of (loss, accuracy) as value, then print a formatted table after training [OK]

Hint: Use dictionary with epoch keys for clear progress reports [OK]

Common Mistakes:

• Not storing metrics together per epoch
• Printing inside loop without history
• Ignoring accuracy tracking