Reflection and self-critique pattern in Agentic AI - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the Reflection and self-critique pattern in AI?

It is a method where an AI system reviews its own outputs and decisions to identify mistakes or areas for improvement, helping it learn and improve over time.

beginner

Why is self-critique important for AI agents?

Self-critique helps AI agents detect errors early, adapt to new situations, and improve their performance without needing constant human intervention.

intermediate

How does reflection help in machine learning models?

Reflection allows models to analyze their predictions and training results, understand where they went wrong, and adjust their strategies or parameters accordingly.

beginner

Give an example of a simple self-critique step in an AI workflow.

After making a prediction, the AI compares it to the actual result, calculates the error, and uses this error to update its model to reduce future mistakes.

advanced

What challenges can arise when implementing reflection and self-critique in AI?

Challenges include ensuring the AI correctly identifies true errors versus noise, avoiding overfitting to past mistakes, and balancing self-critique with exploration of new strategies.

What is the main goal of the reflection and self-critique pattern in AI?

A To store more data

B To make AI run faster

C To help AI improve by reviewing its own outputs

D To avoid any changes in AI behavior

Reflection and self-critique help AI learn from its own mistakes and improve performance.

Which of the following is a key step in self-critique?

A Comparing predictions to actual results

B Ignoring errors

C Randomly changing model parameters

D Deleting training data

Self-critique involves comparing predictions to actual outcomes to find errors.

Why might an AI avoid overfitting during self-critique?

A To keep learning general patterns, not just past mistakes

B To memorize all training data exactly

C To stop learning completely

D To increase model size

Avoiding overfitting helps AI generalize well to new data, not just past errors.

What does reflection in AI usually involve?

A Adding random noise to data

B Ignoring feedback

C Deleting model weights

D Analyzing past decisions and outcomes

Reflection means looking back at decisions and results to learn and improve.

Which is NOT a benefit of self-critique in AI?

A Improved accuracy

B Guaranteed perfect predictions

C Reduced human supervision

D Faster adaptation

Self-critique helps improve but does not guarantee perfect predictions.

Explain how the reflection and self-critique pattern helps an AI system improve its performance.

Think about how looking back at your own work helps you do better next time.

Describe some challenges that might occur when an AI tries to self-critique and reflect.

Consider what might confuse the AI or make it learn the wrong lessons.

Practice

1. What is the main purpose of the Reflection and self-critique pattern in AI?

easy

A. To store large amounts of data

B. To speed up AI computations

C. To help AI review and improve its own answers

D. To create new AI models automatically

Solution

1. Step 1: Understand the pattern's goal

   The reflection and self-critique pattern is designed to let AI look back at its answers and find mistakes.

2. Step 2: Identify the main benefit

   By reviewing its own work, AI can fix errors and improve future responses.

3. Final Answer:

   To help AI review and improve its own answers -> Option C

4. Quick Check:

   Reflection and self-critique = improve answers [OK]

Hint: Focus on improvement through self-review [OK]

Common Mistakes:

• Confusing speed with accuracy
• Thinking it stores data
• Assuming it creates new models

2. Which of the following is the correct way to describe the reflection step in the pattern?

easy

A. AI reviews its previous answers to find mistakes

B. AI ignores previous answers and generates new ones

C. AI deletes all previous data to start fresh

D. AI copies answers from other models without checking

Solution

1. Step 1: Define reflection in AI context

   Reflection means looking back at past answers to check for errors or improvements.

2. Step 2: Match options to definition

   Only AI reviews its previous answers to find mistakes correctly states that AI reviews previous answers to find mistakes.

3. Final Answer:

   AI reviews its previous answers to find mistakes -> Option A

4. Quick Check:

   Reflection = review past answers [OK]

Hint: Reflection means reviewing past work carefully [OK]

Common Mistakes:

• Thinking reflection means ignoring past answers
• Confusing reflection with deleting data
• Assuming copying answers is reflection

3. Consider this simple AI pseudo-code using reflection and self-critique:

answer = AI.generate_answer(question)
errors = AI.reflect(answer)
if errors:
    answer = AI.fix_errors(answer, errors)
print(answer)

What will print(answer) show if the AI finds errors?

medium

A. The original answer without changes

B. The corrected answer after fixing errors

C. No output because the program stops

D. An error message instead of an answer

Solution

1. Step 1: Understand the code flow

   The AI first generates an answer, then reflects to find errors. If errors exist, it fixes them.

2. Step 2: Determine the final printed output

   Since errors are fixed before printing, the output is the corrected answer.

3. Final Answer:

   The corrected answer after fixing errors -> Option B

4. Quick Check:

   Errors fixed before print = corrected answer [OK]

Hint: Errors fixed before print means corrected output [OK]

Common Mistakes:

• Assuming original answer prints despite errors
• Thinking program stops on errors
• Confusing error message with fixed answer

4. You have this AI code snippet:

answer = AI.generate_answer(question)
errors = AI.reflect(answer)
if errors:
    AI.fix_errors(answer, errors)
print(answer)

Why might this code fail to print the corrected answer?

medium

A. Because fix_errors does not update answer variable

B. Because reflect never finds errors

C. Because print is called before generating answer

D. Because answer is not defined

Solution

1. Step 1: Analyze variable updates

   The fix_errors function is called but its result is not assigned back to answer.

2. Step 2: Understand impact on output

   Since answer is unchanged, print shows the original, not corrected, answer.

3. Final Answer:

   Because fix_errors does not update answer variable -> Option A

4. Quick Check:

   Fix must assign back to answer [OK]

Hint: Assign fixed answer back to variable before printing [OK]

Common Mistakes:

• Assuming reflect never finds errors
• Thinking print is called too early
• Ignoring variable assignment after fixing

5. You want to improve an AI assistant using the reflection and self-critique pattern. Which approach best applies this pattern to reduce repeated mistakes over time?

hard

A. AI copies answers from a fixed database without checking

B. AI generates answers randomly to explore new possibilities

C. AI deletes old answers to save memory without review

D. After each answer, AI reviews its response, identifies errors, fixes them, and updates its knowledge base

Solution

1. Step 1: Identify key steps in the pattern

   The pattern involves reviewing answers, finding errors, fixing them, and learning from mistakes.

2. Step 2: Match approach to pattern goals

   After each answer, AI reviews its response, identifies errors, fixes them, and updates its knowledge base describes reviewing, fixing, and updating knowledge, which fits the pattern perfectly.

3. Final Answer:

   After each answer, AI reviews its response, identifies errors, fixes them, and updates its knowledge base -> Option D

4. Quick Check:

   Review + fix + learn = improved AI [OK]

Hint: Choose option with review, fix, and learning steps [OK]

Common Mistakes:

• Ignoring learning from errors
• Choosing random or fixed answers
• Skipping error identification