When to use which reasoning pattern in Agentic AI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Choosing the right reasoning pattern for a step-by-step problem

You want an AI agent to solve a complex math problem by breaking it down into smaller steps. Which reasoning pattern should you choose?

A Chain of Thought reasoning, because it guides the agent to think step-by-step.

B ReAct reasoning, because it combines reasoning with actions like searching the web.

C Self-Consistency, because it samples multiple answers and picks the most common one.

D Tree of Thought, because it explores multiple reasoning paths in parallel.

💡 Hint

Think about which pattern helps the agent explain each step clearly.

Chain of Thought reasoning is best for step-by-step explanations. It helps the agent break down complex problems into smaller, understandable steps.

❓ Model Choice

intermediate

Best reasoning pattern for combining reasoning and external actions

You want an AI agent that can both think through a problem and perform actions like searching the internet or calling APIs. Which reasoning pattern fits best?

A Self-Consistency, which samples multiple reasoning paths internally.

B Chain of Thought reasoning, focusing only on internal reasoning steps.

C ReAct reasoning, which interleaves reasoning and actions.

D Tree of Thought, which explores multiple reasoning paths but does not perform actions.

💡 Hint

Look for the pattern that mixes thinking and doing.

ReAct reasoning allows the agent to alternate between reasoning and taking external actions, making it suitable for tasks requiring interaction with the environment.

❓ Metrics

advanced

Evaluating Self-Consistency reasoning effectiveness

You run Self-Consistency reasoning by sampling multiple answers from an AI model and selecting the most frequent answer. Which metric best measures if this approach improved answer reliability?

A Accuracy, because it shows how often the final answer matches the true answer.

B Loss, because it measures the model's prediction error during training.

C F1 Score, because it balances precision and recall for classification.

D Perplexity, because it measures how surprised the model is by the data.

💡 Hint

Think about which metric directly shows correctness of final answers.

Accuracy measures how often the chosen answer matches the correct one, making it the best metric to evaluate Self-Consistency reasoning effectiveness.

🔧 Debug

advanced

Why does Tree of Thought reasoning take longer to run?

You implemented Tree of Thought reasoning but notice it takes much longer than Chain of Thought. What is the main reason?

A Tree of Thought uses fewer reasoning steps, so it is slower per step.

B Tree of Thought explores multiple reasoning paths in parallel, increasing computation time.

C Tree of Thought skips important steps, causing delays.

D Tree of Thought only samples one answer, so it is slower to converge.

💡 Hint

Consider how exploring many options affects speed.

Tree of Thought explores many possible reasoning paths simultaneously, which requires more computation and thus takes longer.

🧠 Conceptual

expert

Selecting reasoning pattern for uncertain or ambiguous problems

You face a problem where the AI model's answers vary widely and uncertainty is high. Which reasoning pattern helps improve answer reliability by considering multiple diverse reasoning paths?

A Chain of Thought, because it focuses on a single reasoning path step-by-step.

B ReAct, because it mixes reasoning with external actions.

C Self-Consistency, because it samples multiple answers and picks the most frequent one.

D Tree of Thought, because it explores multiple reasoning paths and selects the best.

💡 Hint

Think about which pattern explores many paths to find the best answer.

Tree of Thought explores multiple reasoning paths in parallel and selects the best, helping reduce uncertainty and improve reliability in ambiguous problems.

Practice

1. Which reasoning pattern is best when you want a clear, step-by-step explanation from an AI?

easy

A. Step-by-step reasoning

B. Direct reasoning

C. Probabilistic reasoning

D. Hybrid reasoning

Solution

1. Step 1: Understand the purpose of step-by-step reasoning

   Step-by-step reasoning breaks down problems into clear, ordered steps for easy understanding.

2. Step 2: Match the pattern to the task

   When you want clear explanations, step-by-step is the best fit because it shows each part of the process.

3. Final Answer:

   Step-by-step reasoning -> Option A

4. Quick Check:

   Clear explanation = Step-by-step reasoning [OK]

Hint: Choose step-by-step for clear, detailed explanations [OK]

Common Mistakes:

• Confusing direct reasoning with step-by-step
• Using probabilistic reasoning for simple tasks
• Thinking hybrid reasoning is always best

2. Which of the following is the correct syntax to describe direct reasoning in AI?

easy

A. AI solves problem by breaking into steps

B. AI guesses answer based on chance

C. AI gives answer immediately without steps

D. AI mixes step-by-step and guessing

Solution

1. Step 1: Understand direct reasoning meaning

   Direct reasoning means AI gives an answer immediately without showing steps.

2. Step 2: Match syntax to meaning

   AI gives answer immediately without steps correctly describes direct reasoning as giving an answer immediately without steps.

3. Final Answer:

   AI gives answer immediately without steps -> Option C

4. Quick Check:

   Direct reasoning = immediate answer [OK]

Hint: Direct reasoning means no steps, just answer [OK]

Common Mistakes:

• Mixing step-by-step with direct reasoning
• Thinking direct reasoning involves guessing
• Confusing hybrid reasoning with direct

3. Given this code snippet simulating reasoning patterns, what will be the output?

def reasoning(pattern):
    if pattern == 'direct':
        return 'Answer immediately'
    elif pattern == 'step':
        return 'Explain step 1, then step 2'
    elif pattern == 'probabilistic':
        return 'Guess with chance'
    else:
        return 'Unknown pattern'

print(reasoning('step'))

medium

A. Answer immediately

B. Explain step 1, then step 2

C. Guess with chance

D. Unknown pattern

Solution

1. Step 1: Check the input to the function

   The function is called with 'step' as the pattern argument.

2. Step 2: Follow the if-elif conditions

   When pattern is 'step', the function returns 'Explain step 1, then step 2'.

3. Final Answer:

   Explain step 1, then step 2 -> Option B

4. Quick Check:

   Input 'step' returns explanation steps [OK]

Hint: Match input string to if-elif return value [OK]

Common Mistakes:

• Choosing output for 'direct' instead of 'step'
• Ignoring else case
• Misreading the function logic

4. This code is meant to select a reasoning pattern based on problem complexity. What is the bug?

def select_pattern(complexity):
    if complexity > 5:
        return 'step-by-step'
    elif complexity > 10:
        return 'probabilistic'
    else:
        return 'direct'

print(select_pattern(12))

medium

A. Print statement syntax is incorrect

B. Missing return statement in else block

C. Function does not handle complexity less than 0

D. The order of conditions is wrong; higher complexity checked second

Solution

1. Step 1: Analyze the if-elif conditions order

   The first condition checks if complexity > 5, which is true for 12, so it returns immediately.

2. Step 2: Identify the logic error

   The second condition (complexity > 10) is never reached because the first condition is broader and comes first.

3. Final Answer:

   The order of conditions is wrong; higher complexity checked second -> Option D

4. Quick Check:

   Check condition order for correct logic [OK]

Hint: Check if conditions from most specific to general [OK]

Common Mistakes:

• Ignoring condition order importance
• Assuming else block missing return causes error
• Thinking print syntax is wrong

5. You have a complex problem with uncertain data and need the AI to both guess and explain some steps. Which reasoning pattern should you choose?

hard

A. Hybrid reasoning

B. Step-by-step reasoning

C. Direct reasoning

D. Probabilistic reasoning

Solution

1. Step 1: Understand problem needs

   The problem is complex with uncertain data and requires both guessing and explanation.

2. Step 2: Match reasoning pattern to needs

   Hybrid reasoning combines step-by-step explanation and probabilistic guessing, fitting the problem best.

3. Final Answer:

   Hybrid reasoning -> Option A

4. Quick Check:

   Complex + uncertain + explanation = Hybrid reasoning [OK]

Hint: Use hybrid for complex, uncertain, and explanatory tasks [OK]

Common Mistakes:

• Choosing only probabilistic reasoning for explanation
• Picking direct reasoning for complex problems
• Ignoring hybrid as a combined approach