ReAct pattern in Prompt Engineering / GenAI - Model Pipeline Trace

Model Pipeline - ReAct pattern

The ReAct pattern helps AI models think and act step-by-step. It combines reasoning and actions to solve problems better.

Data Flow - 4 Stages

1Input Question

1 question string→Receive user question→1 question string

"What is the capital of France?"

↓

2Reasoning Step

1 question string→Model thinks internally about the question→1 reasoning string

"The capital of France is a famous city known for the Eiffel Tower."

↓

3Action Step

1 reasoning string→Model performs an action like searching or recalling knowledge→1 action result string

"Retrieved: Paris is the capital of France."

↓

4Answer Generation

1 action result string→Model combines reasoning and action to produce final answer→1 answer string

"The capital of France is Paris."

Training Trace - Epoch by Epoch

Loss
0.9 | *
0.8 | **
0.7 | ***
0.6 | ****
0.5 | *****
0.4 | ******
0.3 | *******
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.85	0.45	Model starts learning to combine reasoning and actions.
2	0.65	0.60	Loss decreases as model improves reasoning steps.
3	0.50	0.72	Model better integrates actions with reasoning.
4	0.38	0.82	Clear improvement in answer accuracy.
5	0.30	0.88	Model converges with strong reasoning-action balance.

Prediction Trace - 4 Layers

Layer 1: Input Question

Layer 2: Reasoning Step

Layer 3: Action Step

Layer 4: Answer Generation

Model Quiz - 3 Questions

What does the 'Action Step' in the ReAct pattern do?

A Receives the user question

B Performs a task like searching or recalling information

C Generates the final answer directly

D Evaluates model accuracy

Key Insight

The ReAct pattern improves AI by making it think step-by-step and act based on reasoning. This leads to better answers and more reliable problem solving.

Practice

1. What is the main purpose of the ReAct pattern in AI?

easy

A. To speed up AI training by skipping reasoning

B. To combine thinking and acting steps for better problem solving

C. To store large datasets efficiently

D. To replace human decision making completely

Solution

1. Step 1: Understand the ReAct pattern concept

   The ReAct pattern mixes reasoning (thinking) and actions (doing) to solve problems step-by-step.

2. Step 2: Identify the main goal

   This approach helps AI be more transparent and effective by breaking down tasks into Thought, Action, Observation, and Final Answer.

3. Final Answer:

   To combine thinking and acting steps for better problem solving -> Option B

4. Quick Check:

   ReAct = Reason + Act [OK]

Hint: Remember ReAct means think then do, step-by-step [OK]

Common Mistakes:

• Thinking AI skips actions
• ReAct stores data only
• ReAct replaces humans fully

2. Which of the following shows the correct sequence in the ReAct pattern?

easy

A. Thought -> Action -> Observation -> Final Answer

B. Action -> Thought -> Final Answer -> Observation

C. Observation -> Final Answer -> Thought -> Action

D. Final Answer -> Thought -> Action -> Observation

Solution

1. Step 1: Recall the ReAct step order

   The ReAct pattern follows a clear order: first the AI thinks (Thought), then acts (Action), then sees results (Observation), and finally gives the answer.

2. Step 2: Match the correct sequence

   Thought -> Action -> Observation -> Final Answer correctly lists this order as Thought -> Action -> Observation -> Final Answer.

3. Final Answer:

   Thought -> Action -> Observation -> Final Answer -> Option A

4. Quick Check:

   Order = T -> A -> O -> FA [OK]

Hint: Think first, then act, observe, answer [OK]

Common Mistakes:

• Mixing up Observation and Action order
• Putting Final Answer before Observation
• Skipping Thought step

3. Given this simplified ReAct code snippet:

thought = 'Check weather'
action = 'Query weather API'
observation = 'It is sunny'
final_answer = f"Weather is {observation}"
print(final_answer)

What will be the printed output?

medium

A. Check weather

B. It is sunny

C. Query weather API

D. Weather is It is sunny

Solution

1. Step 1: Understand variable assignments

   The variable observation holds the string 'It is sunny'. The final_answer uses this to create 'Weather is It is sunny'.

2. Step 2: Evaluate the print statement

   The print outputs the final_answer string, which is 'Weather is It is sunny' because the f-string inserts the full observation string.

3. Final Answer:

   Weather is It is sunny -> Option D

4. Quick Check:

   Output includes 'Weather is' + observation [OK]

Hint: Look at final_answer string formatting carefully [OK]

Common Mistakes:

• Ignoring f-string variable insertion
• Printing wrong variable
• Confusing observation with action

4. Identify the error in this ReAct step code:

thought = 'Calculate sum'
action = 'Add 2 and 3'
observation = 2 + 3
final_answer = 'Sum is ' + observation
print(final_answer)

medium

A. Cannot concatenate string and integer directly

B. Missing action execution step

C. Observation should be a string, not a number

D. Final answer should be a number, not string

Solution

1. Step 1: Analyze the final_answer concatenation

   The code tries to add a string 'Sum is ' and an integer observation (5) directly, which causes a TypeError in Python.

2. Step 2: Identify the fix

   To fix, convert observation to string using str(observation) before concatenation.

3. Final Answer:

   Cannot concatenate string and integer directly -> Option A

4. Quick Check:

   String + int causes error [OK]

Hint: Convert numbers to strings before adding to text [OK]

Common Mistakes:

• Ignoring type mismatch in concatenation
• Thinking observation must be string always
• Confusing action with observation

5. You want to build a ReAct-based AI assistant that solves math problems step-by-step. Which approach best applies the ReAct pattern?

hard

A. AI randomly guesses answers and checks correctness later

B. AI immediately gives the answer without intermediate steps

C. AI thinks about the problem, performs a calculation action, observes the result, then states the final answer

D. AI stores all previous answers without reasoning

Solution

1. Step 1: Understand ReAct for stepwise problem solving

   The ReAct pattern requires the AI to think (reason), act (calculate), observe (check result), and then answer.

2. Step 2: Match the approach to ReAct steps

   AI thinks about the problem, performs a calculation action, observes the result, then states the final answer describes this exact process, making the AI transparent and effective in solving math problems step-by-step.

3. Final Answer:

   AI thinks about the problem, performs a calculation action, observes the result, then states the final answer -> Option C

4. Quick Check:

   ReAct = Thought + Action + Observation + Answer [OK]

Hint: Follow Thought -> Action -> Observation -> Answer for stepwise AI [OK]

Common Mistakes:

• Skipping reasoning steps
• Guessing without observation
• Ignoring stepwise transparency