Agent architecture (observe, think, act) in Prompt Engineering / GenAI - Model Pipeline Trace

Model Pipeline - Agent architecture (observe, think, act)

This agent architecture shows how an AI system works by observing its environment, thinking about what it sees, and then acting based on that thinking. It repeats this cycle to learn and improve.

Data Flow - 3 Stages

1Observe

1 environment state snapshot→Agent senses or receives data from environment→1 observation vector

Image pixels or sensor readings like temperature and position

↓

2Think

1 observation vector→Agent processes observation to decide next action→1 action decision vector

Neural network outputs probabilities for possible moves

↓

3Act

1 action decision vector→Agent performs action in environment→Environment changes state

Robot moves forward or AI clicks a button

Training Trace - Epoch by Epoch

Loss
1.0 |****
0.8 |*** 
0.6 |**  
0.4 |*   
0.2 |*   
0.0 +----
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.85	0.40	Agent starts learning, loss is high, accuracy low
2	0.65	0.55	Agent improves by better thinking and acting
3	0.45	0.70	Agent learns to act more correctly
4	0.30	0.85	Agent's decisions become more accurate
5	0.20	0.92	Agent converges to good performance

Prediction Trace - 3 Layers

Layer 1: Observe

Layer 2: Think

Layer 3: Act

Model Quiz - 3 Questions

What is the first step the agent takes in this architecture?

A Observe the environment

B Think about the action

C Act on the environment

D Train the model

Key Insight

This agent architecture shows a simple but powerful cycle: first sensing the world, then deciding what to do, and finally acting. Training improves the agent's decisions by reducing mistakes over time.

Practice

1. Which of the following best describes the observe step in an agent architecture?

easy

A. Collecting information from the environment

B. Making decisions based on data

C. Performing actions to change the environment

D. Storing past experiences for learning

Solution

1. Step 1: Understand the role of observation

   The observe step is about gathering data or signals from the environment around the agent.

2. Step 2: Differentiate from other steps

   Thinking is about decision-making, and acting is about doing something. Observation is just about sensing.

3. Final Answer:

   Collecting information from the environment -> Option A

4. Quick Check:

   Observe = Collect data [OK]

Hint: Observe means sensing or collecting data first [OK]

Common Mistakes:

• Confusing observe with think or act
• Thinking observe means acting
• Mixing observe with storing data

2. Which of the following is the correct order of steps in a simple agent architecture?

easy

A. Act, Think, Observe

B. Think, Observe, Act

C. Think, Act, Observe

D. Observe, Think, Act

Solution

1. Step 1: Recall the agent cycle

   The agent first observes the environment, then thinks (decides), and finally acts.

2. Step 2: Match the sequence

   Only the sequence Observe, Think, Act matches the correct order of operations.

3. Final Answer:

   Observe, Think, Act -> Option D

4. Quick Check:

   Order = Observe, Think, Act [OK]

Hint: Remember: Sense first, then decide, then do [OK]

Common Mistakes:

• Mixing up the order of steps
• Starting with act before observe
• Confusing think and observe order

3. Consider this simple Python agent code snippet:

class Agent:
    def observe(self, data):
        self.data = data
    def think(self):
        return self.data * 2
    def act(self, result):
        print(f"Action: {result}")

agent = Agent()
agent.observe(5)
result = agent.think()
agent.act(result)

What will be printed when this code runs?

medium

A. No output, error occurs

B. Action: 10

C. Action: 25

D. Action: 5

Solution

1. Step 1: Follow the observe method

   The agent observes the value 5 and stores it in self.data.

2. Step 2: Follow the think method

   The think method returns self.data * 2, which is 5 * 2 = 10.

3. Step 3: Follow the act method

   The act method prints "Action: 10" using the result from think.

4. Final Answer:

   Action: 10 -> Option B

5. Quick Check:

   5 * 2 = 10 printed [OK]

Hint: Multiply observed data by 2, then print [OK]

Common Mistakes:

• Confusing observe data with result
• Forgetting to multiply by 2
• Expecting no output or error

4. This agent code has a bug:

class Agent:
    def observe(self, data):
        self.data = data
    def think(self):
        return self.data + 1
    def act(self, result):
        print(f"Action: {result}")

agent = Agent()
result = agent.think()
agent.act(result)

What is the error and how to fix it?

medium

A. Error: self.data not set before think; fix by calling observe first

B. Error: act method missing return; fix by adding return statement

C. Error: observe method has wrong parameter; fix by renaming parameter

D. No error; code runs fine

Solution

1. Step 1: Identify missing observe call

   The code calls think before observe, so self.data is not set.

2. Step 2: Understand consequence

   Calling think tries to use self.data which does not exist, causing an error.

3. Step 3: Fix by calling observe first

   Call agent.observe(some_value) before think to set self.data properly.

4. Final Answer:

   Error: self.data not set before think; fix by calling observe first -> Option A

5. Quick Check:

   Observe must run before think [OK]

Hint: Always observe before think to set data [OK]

Common Mistakes:

• Ignoring the missing observe call
• Thinking act needs return
• Confusing parameter names

5. You want to build an agent that observes temperature, thinks if it's too hot (>30°C), and acts by turning on a fan. Which code snippet correctly implements the think method?

hard

A. def think(self):
return self.data == 30

B. def think(self):
if self.data < 30:
return True
else:
return False

C. def think(self):
return self.data > 30

D. def think(self):
return self.data * 30

Solution

1. Step 1: Understand the condition for action

   The agent should act if temperature is greater than 30°C, so think returns True if data > 30.

2. Step 2: Check each option

   def think(self): return self.data > 30 returns True if data > 30, matching the requirement. Others do not correctly check this condition.

3. Final Answer:

   def think(self): return self.data > 30 -> Option C

4. Quick Check:

   Think returns True if hot (>30) [OK]

Hint: Think returns True if temperature > 30 [OK]

Common Mistakes:

• Using wrong comparison operators
• Returning True for less than 30
• Multiplying data instead of comparing