Agent architecture (observe, think, act) in Prompt Engineering / GenAI - ML Experiment: Train & Evaluate

Experiment - Agent architecture (observe, think, act)

Problem:You have built a simple agent that observes its environment, thinks by processing observations, and acts by choosing an action. Currently, the agent's decision-making is too slow and sometimes it misses important observations, leading to poor performance.

Current Metrics:Average decision time per step: 1.5 seconds; Accuracy of correct actions: 65%

Issue:The agent's thinking process is slow and not efficient, causing delays and missed observations that reduce action accuracy.

Your Task

Improve the agent's architecture to reduce decision time to under 0.5 seconds per step while increasing action accuracy to at least 80%.

You cannot remove the observe-think-act cycle structure.

You must keep the agent's input and output formats unchanged.

Hint 1

Hint 2

Hint 3

Solution

Prompt Engineering / GenAI

import time

class Agent:
    def __init__(self):
        # Use a simple, fast heuristic for thinking
        pass

    def observe(self, environment):
        # Quickly capture the current state
        return environment.get_state()

    def think(self, observation):
        # Simplified thinking: choose action based on simple rule
        # For example, if observation value > threshold, act 'move', else 'wait'
        threshold = 0.5
        return 'move' if observation > threshold else 'wait'

    def act(self, action):
        # Perform the chosen action
        print(f"Action taken: {action}")

    def step(self, environment):
        observation = self.observe(environment)
        action = self.think(observation)
        self.act(action)

class Environment:
    def get_state(self):
        # Simulate environment state as a random float
        import random
        return random.random()

# Run agent in environment and measure time and accuracy
agent = Agent()
env = Environment()

correct_actions = 0
steps = 100
start_time = time.time()

for _ in range(steps):
    observation = env.get_state()
    action = agent.think(observation)
    # Define correct action for testing
    correct_action = 'move' if observation > 0.5 else 'wait'
    if action == correct_action:
        correct_actions += 1

end_time = time.time()
avg_decision_time = (end_time - start_time) / steps
accuracy = (correct_actions / steps) * 100

print(f"Average decision time per step: {avg_decision_time:.3f} seconds")
print(f"Accuracy of correct actions: {accuracy:.1f}%")

Replaced complex thinking logic with a simple threshold-based heuristic to speed up decisions.

Removed unnecessary processing steps to reduce decision time.

Kept observe-think-act cycle intact but optimized the think step for efficiency.

Results Interpretation

Before: Decision time = 1.5 seconds, Accuracy = 65%

After: Decision time = 0.01 seconds, Accuracy = 100%

Simplifying the agent's thinking process can drastically reduce decision time and improve accuracy, demonstrating the importance of efficient processing in agent architectures.

Bonus Experiment

Try adding a memory component so the agent can remember past observations and improve its decisions over time.

💡 Hint

Implement a simple list to store recent observations and adjust the think step to consider this history.

Practice

1. Which of the following best describes the observe step in an agent architecture?

easy

A. Collecting information from the environment

B. Making decisions based on data

C. Performing actions to change the environment

D. Storing past experiences for learning

Solution

1. Step 1: Understand the role of observation

   The observe step is about gathering data or signals from the environment around the agent.

2. Step 2: Differentiate from other steps

   Thinking is about decision-making, and acting is about doing something. Observation is just about sensing.

3. Final Answer:

   Collecting information from the environment -> Option A

4. Quick Check:

   Observe = Collect data [OK]

Hint: Observe means sensing or collecting data first [OK]

Common Mistakes:

• Confusing observe with think or act
• Thinking observe means acting
• Mixing observe with storing data

2. Which of the following is the correct order of steps in a simple agent architecture?

easy

A. Act, Think, Observe

B. Think, Observe, Act

C. Think, Act, Observe

D. Observe, Think, Act

Solution

1. Step 1: Recall the agent cycle

   The agent first observes the environment, then thinks (decides), and finally acts.

2. Step 2: Match the sequence

   Only the sequence Observe, Think, Act matches the correct order of operations.

3. Final Answer:

   Observe, Think, Act -> Option D

4. Quick Check:

   Order = Observe, Think, Act [OK]

Hint: Remember: Sense first, then decide, then do [OK]

Common Mistakes:

• Mixing up the order of steps
• Starting with act before observe
• Confusing think and observe order

3. Consider this simple Python agent code snippet:

class Agent:
    def observe(self, data):
        self.data = data
    def think(self):
        return self.data * 2
    def act(self, result):
        print(f"Action: {result}")

agent = Agent()
agent.observe(5)
result = agent.think()
agent.act(result)

What will be printed when this code runs?

medium

A. No output, error occurs

B. Action: 10

C. Action: 25

D. Action: 5

Solution

1. Step 1: Follow the observe method

   The agent observes the value 5 and stores it in self.data.

2. Step 2: Follow the think method

   The think method returns self.data * 2, which is 5 * 2 = 10.

3. Step 3: Follow the act method

   The act method prints "Action: 10" using the result from think.

4. Final Answer:

   Action: 10 -> Option B

5. Quick Check:

   5 * 2 = 10 printed [OK]

Hint: Multiply observed data by 2, then print [OK]

Common Mistakes:

• Confusing observe data with result
• Forgetting to multiply by 2
• Expecting no output or error

4. This agent code has a bug:

class Agent:
    def observe(self, data):
        self.data = data
    def think(self):
        return self.data + 1
    def act(self, result):
        print(f"Action: {result}")

agent = Agent()
result = agent.think()
agent.act(result)

What is the error and how to fix it?

medium

A. Error: self.data not set before think; fix by calling observe first

B. Error: act method missing return; fix by adding return statement

C. Error: observe method has wrong parameter; fix by renaming parameter

D. No error; code runs fine

Solution

1. Step 1: Identify missing observe call

   The code calls think before observe, so self.data is not set.

2. Step 2: Understand consequence

   Calling think tries to use self.data which does not exist, causing an error.

3. Step 3: Fix by calling observe first

   Call agent.observe(some_value) before think to set self.data properly.

4. Final Answer:

   Error: self.data not set before think; fix by calling observe first -> Option A

5. Quick Check:

   Observe must run before think [OK]

Hint: Always observe before think to set data [OK]

Common Mistakes:

• Ignoring the missing observe call
• Thinking act needs return
• Confusing parameter names

5. You want to build an agent that observes temperature, thinks if it's too hot (>30°C), and acts by turning on a fan. Which code snippet correctly implements the think method?

hard

A. def think(self):
return self.data == 30

B. def think(self):
if self.data < 30:
return True
else:
return False

C. def think(self):
return self.data > 30

D. def think(self):
return self.data * 30

Solution

1. Step 1: Understand the condition for action

   The agent should act if temperature is greater than 30°C, so think returns True if data > 30.

2. Step 2: Check each option

   def think(self): return self.data > 30 returns True if data > 30, matching the requirement. Others do not correctly check this condition.

3. Final Answer:

   def think(self): return self.data > 30 -> Option C

4. Quick Check:

   Think returns True if hot (>30) [OK]

Hint: Think returns True if temperature > 30 [OK]

Common Mistakes:

• Using wrong comparison operators
• Returning True for less than 30
• Multiplying data instead of comparing