Computer use agents in Agentic AI

Introduction

Computer use agents help computers do tasks for us automatically. They act like helpers that can learn and make decisions.

When you want a program to answer questions for you automatically.

When you need a system to control smart devices in your home.

When you want a computer to help schedule your appointments.

When you want to automate repetitive tasks on your computer.

When you want a chatbot that can talk and help users.

Syntax

Agentic AI

agent = Agent(task='task description', environment=Environment())
agent.run()

The Agent is the helper that does the task.

The Environment is where the agent works and learns.

Examples

This agent answers questions in a question-answer environment.

Agentic AI

agent = Agent(task='answer questions', environment=QAEnvironment())
agent.run()

This agent controls smart lights in a home environment.

Agentic AI

agent = Agent(task='control smart lights', environment=SmartHomeEnvironment())
agent.run()

Sample Model

This simple program creates an environment and an agent. The agent greets the user by asking how it can help.

Agentic AI

class Environment:
    def __init__(self):
        self.state = 'ready'

    def get_state(self):
        return self.state

    def perform_action(self, action):
        if action == 'greet':
            return 'Hello! How can I help you?'
        return 'Action not recognized.'

class Agent:
    def __init__(self, task, environment):
        self.task = task
        self.env = environment

    def run(self):
        state = self.env.get_state()
        if self.task == 'greet user' and state == 'ready':
            response = self.env.perform_action('greet')
            print(response)
        else:
            print('Agent is idle.')

# Create environment and agent
env = Environment()
agent = Agent(task='greet user', environment=env)
agent.run()

Important Notes

Agents work best when they can sense their environment and act on it.

Simple agents can do fixed tasks; advanced agents learn and improve.

Summary

Computer use agents are helpers that perform tasks automatically.

They work by sensing an environment and taking actions.

Agents can be simple or smart depending on the task.

Practice

1. What is the main role of a computer use agent?

easy

A. To display graphics on the screen

B. To perform tasks automatically by sensing and acting

C. To store large amounts of data

D. To manually control the computer hardware

Solution

1. Step 1: Understand what an agent does

   An agent senses its environment and takes actions to complete tasks automatically.

2. Step 2: Compare options with this definition

   Only To perform tasks automatically by sensing and acting describes automatic task performance by sensing and acting.

3. Final Answer:

   To perform tasks automatically by sensing and acting -> Option B

4. Quick Check:

   Agent role = automatic task performance [OK]

Hint: Agents act automatically by sensing environment [OK]

Common Mistakes:

• Confusing agents with hardware controllers
• Thinking agents only store data
• Assuming agents only display information

2. Which of the following is the correct way to describe an agent's action cycle?

easy

A. Sense environment -> Take action -> Update environment

B. Take action -> Sense environment -> Sleep

C. Sense environment -> Sleep -> Take action

D. Update environment -> Take action -> Sense environment

Solution

1. Step 1: Recall the agent cycle steps

   An agent first senses its environment, then takes an action based on that sensing.

2. Step 2: Match the correct sequence

   Sense environment -> Take action -> Update environment correctly shows sensing first, then acting, then environment update.

3. Final Answer:

   Sense environment -> Take action -> Update environment -> Option A

4. Quick Check:

   Agent cycle = sense then act [OK]

Hint: Agents sense first, then act, then update [OK]

Common Mistakes:

• Mixing order of sensing and acting
• Including sleep incorrectly in cycle
• Ignoring environment update step

3. Consider this simple agent code snippet:

class Agent:
    def __init__(self):
        self.state = 0
    def sense(self, input):
        self.state += input
    def act(self):
        return self.state * 2

agent = Agent()
agent.sense(3)
agent.sense(4)
print(agent.act())

What is the output of this code?

medium

A. 14

B. 7

C. 12

D. 0

Solution

1. Step 1: Calculate state after sensing inputs

   Initial state is 0. After agent.sense(3), state = 3. After agent.sense(4), state = 7.

2. Step 2: Calculate action output

   agent.act() returns state * 2 = 7 * 2 = 14.

3. Final Answer:

   14 -> Option A

4. Quick Check:

   State sum 7 x 2 = 14 [OK]

Hint: Add inputs then multiply by 2 for output [OK]

Common Mistakes:

• Multiplying inputs separately instead of sum
• Using only last input instead of sum
• Confusing state update logic

4. This agent code has a bug:

class Agent:
    def __init__(self):
        self.state = 0
    def sense(self, input):
        self.state = input
    def act(self):
        return self.state * 2

agent = Agent()
agent.sense(3)
agent.sense(4)
print(agent.act())

What is the bug and how to fix it?

medium

A. Bug: sense method missing; Fix: add sense method

B. Bug: act returns wrong value; Fix: return state + 2

C. Bug: state overwritten each sense; Fix: use += to accumulate

D. Bug: state not initialized; Fix: initialize state in act

Solution

1. Step 1: Identify the problem in sense method

   The sense method sets state = input, so previous state is lost on each call.

2. Step 2: Fix by accumulating inputs

   Change state = input to state += input to keep adding inputs.

3. Final Answer:

   Bug: state overwritten each sense; Fix: use += to accumulate -> Option C

4. Quick Check:

   Accumulate inputs with += fixes bug [OK]

Hint: Use += to add inputs, not = to overwrite [OK]

Common Mistakes:

• Thinking act method is wrong
• Adding sense method again unnecessarily
• Initializing state in wrong place

5. You want to design a smart agent that automatically adjusts room temperature based on sensor data. Which approach best fits this task?

hard

A. Use a simple reflex agent that acts only on current sensor reading

B. Use a fixed schedule agent ignoring sensor data

C. Use a random agent that changes temperature randomly

D. Use a model-based agent that keeps track of past temperatures

Solution

1. Step 1: Understand task needs

   Adjusting temperature smartly requires remembering past data to avoid sudden changes.

2. Step 2: Choose agent type

   A model-based agent keeps track of past states, making it suitable for this task.

3. Final Answer:

   Use a model-based agent that keeps track of past temperatures -> Option D

4. Quick Check:

   Smart adjustment needs model-based agent [OK]

Hint: Smart agents remember past data for better decisions [OK]

Common Mistakes:

• Choosing simple reflex agent ignoring history
• Using random or fixed schedule agents
• Not considering past sensor data