Tool selection by the agent in Agentic AI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

How does an agent decide which tool to use?

An agent has multiple tools available to solve a problem. What is the main factor it uses to select the best tool?

A The tool with the most complex internal architecture

B The tool with the fastest response time regardless of accuracy

C The tool that was used most recently

D The tool that best matches the current task requirements and context

💡 Hint

Think about what helps the agent solve the problem correctly, not just quickly or by habit.

An agent selects a tool based on how well the tool fits the current task and context to maximize success. Speed or complexity alone do not guarantee the best choice.

❓ Predict Output

intermediate

Output of tool selection code snippet

What is the output of this Python code simulating an agent choosing a tool?

Agentic AI

tools = {'search': 0.8, 'calculator': 0.9, 'translator': 0.7}
selected_tool = max(tools, key=tools.get)
print(selected_tool)

A "search"

B "translator"

C "calculator"

D KeyError

💡 Hint

Look for the tool with the highest value in the dictionary.

The max function with key=tools.get returns the key with the highest value. Calculator has 0.9, which is highest.

❓ Hyperparameter

advanced

Choosing the right confidence threshold for tool selection

An agent uses confidence scores to pick tools. What happens if the confidence threshold is set too high?

A The agent rarely selects any tool, possibly failing to act

B The agent selects tools more often, increasing speed but risking errors

C The agent ignores confidence and picks tools randomly

D The agent always picks the tool with the lowest confidence

💡 Hint

Think about what happens if the agent demands very high confidence before using a tool.

If the threshold is too high, the agent may find no tool confident enough and thus avoid selecting any, leading to inaction.

❓ Metrics

advanced

Evaluating agent tool selection accuracy

An agent selects tools for tasks. Which metric best measures how often the agent picks the correct tool?

A Accuracy

B Recall

C Precision

D F1 Score

💡 Hint

Consider the metric that measures overall correct selections out of all attempts.

Accuracy measures the proportion of correct tool selections out of all selections, making it suitable here.

🔧 Debug

expert

Debugging tool selection logic error

What error does this code produce when the agent tries to select a tool?

tools = {'search': 0.8, 'calculator': 0.9, 'translator': 0.7}
threshold = 0.95
selected_tool = None
for tool, score in tools.items():
    if score > threshold:
        selected_tool = tool
print(selected_tool.upper())

A KeyError because 'upper' is not a dict key

B AttributeError because selected_tool can be None

C TypeError because score is a float

D No error, prints 'CALCULATOR'

💡 Hint

What if no tool meets the threshold? What happens when calling upper() on None?

If no tool has score > 0.95, selected_tool stays None. Calling None.upper() raises AttributeError.

Practice

1. What is the main purpose of tool selection by an AI agent?

easy

A. To choose the best helper tool for a specific task

B. To train the AI model faster

C. To store data securely

D. To improve the hardware performance

Solution

1. Step 1: Understand the role of tool selection

   Tool selection means picking the right tool or helper for the AI to complete a task well.

2. Step 2: Match purpose with options

   Among the options, only choosing the best helper tool fits the idea of tool selection.

3. Final Answer:

   To choose the best helper tool for a specific task -> Option A

4. Quick Check:

   Tool selection = choosing best tool [OK]

Hint: Tool selection means picking the right tool for the job [OK]

Common Mistakes:

• Confusing tool selection with training the model
• Thinking it improves hardware
• Mixing it with data storage

2. Which of the following is the correct way to check if a tool named calculator should be used for a task containing the word 'math'?

easy

A. if calculator in task_description: use math

B. if task_description == 'calculator': use math

C. if 'math' in task_description: use calculator

D. if 'calculator' == task_description: use math

Solution

1. Step 1: Understand keyword check syntax

   To check if 'math' is in the task description, use 'math' in task_description.

2. Step 2: Match correct syntax with options

   if 'math' in task_description: use calculator correctly uses this syntax to decide to use the calculator tool.

3. Final Answer:

   if 'math' in task_description: use calculator -> Option C

4. Quick Check:

   Keyword in string check = if 'math' in task_description: use calculator [OK]

Hint: Use 'keyword' in string to check presence [OK]

Common Mistakes:

• Using equality instead of containment
• Checking wrong variable names
• Confusing tool and task names

3. Given the code below, what will be printed?

tools = ['calculator', 'translator', 'weather']
task = 'translate this sentence'
selected_tool = None
for tool in tools:
    if tool in task:
        selected_tool = tool
        break
print(selected_tool)

medium

A. calculator

B. translator

C. weather

D. None

Solution

1. Step 1: Loop through tools and check if tool name is in task

   The loop checks if 'calculator', 'translator', or 'weather' is in the task string 'translate this sentence'.

2. Step 2: Identify which tool matches the task

   None of the tool names appear as substrings in the task ('translator' is not in 'translate this sentence'), so selected_tool remains None.

3. Final Answer:

   None -> Option D

4. Quick Check:

   No substring match, prints None [OK]

Hint: Check substring presence carefully in loops [OK]

Common Mistakes:

• Assuming exact word match needed
• Ignoring break statement
• Thinking 'translator' matches 'translate'

4. The following code is meant to select a tool based on keywords, but it always prints None. What is the error?

tools = {'calc': 'calculator', 'trans': 'translator'}
task = 'please compute this'
selected_tool = None
for key in tools:
    if key in task:
        selected_tool = tools[key]
print(selected_tool)

medium

A. The print statement is outside the loop

B. The keys 'calc' and 'trans' do not match any substring in the task

C. The loop should use tools.values() instead of keys

D. The dictionary keys should be full tool names, not abbreviations

Solution

1. Step 1: Check if keys are substrings of the task

   The keys are 'calc' and 'trans'. The task is 'please compute this'. Neither 'calc' nor 'trans' is a substring.

2. Step 2: Understand why selected_tool stays None

   Since no key matches, the if condition never runs, so selected_tool remains None.

3. Final Answer:

   The keys 'calc' and 'trans' do not match any substring in the task -> Option B

4. Quick Check:

   Substring match fails due to partial keys [OK]

Hint: Check if keys exactly appear as substrings in task [OK]

Common Mistakes:

• Assuming partial matches work
• Thinking print location causes error
• Confusing keys with values

5. You want an AI agent to select tools based on multiple keywords in a task. Which approach best fits this need?

hard

A. Check each tool's keywords and select the tool with the most keyword matches

B. Always select the first tool in the list regardless of task

C. Select a tool randomly without checking the task

D. Use only one keyword per tool and ignore others

Solution

1. Step 1: Understand the need for multiple keyword matching

   When tasks have multiple keywords, the agent should consider all keywords to pick the best tool.

2. Step 2: Evaluate options for best fit

   Check each tool's keywords and select the tool with the most keyword matches uses multiple keyword checks and picks the tool with the most matches, which is the best approach.

3. Final Answer:

   Check each tool's keywords and select the tool with the most keyword matches -> Option A

4. Quick Check:

   Best tool = most keyword matches [OK]

Hint: Count keyword matches to pick best tool [OK]

Common Mistakes:

• Ignoring multiple keywords
• Picking tools randomly
• Always choosing first tool