Tool permission boundaries in Agentic AI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding Tool Permission Boundaries in Agentic AI

Which of the following best describes the purpose of tool permission boundaries in agentic AI systems?

A To allow the AI unrestricted access to all system tools for maximum efficiency.

B To restrict the AI's access to only necessary tools and data to prevent misuse or unintended actions.

C To enable the AI to modify its own code without any restrictions.

D To prevent the AI from communicating with external systems under any circumstances.

💡 Hint

Think about why limiting access is important for safety and control.

Tool permission boundaries limit what tools and data an AI can access, ensuring it only uses what is necessary and preventing harmful or unintended actions.

❓ Model Choice

intermediate

Choosing the Right Permission Model for Tool Access

You want to design an agentic AI system that safely interacts with external APIs but only for specific tasks. Which permission model is most appropriate?

A Random access control where permissions change unpredictably.

B Full access control allowing all API calls without restrictions.

C No access control, trusting the AI to self-regulate API usage.

D Role-based access control (RBAC) limiting API calls to predefined roles.

💡 Hint

Consider a model that assigns permissions based on roles or tasks.

RBAC assigns permissions based on roles, allowing safe, task-specific access to external APIs, which fits the requirement.

❓ Metrics

advanced

Evaluating Tool Permission Boundary Effectiveness

Which metric would best measure the effectiveness of tool permission boundaries in preventing unauthorized AI actions?

A Speed of AI responses to user queries.

B Total number of tools available to the AI.

C Number of unauthorized tool access attempts blocked by the system.

D Amount of data processed by the AI per second.

💡 Hint

Think about what shows the system is stopping bad actions.

The number of unauthorized access attempts blocked directly reflects how well permission boundaries prevent misuse.

🔧 Debug

advanced

Debugging Permission Boundary Violation in Agentic AI

An agentic AI system unexpectedly accessed a restricted tool despite permission boundaries. Which of the following is the most likely cause?

A A misconfigured permission rule allowing broader access than intended.

B The AI system was offline and could not enforce permissions.

C The AI was running in a sandbox environment with no external access.

D The AI system had no tools installed at all.

💡 Hint

Consider what would let the AI bypass restrictions unintentionally.

A misconfigured permission rule can accidentally grant the AI access to restricted tools, causing violations.

🧠 Conceptual

expert

Balancing Flexibility and Safety in Tool Permission Boundaries

In agentic AI, what is the main challenge when designing tool permission boundaries that are both flexible and safe?

A Ensuring the AI has enough access to perform tasks without risking unauthorized actions.

B Allowing the AI to access all system tools to maximize learning speed.

C Making permission boundaries so strict that the AI cannot perform any useful tasks.

D Preventing the AI from accessing any tools to avoid all risks.

💡 Hint

Think about the trade-off between capability and control.

The key challenge is to give the AI enough access to do its job while preventing misuse or harm by limiting unauthorized actions.

Practice

1. What is the main purpose of tool permission boundaries in agentic AI systems?

easy

A. To limit what actions AI tools can perform

B. To increase the speed of AI computations

C. To improve the visual design of AI interfaces

D. To store large amounts of data efficiently

Solution

1. Step 1: Understand the role of permission boundaries

   Permission boundaries restrict the actions AI tools can take to ensure safety and control.

2. Step 2: Identify the main goal

   The main goal is to limit actions to prevent harmful or unauthorized behavior.

3. Final Answer:

   To limit what actions AI tools can perform -> Option A

4. Quick Check:

   Permission boundaries = limit actions [OK]

Hint: Permission boundaries control AI actions to keep systems safe [OK]

Common Mistakes:

• Confusing permission boundaries with data storage
• Thinking permission boundaries speed up AI
• Assuming permission boundaries affect UI design

2. Which of the following is the correct way to define a permission boundary for an AI tool in pseudocode?

easy

A. permissions = 'full_access'

B. allow_actions = ['read', 'write', 'execute']

C. actions = ['all']

D. permission_boundary = { 'allowed': ['read', 'write'], 'denied': ['delete'] }

Solution

1. Step 1: Identify correct permission boundary structure

   A permission boundary should clearly specify allowed and denied actions.

2. Step 2: Compare options

   permission_boundary = { 'allowed': ['read', 'write'], 'denied': ['delete'] } explicitly defines allowed and denied actions, which fits permission boundary concept.

3. Final Answer:

   permission_boundary = { 'allowed': ['read', 'write'], 'denied': ['delete'] } -> Option D

4. Quick Check:

   Permission boundary = allowed and denied actions [OK]

Hint: Look for explicit allowed and denied lists in permission definitions [OK]

Common Mistakes:

• Using vague permissions like 'all' or 'full_access'
• Not specifying denied actions
• Confusing action lists with permission boundaries

3. Given this pseudocode for an AI tool permission check:

def can_perform(action, permissions):
    return action in permissions['allowed'] and action not in permissions['denied']

permissions = {'allowed': ['read', 'write'], 'denied': ['delete']}
action = 'delete'
print(can_perform(action, permissions))

What will be the output?

medium

A. True

B. False

C. Error

D. None

Solution

1. Step 1: Understand the function logic

   The function returns True only if action is in allowed and not in denied.

2. Step 2: Check the action 'delete'

   'delete' is not in allowed but is in denied, so condition fails.

3. Final Answer:

   False -> Option B

4. Quick Check:

   Action denied = False output [OK]

Hint: Check if action is both allowed and not denied for True [OK]

Common Mistakes:

• Ignoring denied list and returning True
• Assuming 'delete' is allowed by default
• Confusing function return values

4. Identify the error in this permission boundary check code:

def check_permission(action, permissions):
    if action in permissions['allowed'] or action not in permissions['denied']:
        return True
    else:
        return False

permissions = {'allowed': ['read'], 'denied': ['delete']}
print(check_permission('delete', permissions))

medium

A. Incorrect dictionary keys

B. Missing return statement

C. Using 'or' instead of 'and' in condition

D. Syntax error in function definition

Solution

1. Step 1: Analyze the condition logic

   The condition uses 'or' which allows action if either allowed or not denied.

2. Step 2: Understand correct logic for permission

   It should be 'and' to ensure action is allowed and not denied simultaneously.

3. Final Answer:

   Using 'or' instead of 'and' in condition -> Option C

4. Quick Check:

   Permission check needs 'and' not 'or' [OK]

Hint: Permission checks require 'and' to combine allowed and denied rules [OK]

Common Mistakes:

• Using 'or' allowing denied actions
• Confusing dictionary keys
• Forgetting to return a value

5. You want to design a permission boundary for an AI tool that can read and write files but must never delete or modify system files. Which permission boundary setup below best enforces this?

hard

A. {'allowed': ['read', 'write'], 'denied': ['delete', 'modify_system_files']}

B. {'allowed': ['read', 'write', 'delete'], 'denied': ['modify_system_files']}

C. {'allowed': ['read'], 'denied': ['write', 'delete', 'modify_system_files']}

D. {'allowed': ['read', 'write', 'modify_system_files'], 'denied': ['delete']}

Solution

1. Step 1: Identify required allowed actions

   The tool must be allowed to read and write files.

2. Step 2: Identify denied actions

   It must never delete or modify system files, so these must be denied.

3. Step 3: Match options to requirements

   {'allowed': ['read', 'write'], 'denied': ['delete', 'modify_system_files']} allows read and write, denies delete and modify_system_files, matching requirements exactly.

4. Final Answer:

   {'allowed': ['read', 'write'], 'denied': ['delete', 'modify_system_files']} -> Option A

5. Quick Check:

   Allowed read/write, denied delete/system modify = {'allowed': ['read', 'write'], 'denied': ['delete', 'modify_system_files']} [OK]

Hint: Match allowed and denied lists exactly to requirements [OK]

Common Mistakes:

• Allowing delete when it should be denied
• Denying write when it should be allowed
• Missing deny for system file modifications