Tool usage (function calling) in Prompt Engineering / GenAI - Model Pipeline Trace

Model Pipeline - Tool usage (function calling)

This pipeline shows how a machine learning model uses a tool (function) during prediction to improve its output. The model calls a function to get extra information, then combines it with its own prediction.

Data Flow - 5 Stages

1Input data

1 sample x 3 features→Receive raw input features→1 sample x 3 features

[5.1, 3.5, 1.4]

↓

2Preprocessing

1 sample x 3 features→Normalize features to range 0-1→1 sample x 3 features

[0.51, 0.7, 0.14]

↓

3Model prediction

1 sample x 3 features→Feed features into neural network→1 sample x 2 outputs

[0.6, 0.4]

↓

4Function call (tool usage)

1 sample x 3 features→Call external function to get extra info→1 sample x 1 feature

[0.8]

↓

5Combine outputs

1 sample x 2 outputs + 1 feature→Combine model output and function output→1 sample x 2 outputs

[0.68, 0.32]

Training Trace - Epoch by Epoch

Loss
0.7 |****
0.6 |*** 
0.5 |**  
0.4 |*   
0.3 |    
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.65	0.60	Model starts learning, loss high, accuracy low
2	0.50	0.72	Loss decreases, accuracy improves
3	0.40	0.80	Model learns important patterns
4	0.32	0.85	Loss continues to drop, accuracy rises
5	0.28	0.88	Model converges with good accuracy

Prediction Trace - 5 Layers

Layer 1: Input features

Layer 2: Normalization

Layer 3: Neural network prediction

Layer 4: Function call (tool usage)

Layer 5: Combine outputs

Model Quiz - 3 Questions

What does the function call (tool usage) provide in the pipeline?

A Raw input data

B Extra information to improve prediction

C Final prediction output

D Training loss value

Key Insight

Using a tool (function call) during prediction can provide extra useful information that improves the model's final output beyond what the model alone predicts.

Practice

1. What is the main purpose of calling a function in AI tool usage?

easy

A. To perform a specific task using given inputs

B. To create new data without inputs

C. To store data permanently

D. To display the AI model architecture

Solution

1. Step 1: Understand function role in AI tools

   Functions are blocks of code designed to perform specific tasks when called with inputs.

2. Step 2: Identify the purpose of calling functions

   Calling a function means using it to do a job, usually with parameters to guide the task.

3. Final Answer:

   To perform a specific task using given inputs -> Option A

4. Quick Check:

   Function call = perform task with inputs [OK]

Hint: Functions do tasks using inputs, not just store or show data [OK]

Common Mistakes:

• Thinking functions create data without inputs
• Confusing function calls with data storage
• Assuming functions only display info

2. Which of the following is the correct way to call a function named generate_text with a parameter prompt in Python?

easy

A. generate_text = prompt

B. generate_text->prompt()

C. call generate_text(prompt)

D. generate_text(prompt)

Solution

1. Step 1: Recall Python function call syntax

   In Python, functions are called by writing the function name followed by parentheses enclosing parameters.

2. Step 2: Match syntax with options

   generate_text(prompt) uses the correct syntax: function name followed by parentheses with parameter inside.

3. Final Answer:

   generate_text(prompt) -> Option D

4. Quick Check:

   Python function call = name(params) [OK]

Hint: Use functionName(parameters) to call in Python [OK]

Common Mistakes:

• Using assignment (=) instead of call
• Adding extra keywords like 'call'
• Using wrong symbols like '->'

3. Given the code:

def add_numbers(a, b):
    return a + b

result = add_numbers(3, 5)
print(result)

What will be printed?

medium

A. None

B. 8

C. TypeError

D. 35

Solution

1. Step 1: Understand function behavior

   The function add_numbers takes two inputs and returns their sum.

2. Step 2: Calculate the sum of inputs 3 and 5

   3 + 5 equals 8, so the function returns 8, which is stored in result.

3. Final Answer:

   8 -> Option B

4. Quick Check:

   3 + 5 = 8 [OK]

Hint: Add inputs inside function to get output [OK]

Common Mistakes:

• Concatenating numbers as strings (35)
• Expecting error due to parameters
• Ignoring return value (None)

4. Identify the error in this function call:

def translate(text, language):
    return f"{text} in {language}"

result = translate("Hello")
print(result)

medium

A. Return statement syntax error

B. Function name is incorrect

C. Missing second argument 'language' in function call

D. Print statement is missing parentheses

Solution

1. Step 1: Check function definition parameters

   The function translate requires two parameters: text and language.

2. Step 2: Check function call arguments

   The call translate("Hello") provides only one argument, missing the second required parameter.

3. Final Answer:

   Missing second argument 'language' in function call -> Option C

4. Quick Check:

   All parameters must be given when calling [OK]

Hint: Count parameters in definition and match in call [OK]

Common Mistakes:

• Ignoring missing arguments
• Assuming default values without definition
• Misreading function name or print syntax

5. You want to use a function summarize_text that takes a long text and a number max_length to limit summary size. Which call correctly uses this function to summarize article with a max length of 100?

hard

A. summary = summarize_text(article, max_length=100)

B. summary = summarize_text(max_length=100, article)

C. summary = summarize_text(article max_length=100)

D. summary = summarize_text(article, 100, max_length)

Solution

1. Step 1: Understand function parameters and calling conventions

   The function expects two inputs: the text and the max_length number. Keyword arguments can be used to specify parameters by name.

2. Step 2: Identify correct syntax for positional and keyword arguments

   summary = summarize_text(article, max_length=100) correctly passes article as the first argument and uses max_length=100 as a keyword argument.

3. Final Answer:

   summary = summarize_text(article, max_length=100) -> Option A

4. Quick Check:

   Positional first, then keyword args [OK]

Hint: Use positional args first, then named args [OK]

Common Mistakes:

• Placing keyword argument before positional
• Missing commas between arguments
• Adding extra unexpected arguments