First interaction with GenAI APIs - Model Pipeline Trace

Model Pipeline - First interaction with GenAI APIs

This pipeline shows how a user sends a text prompt to a GenAI API, the API processes it, and returns a generated text response. It helps understand the flow from input to output in a simple GenAI interaction.

Data Flow - 5 Stages

1User Input

1 prompt string→User writes a text prompt→1 prompt string

"Tell me a fun fact about space."

↓

2API Request

1 prompt string→Send prompt to GenAI API→1 API request with prompt

{"prompt": "Tell me a fun fact about space."}

↓

3Model Processing

1 prompt string→GenAI model generates text based on prompt→1 generated text string

"Did you know that a day on Venus is longer than a year on Venus?"

↓

4API Response

1 generated text string→API sends generated text back to user→1 response string

"Did you know that a day on Venus is longer than a year on Venus?"

↓

5User Output

1 response string→User reads or uses the generated text→Displayed text

Displayed: Did you know that a day on Venus is longer than a year on Venus?

Training Trace - Epoch by Epoch

Loss
2.3 |*****
1.8 |****
1.2 |***
0.8 |**
0.5 |*

Epoch	Loss ↓	Accuracy ↑	Observation
1	2.3	0.10	Initial training with random outputs, high loss, low accuracy.
2	1.8	0.25	Model starts learning basic language patterns.
3	1.2	0.45	Improved understanding of prompt-response relation.
4	0.8	0.65	Better generation quality, loss decreasing steadily.
5	0.5	0.80	Model generates coherent and relevant text.

Prediction Trace - 4 Layers

Layer 1: Input Encoding

Layer 2: Model Attention Layers

Layer 3: Text Generation

Layer 4: Output Decoding

Model Quiz - 3 Questions

What is the first step in the GenAI API interaction pipeline?

A API sends response

B Model generates text

C User writes a text prompt

D Output decoding

Key Insight

This visualization shows how a GenAI API takes a user prompt, processes it through a trained model, and returns a meaningful text response. Training improves the model's ability to generate relevant text by reducing loss and increasing accuracy over time.

Practice

1. What is the main purpose of a GenAI API when you first interact with it?

easy

A. To train a new AI model from scratch

B. To store large datasets for AI training

C. To manually code AI algorithms

D. To send a prompt and receive a text response from the AI model

Solution

1. Step 1: Understand what GenAI APIs do

   GenAI APIs let you send a prompt (a question or task) to an AI model.

2. Step 2: Identify the response from the API

   The API returns a text response generated by the AI based on your prompt.

3. Final Answer:

   To send a prompt and receive a text response from the AI model -> Option D

4. Quick Check:

   GenAI API = prompt in, text out [OK]

Hint: GenAI APIs take your question and give text answers [OK]

Common Mistakes:

• Thinking you train the AI on first use
• Believing you write AI code manually
• Confusing API with data storage

2. Which of the following is the correct way to send a prompt to a GenAI API in Python?

easy

A. response = genai.ask(prompt)

B. response = genai.ask('Hello AI!')

C. response = genai.ask(prompt='Hello AI!')

D. response = genai.ask(input='Hello AI!')

Solution

1. Step 1: Check the correct parameter name for prompt

   The GenAI API expects the prompt to be passed with the keyword 'prompt'.

2. Step 2: Verify the syntax for calling the API

   Using named argument prompt='Hello AI!' matches the expected syntax.

3. Final Answer:

   response = genai.ask(prompt='Hello AI!') -> Option C

4. Quick Check:

   Use prompt= keyword to send text [OK]

Hint: Use prompt='text' when calling genai.ask() [OK]

Common Mistakes:

• Omitting the prompt= keyword
• Using wrong parameter name like input=
• Passing variable without quotes when string needed

3. Given the code below, what will be printed?

response = genai.ask(prompt='What is 2 + 2?')
print(response.text)

medium

A. '4'

B. 'What is 2 + 2?'

C. An error because response has no attribute text

D. '2 + 2 equals 4'

Solution

1. Step 1: Understand the prompt sent to the AI

   The prompt asks the AI a simple math question: 'What is 2 + 2?'.

2. Step 2: Predict the AI's text response

   The AI will respond with the answer '4' as text, accessible via response.text.

3. Final Answer:

   '4' -> Option A

4. Quick Check:

   Simple math prompt returns answer text [OK]

Hint: AI answers math questions with the result as text [OK]

Common Mistakes:

• Expecting the prompt text to be printed
• Assuming response.text does not exist
• Thinking AI returns full sentence instead of just answer

4. You wrote this code but get an error:

response = genai.ask('Hello AI!')
print(response.text)

What is the likely cause?

medium

A. The print statement is incorrect

B. The prompt argument is missing its keyword name

C. The genai.ask function does not exist

D. response.text is not a valid attribute

Solution

1. Step 1: Check how the prompt is passed to genai.ask()

   The code passes 'Hello AI!' without specifying prompt= keyword.

2. Step 2: Understand the API expects prompt= keyword

   Without prompt=, the function may raise an error or not recognize the input.

3. Final Answer:

   The prompt argument is missing its keyword name -> Option B

4. Quick Check:

   Always use prompt= when calling genai.ask() [OK]

Hint: Always name the prompt argument: prompt='text' [OK]

Common Mistakes:

• Passing prompt as positional argument
• Assuming print statement causes error
• Thinking response.text is invalid

5. You want to use a GenAI API to get a short story about a cat. Which approach is best to get a clear, useful response?

hard

A. Send prompt='Write a short story about a cat in 3 sentences.'

B. Send prompt='cat story'

C. Send prompt='Tell me something interesting.'

D. Send prompt='Write a story'

Solution

1. Step 1: Identify the prompt that clearly states the task

   Send prompt='Write a short story about a cat in 3 sentences.' specifies the topic (cat), the type (short story), and length (3 sentences).

2. Step 2: Compare other prompts for clarity

   Options B, C, and D are vague and may produce unrelated or too long responses.

3. Final Answer:

   Send prompt='Write a short story about a cat in 3 sentences.' -> Option A

4. Quick Check:

   Clear, detailed prompts get better AI answers [OK]

Hint: Be specific and clear in your prompt for best results [OK]

Common Mistakes:

• Using too short or vague prompts
• Not specifying length or topic clearly
• Expecting AI to guess details