First interaction with GenAI APIs - ML Experiment: Train & Evaluate

Experiment - First interaction with GenAI APIs

Problem:You want to generate text using a GenAI API but the output is not as expected. The generated text is too short and lacks detail.

Current Metrics:Output length average: 20 words; Relevance score (manual check): 60%

Issue:The model output is too brief and not detailed enough, indicating underutilization of the API parameters.

Your Task

Increase the output length to at least 50 words and improve relevance score to above 80% by adjusting API parameters.

You can only change the API request parameters such as max tokens, temperature, and prompt wording.

You cannot change the underlying model or use a different API.

Hint 1

Hint 2

Hint 3

Solution

Prompt Engineering / GenAI

import requests

api_url = "https://api.genai.example/v1/generate"
headers = {"Authorization": "Bearer YOUR_API_KEY"}
prompt = "Write a detailed description about the benefits of daily exercise."

params = {
    "model": "genai-text-001",
    "prompt": prompt,
    "max_tokens": 100,
    "temperature": 0.7
}

response = requests.post(api_url, headers=headers, json=params)
output = response.json().get("text", "")
print(f"Generated Text:\n{output}")

Increased max_tokens from 30 to 100 to allow longer output.

Set temperature to 0.7 to balance creativity and coherence.

Made the prompt more specific by asking for a detailed description.

Results Interpretation

Before: Output length: 20 words, Relevance: 60%

After: Output length: 65 words, Relevance: 85%

Adjusting API parameters like max tokens and temperature, along with clear prompts, helps generate longer and more relevant text from GenAI APIs.

Bonus Experiment

Try using different temperature values (e.g., 0.3, 0.9) to see how creativity and detail in the output change.

💡 Hint

Lower temperature makes output more focused and deterministic; higher temperature increases creativity but may reduce coherence.

Practice

1. What is the main purpose of a GenAI API when you first interact with it?

easy

A. To train a new AI model from scratch

B. To store large datasets for AI training

C. To manually code AI algorithms

D. To send a prompt and receive a text response from the AI model

Solution

1. Step 1: Understand what GenAI APIs do

   GenAI APIs let you send a prompt (a question or task) to an AI model.

2. Step 2: Identify the response from the API

   The API returns a text response generated by the AI based on your prompt.

3. Final Answer:

   To send a prompt and receive a text response from the AI model -> Option D

4. Quick Check:

   GenAI API = prompt in, text out [OK]

Hint: GenAI APIs take your question and give text answers [OK]

Common Mistakes:

• Thinking you train the AI on first use
• Believing you write AI code manually
• Confusing API with data storage

2. Which of the following is the correct way to send a prompt to a GenAI API in Python?

easy

A. response = genai.ask(prompt)

B. response = genai.ask('Hello AI!')

C. response = genai.ask(prompt='Hello AI!')

D. response = genai.ask(input='Hello AI!')

Solution

1. Step 1: Check the correct parameter name for prompt

   The GenAI API expects the prompt to be passed with the keyword 'prompt'.

2. Step 2: Verify the syntax for calling the API

   Using named argument prompt='Hello AI!' matches the expected syntax.

3. Final Answer:

   response = genai.ask(prompt='Hello AI!') -> Option C

4. Quick Check:

   Use prompt= keyword to send text [OK]

Hint: Use prompt='text' when calling genai.ask() [OK]

Common Mistakes:

• Omitting the prompt= keyword
• Using wrong parameter name like input=
• Passing variable without quotes when string needed

3. Given the code below, what will be printed?

response = genai.ask(prompt='What is 2 + 2?')
print(response.text)

medium

A. '4'

B. 'What is 2 + 2?'

C. An error because response has no attribute text

D. '2 + 2 equals 4'

Solution

1. Step 1: Understand the prompt sent to the AI

   The prompt asks the AI a simple math question: 'What is 2 + 2?'.

2. Step 2: Predict the AI's text response

   The AI will respond with the answer '4' as text, accessible via response.text.

3. Final Answer:

   '4' -> Option A

4. Quick Check:

   Simple math prompt returns answer text [OK]

Hint: AI answers math questions with the result as text [OK]

Common Mistakes:

• Expecting the prompt text to be printed
• Assuming response.text does not exist
• Thinking AI returns full sentence instead of just answer

4. You wrote this code but get an error:

response = genai.ask('Hello AI!')
print(response.text)

What is the likely cause?

medium

A. The print statement is incorrect

B. The prompt argument is missing its keyword name

C. The genai.ask function does not exist

D. response.text is not a valid attribute

Solution

1. Step 1: Check how the prompt is passed to genai.ask()

   The code passes 'Hello AI!' without specifying prompt= keyword.

2. Step 2: Understand the API expects prompt= keyword

   Without prompt=, the function may raise an error or not recognize the input.

3. Final Answer:

   The prompt argument is missing its keyword name -> Option B

4. Quick Check:

   Always use prompt= when calling genai.ask() [OK]

Hint: Always name the prompt argument: prompt='text' [OK]

Common Mistakes:

• Passing prompt as positional argument
• Assuming print statement causes error
• Thinking response.text is invalid

5. You want to use a GenAI API to get a short story about a cat. Which approach is best to get a clear, useful response?

hard

A. Send prompt='Write a short story about a cat in 3 sentences.'

B. Send prompt='cat story'

C. Send prompt='Tell me something interesting.'

D. Send prompt='Write a story'

Solution

1. Step 1: Identify the prompt that clearly states the task

   Send prompt='Write a short story about a cat in 3 sentences.' specifies the topic (cat), the type (short story), and length (3 sentences).

2. Step 2: Compare other prompts for clarity

   Options B, C, and D are vague and may produce unrelated or too long responses.

3. Final Answer:

   Send prompt='Write a short story about a cat in 3 sentences.' -> Option A

4. Quick Check:

   Clear, detailed prompts get better AI answers [OK]

Hint: Be specific and clear in your prompt for best results [OK]

Common Mistakes:

• Using too short or vague prompts
• Not specifying length or topic clearly
• Expecting AI to guess details