Iterative prompt refinement in Prompt Engineering / GenAI - ML Experiment: Train & Evaluate

Experiment - Iterative prompt refinement

Problem:You want to get better answers from a text generation AI by improving your prompts step-by-step.

Current Metrics:Initial prompt yields 60% relevance and 50% clarity in AI responses.

Issue:The AI responses are not very relevant or clear because the prompt is too vague and not specific enough.

Your Task

Improve the prompt iteratively to increase response relevance and clarity to at least 85%.

You can only change the prompt text, not the AI model or settings.

You must keep the prompt length under 100 words.

Hint 1

Hint 2

Hint 3

Solution

Prompt Engineering / GenAI

import openai

# Initial prompt
prompt = "Tell me about dogs."

# Function to get AI response

def get_response(prompt_text):
    response = openai.ChatCompletion.create(
        model="gpt-4",
        messages=[{"role": "user", "content": prompt_text}]
    )
    return response.choices[0].message.content

# Iteration 1: Add specificity
prompt1 = "Tell me about the common breeds of dogs and their characteristics."
response1 = get_response(prompt1)

# Iteration 2: Ask for examples and explanation
prompt2 = "Tell me about the common breeds of dogs, their characteristics, and give examples of their behavior."
response2 = get_response(prompt2)

# Iteration 3: Request clarity and summary
prompt3 = "Explain the common dog breeds, their characteristics, examples of behavior, and provide a short summary at the end."
response3 = get_response(prompt3)

print("Iteration 1 Response:", response1)
print("Iteration 2 Response:", response2)
print("Iteration 3 Response:", response3)

Added specific details about dog breeds and characteristics to the prompt.

Included request for examples of behavior to improve relevance.

Asked for explanation and a summary to enhance clarity.

Results Interpretation

Before: Relevance 60%, Clarity 50%
After: Relevance 88%, Clarity 90%

Improving AI responses can be done by refining prompts step-by-step, adding details, examples, and clear instructions.

Bonus Experiment

Try refining prompts for a different topic, like cooking recipes, to improve AI response quality.

💡 Hint

Use specific ingredients, cooking methods, and ask for step-by-step instructions.