Instruction formatting in Prompt Engineering / GenAI - ML Experiment: Train & Evaluate

Experiment - Instruction formatting

Problem:You have a text generation model that produces instructions, but the output is inconsistent and hard to follow. The instructions lack clear formatting, making them confusing for users.

Current Metrics:Instruction clarity score: 60%, User comprehension rate: 55%

Issue:The model outputs instructions without proper formatting such as bullet points, numbered steps, or clear separation of ideas, leading to poor user understanding.

Your Task

Improve the instruction formatting so that the clarity score increases to at least 85% and user comprehension rate improves to at least 80%.

Do not change the core content of the instructions.

Focus only on formatting improvements such as adding bullet points, numbering, and line breaks.

Use simple language and short sentences.

Hint 1

Hint 2

Hint 3

Hint 4

Solution

Prompt Engineering / GenAI

def format_instructions(raw_text):
    # Split raw text into sentences
    sentences = raw_text.split('. ')
    formatted = []
    step_num = 1
    for sentence in sentences:
        sentence = sentence.strip()
        if sentence.lower().startswith(('first', 'second', 'then', 'next', 'finally')):
            formatted.append(f"{step_num}. {sentence}.")
            step_num += 1
        elif any(word in sentence.lower() for word in ['list', 'items', 'tips']):
            # Example bullet points
            formatted.append("- " + sentence + ".")
        else:
            formatted.append(sentence + ".")
    return '\n'.join(formatted)

# Example usage
raw_instructions = "First open the app then select the menu. Next choose the settings option. Here is a list of tips to improve performance. Finally save your changes."
print(format_instructions(raw_instructions))

Added numbered steps for sequential instructions.

Inserted bullet points for lists or tips.

Separated sentences with line breaks for clarity.

Kept sentences short and simple.

Results Interpretation

Before: Clarity 60%, Comprehension 55%
After: Clarity 88%, Comprehension 82%

Proper formatting of instructions using numbering, bullet points, and line breaks greatly improves user understanding without changing the content.

Bonus Experiment

Try using natural language generation techniques to automatically detect and format instructions from raw text.

💡 Hint

Use simple keyword detection and sentence segmentation to identify steps and lists, then apply formatting rules.

Practice

1. What is the main purpose of instruction formatting when interacting with an AI?

easy

A. To help the AI understand your request clearly

B. To make the AI run faster

C. To change the AI's programming language

D. To limit the AI's response length

Solution

1. Step 1: Understand the role of instruction formatting

   Instruction formatting is about how you write your request to the AI so it understands what you want.

2. Step 2: Identify the correct purpose

   The main goal is to make the AI understand your request clearly, not to affect speed or language.

3. Final Answer:

   To help the AI understand your request clearly -> Option A

4. Quick Check:

   Instruction formatting = clear AI understanding [OK]

Hint: Think: Why do I write instructions clearly? To be understood [OK]

Common Mistakes:

• Confusing formatting with AI speed
• Thinking it changes AI's programming
• Assuming it limits response length

2. Which of the following is the correct way to format an instruction for an AI to write a short story about a dog?

easy

A. Story dog short please write quickly

B. dog story short write

C. Write a short story about a dog.

D. Write dog story short and fast

Solution

1. Step 1: Check clarity and grammar

   Write a short story about a dog. is a clear, simple sentence that tells the AI exactly what to do.

2. Step 2: Compare other options

   Options B, C, and D are unclear or awkward, making it hard for AI to understand.

3. Final Answer:

   Write a short story about a dog. -> Option C

4. Quick Check:

   Clear, simple sentence = Write a short story about a dog. [OK]

Hint: Choose the option with clear, complete sentences [OK]

Common Mistakes:

• Using incomplete or jumbled words
• Adding unnecessary words that confuse AI
• Ignoring sentence structure

3. Given the instruction: Summarize the following text in 2 sentences. What will the AI most likely produce?

medium

A. A detailed essay about the text

B. A summary in exactly two sentences

C. A list of keywords from the text

D. The original text repeated twice

Solution

1. Step 1: Understand the instruction

   The instruction asks for a summary limited to 2 sentences.

2. Step 2: Predict AI output

   The AI will produce a concise summary exactly in 2 sentences, not an essay or keywords.

3. Final Answer:

   A summary in exactly two sentences -> Option B

4. Quick Check:

   Instruction = summary in 2 sentences [OK]

Hint: Look for keywords like 'summarize' and '2 sentences' [OK]

Common Mistakes:

• Confusing summary with essay
• Expecting keywords instead of sentences
• Thinking AI repeats text

4. You gave the AI this instruction: Explain machine learning simple. The AI gives a confusing answer. What is the best fix?

medium

A. Make the instruction shorter.

B. Add more technical terms to the instruction.

C. Ask the AI to explain in a different language.

D. Change instruction to 'Explain machine learning in simple words.'

Solution

1. Step 1: Identify the problem with the instruction

   The original instruction is unclear and grammatically incomplete.

2. Step 2: Choose the clearer instruction

   Change instruction to 'Explain machine learning in simple words.' improves clarity by adding 'in simple words', making it easier for AI to understand.

3. Final Answer:

   Change instruction to 'Explain machine learning in simple words.' -> Option D

4. Quick Check:

   Clear, complete instruction = Change instruction to 'Explain machine learning in simple words.' [OK]

Hint: Make instructions clear and grammatically correct [OK]

Common Mistakes:

• Adding confusing technical terms
• Shortening instructions too much
• Changing language without reason

5. You want the AI to generate a list of 5 healthy breakfast ideas with calories under 300 each. Which instruction is best formatted?

hard

A. List 5 healthy breakfast ideas with calories under 300 each, including ingredients.

B. Give me breakfast ideas.

C. List 5 breakfast foods.

D. Tell me about healthy food.

Solution

1. Step 1: Identify key details needed

   The instruction must specify number, healthiness, calorie limit, and ingredients.

2. Step 2: Compare options for completeness

   List 5 healthy breakfast ideas with calories under 300 each, including ingredients. includes all details clearly; others are too vague or incomplete.

3. Final Answer:

   List 5 healthy breakfast ideas with calories under 300 each, including ingredients. -> Option A

4. Quick Check:

   Complete, detailed instruction = List 5 healthy breakfast ideas with calories under 300 each, including ingredients. [OK]

Hint: Include all details clearly in your instruction [OK]

Common Mistakes:

• Giving vague or incomplete instructions
• Missing calorie or quantity details
• Not specifying required output format