Bird
Raised Fist0
Prompt Engineering / GenAIml~20 mins

Message roles (system, user, assistant) in Prompt Engineering / GenAI - ML Experiment: Train & Evaluate

Choose your learning style10 modes available
LearnWhyDeepModelTryChallengeExperimentRecallMetrics

Start learning this pattern below

Jump into concepts and practice - no test required

or
Recommended
Test this pattern10 questions across easy, medium, and hard to know if this pattern is strong
Experiment - Message roles (system, user, assistant)
Problem:You are building a chatbot using a generative AI model. The model uses three message roles: system, user, and assistant. The system message sets the behavior, the user message is the input, and the assistant message is the model's reply. Currently, the model responds well to user messages but sometimes ignores the system instructions, leading to inconsistent answers.
Current Metrics:User satisfaction score: 70%, Consistency score: 65%
Issue:The model does not consistently follow system instructions, causing lower consistency and user satisfaction.
Your Task
Improve the model's adherence to system instructions to increase consistency score to at least 85% while maintaining or improving user satisfaction above 75%.
Do not change the model architecture or training data.
Only modify how messages with roles are structured and sent to the model.
Hint 1
Hint 2
Hint 3
Solution
Prompt Engineering / GenAI
messages = [
    {"role": "system", "content": "You are a helpful assistant. Always follow the user's instructions carefully and provide clear, concise answers."},
    {"role": "user", "content": "Explain how photosynthesis works in simple terms."}
]

response = model.chat(messages=messages)
print(response.content)
Placed a clear and explicit system message at the start to guide the assistant's behavior.
Ensured the system message is the first message in the conversation list.
Simplified and emphasized instructions in the system message to improve adherence.
Results Interpretation

Before: User satisfaction 70%, Consistency 65%
After: User satisfaction 78%, Consistency 87%

Proper use and placement of system messages significantly improves the model's ability to follow instructions, leading to better consistency and user satisfaction.
Bonus Experiment
Try adding multiple system messages with different instructions and observe how the model prioritizes them.
💡 Hint
Experiment with combining or splitting instructions across system messages and see which approach yields clearer assistant behavior.

Practice

(1/5)
1. What is the main purpose of the system role in AI chat messages?
easy
A. To store conversation history
B. To provide user input or questions
C. To set instructions and guide the AI's behavior
D. To display the AI's answers

Solution

  1. Step 1: Understand the roles in AI chat

    The system role is designed to give the AI instructions or context on how to respond.

  2. Step 2: Differentiate from other roles

    The user role is for input, and the assistant role is for AI output, so setting instructions fits the system role.

  3. Final Answer:

    To set instructions and guide the AI's behavior -> Option C

  4. Quick Check:

    System role = instructions [OK]
Hint: System role sets AI instructions, user inputs, assistant replies [OK]
Common Mistakes:
  • Confusing system role with user input
  • Thinking assistant role sets instructions
  • Assuming system role stores chat history
2. Which of the following is the correct way to represent a user message in a chat API call?
easy
A. {"role": "assistant", "content": "Hello!"}
B. {"role": "user", "content": "What is AI?"}
C. {"role": "system", "content": "You are helpful."}
D. {"role": "bot", "content": "I can help."}

Solution

  1. Step 1: Identify the role for user input

    The user messages must have the role set to "user" to indicate input from the person.

  2. Step 2: Check each option's role field

    {"role": "user", "content": "What is AI?"} uses "user" correctly, while others use "assistant", "system", or invalid "bot".

  3. Final Answer:

    {"role": "user", "content": "What is AI?"} -> Option B

  4. Quick Check:

    User role = "user" [OK]
Hint: User messages always have role "user" in JSON [OK]
Common Mistakes:
  • Using "bot" instead of "assistant" or "user"
  • Mixing system role with user messages
  • Forgetting to set the role field
3. Given this message list sent to an AI model:
[{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello!"}]

What role will the AI use to respond?
medium
A. system
B. user
C. moderator
D. assistant

Solution

  1. Step 1: Understand message roles in conversation

    The AI responds with messages having the role "assistant" to show its output.

  2. Step 2: Identify the role for AI replies

    Since the input messages include system and user roles, the AI's reply will be labeled as "assistant".

  3. Final Answer:

    assistant -> Option D

  4. Quick Check:

    AI replies use role "assistant" [OK]
Hint: AI responses always have role "assistant" [OK]
Common Mistakes:
  • Thinking AI replies use "system" role
  • Confusing user input role with AI output
  • Assuming unknown roles like "moderator"
4. You wrote this message list for an AI chat:
[{"role": "system", "content": "Be concise."}, {"role": "user", "content": "Explain AI."}, {"role": "user", "content": "Tell me more."}]

Why might the AI ignore the second user message?
medium
A. Because there are two user messages without an assistant reply in between
B. Because the system role is missing
C. Because the assistant role is used twice
D. Because the user messages are empty

Solution

  1. Step 1: Check message sequence rules

    AI expects alternating user and assistant messages; two user messages in a row can cause confusion.

  2. Step 2: Identify the problem in the message list

    Here, two user messages come one after another without an assistant reply, so the AI may ignore the second user message.

  3. Final Answer:

    Because there are two user messages without an assistant reply in between -> Option A

  4. Quick Check:

    Messages alternate user-assistant-user [OK]
Hint: User and assistant messages must alternate to avoid ignored inputs [OK]
Common Mistakes:
  • Thinking system role is missing
  • Assuming assistant role used twice
  • Believing empty messages cause ignoring
5. You want the AI to act as a friendly tutor and answer questions clearly. Which message list correctly sets this up before the user asks a question?
hard
A. [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}]
B. [{"role": "user", "content": "Explain math."}, {"role": "system", "content": "Be friendly and clear."}]
C. [{"role": "assistant", "content": "I will be friendly."}, {"role": "user", "content": "Explain math."}]
D. [{"role": "user", "content": "Explain math."}, {"role": "assistant", "content": "I will be friendly."}]

Solution

  1. Step 1: Place instructions in the system role

    Instructions for AI behavior must be in the system message before user input.

  2. Step 2: Check message order and roles

    [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}] correctly puts the system message first with instructions, then the user question.

  3. Final Answer:

    [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}] -> Option A

  4. Quick Check:

    System message first with instructions [OK]
Hint: Put AI instructions in system role before user messages [OK]
Common Mistakes:
  • Putting system message after user input
  • Using assistant role for instructions
  • Starting with user message without system context