Message roles (system, user, assistant) in Prompt Engineering / GenAI - Model Pipeline Trace

Model Pipeline - Message roles (system, user, assistant)

This pipeline shows how a generative AI model processes different message roles: system, user, and assistant. Each role guides the model to understand context, user input, and generate helpful responses.

Data Flow - 4 Stages

1Input messages

3 messages with role and content→Collect messages with roles: system, user, assistant→3 messages with role and content

[{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "What is AI?"}, {"role": "assistant", "content": "AI means artificial intelligence."}]

↓

2Preprocessing

3 messages with role and content→Convert messages into tokens and add role embeddings→Token sequences with role embeddings

Tokens for 'What is AI?' plus role info for 'user'

↓

3Model encoding

Token sequences with role embeddings→Process tokens through transformer layers to understand context→Contextual embeddings representing message meaning

Vector representations capturing 'What is AI?' in user context

↓

4Response generation

Contextual embeddings→Generate next tokens as assistant reply→Token sequence for assistant response

Tokens forming 'AI means artificial intelligence.'

Training Trace - Epoch by Epoch

Loss: 2.3 |\
       1.8 | \
       1.3 |  \
       0.9 |   \
       0.6 |    \__
         +----------------
          1  2  3  4  5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	2.3	0.25	Model starts learning basic message patterns
2	1.8	0.40	Model improves understanding of roles
3	1.3	0.55	Better context handling between system and user
4	0.9	0.70	Assistant responses become more relevant
5	0.6	0.80	Model converges with good role-based replies

Prediction Trace - 3 Layers

Layer 1: Input message encoding

Layer 2: Transformer encoding

Layer 3: Response generation

Model Quiz - 3 Questions

Which message role sets the overall behavior of the AI model?

A System

B User

C Assistant

D null

Key Insight

Understanding message roles helps the AI model respond appropriately by distinguishing instructions (system), questions (user), and answers (assistant). This role-based context improves conversation quality.

Practice

1. What is the main purpose of the system role in AI chat messages?

easy

A. To store conversation history

B. To provide user input or questions

C. To set instructions and guide the AI's behavior

D. To display the AI's answers

Solution

1. Step 1: Understand the roles in AI chat

   The system role is designed to give the AI instructions or context on how to respond.

2. Step 2: Differentiate from other roles

   The user role is for input, and the assistant role is for AI output, so setting instructions fits the system role.

3. Final Answer:

   To set instructions and guide the AI's behavior -> Option C

4. Quick Check:

   System role = instructions [OK]

Hint: System role sets AI instructions, user inputs, assistant replies [OK]

Common Mistakes:

• Confusing system role with user input
• Thinking assistant role sets instructions
• Assuming system role stores chat history

2. Which of the following is the correct way to represent a user message in a chat API call?

easy

A. {"role": "assistant", "content": "Hello!"}

B. {"role": "user", "content": "What is AI?"}

C. {"role": "system", "content": "You are helpful."}

D. {"role": "bot", "content": "I can help."}

Solution

1. Step 1: Identify the role for user input

   The user messages must have the role set to "user" to indicate input from the person.

2. Step 2: Check each option's role field

   {"role": "user", "content": "What is AI?"} uses "user" correctly, while others use "assistant", "system", or invalid "bot".

3. Final Answer:

   {"role": "user", "content": "What is AI?"} -> Option B

4. Quick Check:

   User role = "user" [OK]

Hint: User messages always have role "user" in JSON [OK]

Common Mistakes:

• Using "bot" instead of "assistant" or "user"
• Mixing system role with user messages
• Forgetting to set the role field

3. Given this message list sent to an AI model:

[{"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": "Hello!"}]

What role will the AI use to respond?

medium

A. system

B. user

C. moderator

D. assistant

Solution

1. Step 1: Understand message roles in conversation

   The AI responds with messages having the role "assistant" to show its output.

2. Step 2: Identify the role for AI replies

   Since the input messages include system and user roles, the AI's reply will be labeled as "assistant".

3. Final Answer:

   assistant -> Option D

4. Quick Check:

   AI replies use role "assistant" [OK]

Hint: AI responses always have role "assistant" [OK]

Common Mistakes:

• Thinking AI replies use "system" role
• Confusing user input role with AI output
• Assuming unknown roles like "moderator"

4. You wrote this message list for an AI chat:

[{"role": "system", "content": "Be concise."}, {"role": "user", "content": "Explain AI."}, {"role": "user", "content": "Tell me more."}]

Why might the AI ignore the second user message?

medium

A. Because there are two user messages without an assistant reply in between

B. Because the system role is missing

C. Because the assistant role is used twice

D. Because the user messages are empty

Solution

1. Step 1: Check message sequence rules

   AI expects alternating user and assistant messages; two user messages in a row can cause confusion.

2. Step 2: Identify the problem in the message list

   Here, two user messages come one after another without an assistant reply, so the AI may ignore the second user message.

3. Final Answer:

   Because there are two user messages without an assistant reply in between -> Option A

4. Quick Check:

   Messages alternate user-assistant-user [OK]

Hint: User and assistant messages must alternate to avoid ignored inputs [OK]

Common Mistakes:

• Thinking system role is missing
• Assuming assistant role used twice
• Believing empty messages cause ignoring

5. You want the AI to act as a friendly tutor and answer questions clearly. Which message list correctly sets this up before the user asks a question?

hard

A. [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}]

B. [{"role": "user", "content": "Explain math."}, {"role": "system", "content": "Be friendly and clear."}]

C. [{"role": "assistant", "content": "I will be friendly."}, {"role": "user", "content": "Explain math."}]

D. [{"role": "user", "content": "Explain math."}, {"role": "assistant", "content": "I will be friendly."}]

Solution

1. Step 1: Place instructions in the system role

   Instructions for AI behavior must be in the system message before user input.

2. Step 2: Check message order and roles

   [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}] correctly puts the system message first with instructions, then the user question.

3. Final Answer:

   [{"role": "system", "content": "You are a friendly tutor. Answer clearly."}, {"role": "user", "content": "Explain math."}] -> Option A

4. Quick Check:

   System message first with instructions [OK]

Hint: Put AI instructions in system role before user messages [OK]

Common Mistakes:

• Putting system message after user input
• Using assistant role for instructions
• Starting with user message without system context