Message roles (system, user, assistant) in Prompt Engineering / GenAI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Understanding the role of the system message

In a chat-based AI model, what is the primary purpose of the system message role?

A To provide instructions and set the behavior of the AI assistant

B To generate the AI's responses to the user

C To ask questions and provide user input to the AI

D To store conversation history for later analysis

💡 Hint

Think about who controls the AI's style and rules.

The system message sets the context and rules for the AI assistant, guiding how it should respond throughout the conversation.

❓ Predict Output

intermediate

Output of a chat message sequence

Given the following chat messages, what will the AI assistant reply? Messages: 1. System: "You are a helpful assistant." 2. User: "What is 2 + 2?" Assuming the AI correctly follows instructions, what is the assistant's reply?

A "I don't know."

B "2 + 2 equals 22."

C "Please provide more details."

D "4"

💡 Hint

The system message says the AI is helpful.

The AI assistant follows the system instruction to be helpful and answers the math question correctly with "4".

❓ Model Choice

advanced

Choosing the correct message role for user input

When sending a message to a chat AI model, which message role should be used to represent the human asking questions or giving commands?

A user

B system

C assistant

D moderator

💡 Hint

Think about who is talking to the AI.

The 'user' role represents the human interacting with the AI by asking questions or giving commands.

❓ Metrics

advanced

Evaluating assistant message quality

Which metric best measures how well the assistant messages follow the instructions given in the system message?

A Perplexity on training data

B Number of tokens generated

C Instruction adherence score from human evaluation

D Model size in parameters

💡 Hint

Think about measuring if the AI listens to the system message.

Instruction adherence score from human evaluation directly measures how well the assistant follows system instructions.

🔧 Debug

expert

Identifying the cause of incorrect assistant behavior

A developer notices the AI assistant ignores the system message instructions and gives unrelated answers. Which is the most likely cause?

A The user message was too short

B The system message was not included in the chat messages sent to the model

C The assistant message role was used for user input

D The model size is too large

💡 Hint

Check if the AI received the instructions at all.

If the system message is missing, the AI has no instructions to follow and may respond incorrectly.