Chat completions endpoint in Prompt Engineering / GenAI - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the purpose of the Chat completions endpoint in generative AI?

It generates conversational responses based on the input messages, allowing AI to chat naturally with users.

beginner

What kind of input does the Chat completions endpoint expect?

It expects a list of messages, each with a role (like 'user' or 'assistant') and content (the text to process).

beginner

How does the Chat completions endpoint return its output?

It returns a completion object containing the AI's reply message, usually with the role 'assistant' and the generated text.

intermediate

Why is specifying the 'model' important when calling the Chat completions endpoint?

Because different models have different capabilities and sizes, choosing the right one affects response quality and speed.

beginner

What is a common use case for the Chat completions endpoint?

Building chatbots, virtual assistants, or any application that needs natural, conversational AI responses.

What role is typically assigned to the AI's response in the Chat completions endpoint?

A moderator

B user

C system

D assistant

The AI's replies are labeled with the role 'assistant' to distinguish them from user or system messages.

Which of the following is NOT part of the input to the Chat completions endpoint?

A User's IP address

B Model name

C List of messages

D Temperature setting

User's IP address is not required input for generating chat completions.

What does the 'temperature' parameter control in the Chat completions endpoint?

A The speed of response

B The randomness of the output

C The length of the response

D The language of the response

Temperature controls how random or creative the AI's responses are.

Which message role can be used to guide the AI's behavior in the conversation?

A assistant

B user

C system

D observer

The 'system' role is used to set instructions or context for the AI.

What is the typical format of the response from the Chat completions endpoint?

A A JSON object with choices containing messages

B A single string of text

C An image file

D A CSV file

The response is a JSON object with a 'choices' array, each containing a message with role and content.

Explain how the Chat completions endpoint processes input messages and generates a response.

Think about how a conversation flows between user and AI.

Describe the role of the 'system' message in the Chat completions endpoint.

It’s like giving the AI a role or rules before chatting.