What tokens and context windows mean in AI for Everyone - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a token in AI language models?

A token is a small piece of text, like a word or part of a word, that AI models use to understand and generate language.

beginner

What does a context window refer to in AI models?

A context window is the amount of text an AI model can look at and remember at one time to understand or generate responses.

beginner

Why do AI models use tokens instead of whole sentences?

Tokens break text into smaller parts so the AI can process language step-by-step, making it easier to understand and generate text.

intermediate

How does the size of the context window affect AI performance?

A larger context window lets the AI consider more text at once, helping it understand longer conversations or documents better.

beginner

Can AI models remember everything from a long conversation?

No, AI models can only remember what fits inside their context window, so very long conversations may lose earlier details.

What is a token in AI language models?

A A small piece of text like a word or part of a word

B A whole paragraph of text

C A type of computer hardware

D A programming language

Tokens are small text pieces that AI models use to process language.

What does the context window limit in AI models?

A The size of the AI's hard drive

B The number of users the AI can serve

C The speed of the internet connection

D The number of tokens the model can consider at once

The context window limits how many tokens the AI can look at and remember at one time.

Why do AI models split text into tokens?

A To delete unnecessary words

B To process language step-by-step more easily

C To translate text into images

D To make text longer

Splitting text into tokens helps AI understand and generate language more effectively.

What happens if a conversation is longer than the AI's context window?

A The AI will stop responding

B The AI will remember everything perfectly

C The AI may forget earlier parts of the conversation

D The AI will speed up

AI can only remember what fits in its context window, so very long conversations may lose earlier details.

How does increasing the context window size help AI?

A It helps the AI understand longer texts better

B It makes the AI slower

C It reduces the AI's memory

D It changes the AI's language

A larger context window lets AI consider more text at once, improving understanding.

Explain what tokens are and why AI models use them.

Think about how breaking text into parts helps AI understand language.

Describe what a context window is and how it affects AI's ability to remember text.

Consider how much text the AI can see at once.