Streaming responses in Prompt Engineering / GenAI - Interactive Code Practice

Practice - 5 Tasks

1fill in blank

easy

Complete the code to start streaming the AI model's response.

Prompt Engineering / GenAI

response = model.generate_stream(prompt=[1])

Drag options to blanks, or click blank then click option'

Atext

Binput_text

Cprompt

Dquery

Attempts:

3 left

💡 Hint

Common Mistakes

Using variable names like 'text' or 'query' which are not defined in this context.

The method generate_stream requires the prompt parameter to specify the input text for streaming the response.

2fill in blank

medium

Complete the code to read the streamed tokens from the response.

Prompt Engineering / GenAI

for token in response.[1]():
    print(token)

Drag options to blanks, or click blank then click option'

Astream_tokens

Bstream

Citer_tokens

Dread

Attempts:

3 left

💡 Hint

Common Mistakes

Using generic method names like 'read' or 'stream' which do not exist.

The method stream_tokens() is used to iterate over tokens as they are streamed from the model.

3fill in blank

hard

Fix the error in the code to properly handle streaming with a callback function.

Prompt Engineering / GenAI

def on_token(token):
    print(token)

model.generate_stream(prompt=prompt, [1]=on_token)

Drag options to blanks, or click blank then click option'

Acallback

Bon_token

Cstream_callback

Dtoken_handler

Attempts:

3 left

💡 Hint

Common Mistakes

Passing the function with incorrect parameter names like 'on_token' or 'token_handler'.

The parameter to pass a function to handle tokens during streaming is commonly named 'callback'.

4fill in blank

hard

Fill both blanks to correctly initialize streaming with a timeout and a callback.

Prompt Engineering / GenAI

response = model.generate_stream(prompt=prompt, [1]=5, [2]=handle_token)

Drag options to blanks, or click blank then click option'

Atimeout

Bmax_tokens

Ccallback

Dstream

Attempts:

3 left

💡 Hint

Common Mistakes

Confusing 'max_tokens' with 'timeout' or using wrong parameter names.

The 'timeout' parameter sets the max wait time, and 'callback' is the function to handle tokens during streaming.

5fill in blank

hard

Fill both blanks to collect streamed tokens into a string with a callback and print final output.

Prompt Engineering / GenAI

collected = []
def collect_token(token):
    collected.[1](token)

model.generate_stream(prompt=prompt, [2]=collect_token)
print(''.join(collected))

Drag options to blanks, or click blank then click option'

Aappend

Bcallback

D.strip()

Attempts:

3 left

💡 Hint

Common Mistakes

Using wrong list method like 'extend' or adding extra string methods after join.

Use 'append' to add tokens to the list, 'callback' to pass the function, and no extra method after join to print raw output.

Practice

1. What is the main benefit of using streaming responses in AI applications?

easy

A. They store all data before sending it to the user.

B. They require no internet connection to work.

C. They increase the total data size sent to the user.

D. They send data bit by bit as it is ready, reducing wait time.

Solution

1. Step 1: Understand streaming response behavior

   Streaming responses send data in small parts as soon as they are ready, instead of waiting for the whole response.

2. Step 2: Identify the user experience impact

   This reduces the waiting time for users, improving their experience by showing partial results quickly.

3. Final Answer:

   They send data bit by bit as it is ready, reducing wait time. -> Option D

4. Quick Check:

   Streaming = send data bit by bit [OK]

Hint: Streaming means sending data bit by bit, not all at once [OK]

Common Mistakes:

• Thinking streaming sends all data at once
• Confusing streaming with offline processing
• Assuming streaming increases data size

2. Which Python code snippet correctly enables streaming when calling an AI model?

easy

A. response = model.generate(prompt, stream=True)

B. response = model.generate(prompt, stream=False)

C. response = model.generate(prompt, streaming=1)

D. response = model.generate(prompt, stream='yes')

Solution

1. Step 1: Identify correct parameter for streaming

   The correct parameter to enable streaming is stream=True.

2. Step 2: Check other options for correctness

   stream=False disables streaming, while streaming=1 and stream='yes' use incorrect parameter names or values.

3. Final Answer:

   response = model.generate(prompt, stream=True) -> Option A

4. Quick Check:

   stream=True enables streaming [OK]

Hint: Use stream=True to enable streaming in model calls [OK]

Common Mistakes:

• Using stream=False disables streaming
• Using wrong parameter names like streaming
• Passing string instead of boolean for stream

3. Given this Python code snippet, what will be printed?

response = model.generate(prompt, stream=True)
for chunk in response:
    print(chunk)

medium

A. Only the last chunk of the response printed.

B. All output printed at once after generation completes.

C. Each chunk of the response printed one by one as received.

D. No output printed because streaming is disabled.

Solution

1. Step 1: Understand the for loop over streaming response

   When stream=True, the response is an iterable that yields chunks as they arrive.

2. Step 2: Explain the print behavior inside the loop

   The loop prints each chunk immediately, so output appears chunk by chunk.

3. Final Answer:

   Each chunk of the response printed one by one as received. -> Option C

4. Quick Check:

   Loop over streaming prints chunks one by one [OK]

Hint: Looping over stream=True prints chunks as they arrive [OK]

Common Mistakes:

• Thinking output prints all at once
• Expecting only last chunk to print
• Assuming streaming is off by default

4. Identify the error in this code snippet for streaming responses:

response = model.generate(prompt, stream=True)
print(response)

medium

A. Streaming response must be looped over to get chunks, not printed directly.

B. The parameter should be stream=False to print response.

C. The model.generate method does not support streaming.

D. The prompt variable is missing.

Solution

1. Step 1: Understand streaming response type

   With stream=True, the response is an iterable, not a complete string.

2. Step 2: Explain why print(response) is incorrect

   Printing the iterable directly shows its object info, not the content chunks. You must loop over it to get data.

3. Final Answer:

   Streaming response must be looped over to get chunks, not printed directly. -> Option A

4. Quick Check:

   Print iterable directly shows object, loop to get data [OK]

Hint: Loop over streaming response; don't print it directly [OK]

Common Mistakes:

• Printing streaming response directly
• Setting stream=False to fix printing
• Assuming model.generate lacks streaming support

5. You want to display AI-generated text to users as soon as possible using streaming. Which approach correctly combines streaming with real-time display in Python?

hard

A. Use stream=True but collect all chunks in a list before printing.

B. Use stream=True and loop over response, printing each chunk immediately.

C. Set stream=False and print the full response after generation.

D. Disable streaming and use a timer to print partial results.

Solution

1. Step 1: Understand real-time display with streaming

   Streaming with stream=True allows receiving data chunks as they are generated.

2. Step 2: Explain how to display chunks immediately

   Looping over the response and printing each chunk immediately shows output in real time to users.

3. Step 3: Compare other options

   Using stream=True but collecting all chunks in a list before printing defeats real-time display. Setting stream=False waits for the full response. Using a timer without streaming is inefficient.

4. Final Answer:

   Use stream=True and loop over response, printing each chunk immediately. -> Option B

5. Quick Check:

   Stream=True + loop + print chunks = real-time display [OK]

Hint: Loop and print chunks immediately with stream=True for real-time [OK]

Common Mistakes:

• Waiting for full response before printing
• Collecting chunks before printing defeats streaming
• Disabling streaming and using timers