Streaming responses in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ component_behavior

intermediate

What is the output behavior of this LangChain streaming code?

Consider this LangChain code snippet that uses streaming to get partial outputs:

from langchain.llms import OpenAI
llm = OpenAI(streaming=True)
for token in llm.stream("Hello, how are you?"):
    print(token, end='')

What will this code do when run?

LangChain

from langchain.llms import OpenAI
llm = OpenAI(streaming=True)
for token in llm.stream("Hello, how are you?"):
    print(token, end='')

A Prints the full response only after the entire generation is done.

B Prints tokens one by one as they are generated, showing partial output in real time.

C Prints nothing because streaming=True disables output.

D Raises an error because 'stream' method does not exist on OpenAI instance.

💡 Hint

Streaming mode allows receiving tokens as they are generated.

When streaming=True, the stream method yields tokens as they are generated, so the code prints tokens one by one in real time.

📝 Syntax

intermediate

Which option correctly enables streaming in LangChain's OpenAI LLM?

You want to create an OpenAI LLM instance that streams output tokens. Which code snippet correctly enables streaming?

A llm = OpenAI(streaming=True)

B llm = OpenAI(enable_stream=True)

C llm = OpenAI(stream=True)

D llm = OpenAI(streaming_output=True)

💡 Hint

Check the official LangChain parameter name for streaming.

The correct parameter to enable streaming is streaming=True. Other options are invalid and cause errors.

❓ state_output

advanced

What is the final value of 'collected' after this streaming code?

Given this code snippet:

collected = ""
for token in llm.stream("Say hello"):
    collected += token
print(collected)

What will be printed?

LangChain

collected = ""
for token in llm.stream("Say hello"):
    collected += token
print(collected)

A The full generated response as a single string.

B Only the last token generated.

C An empty string because tokens are not concatenated.

D A list of tokens printed as a string.

💡 Hint

Tokens are concatenated in the loop into a string variable.

Each token is added to the string collected, so after the loop, collected contains the full response.

🔧 Debug

advanced

Why does this LangChain streaming code raise an error?

Look at this code:

llm = OpenAI(streaming=True)
response = llm("Hello")
for token in response:
    print(token)

Why does it raise an error?

LangChain

llm = OpenAI(streaming=True)
response = llm("Hello")
for token in response:
    print(token)

A Because the response is a string, not an iterable of tokens.

B Because streaming=True disables the call method.

C Because the 'for' loop syntax is invalid here.

D Because OpenAI requires an explicit 'stream' method call to stream tokens.

💡 Hint

Check how streaming tokens are accessed in LangChain.

When streaming=True, you must call llm.stream() to get an iterable of tokens. Calling llm() returns the full string, not a stream.

🧠 Conceptual

expert

What is the main advantage of using streaming responses in LangChain?

Why would a developer choose to use streaming responses when calling an LLM in LangChain?

A To automatically cache all responses for faster future calls.

B To reduce the total number of tokens generated by the model.

C To receive tokens as soon as they are generated, enabling real-time display and lower latency.

D To ensure the entire response is generated before any output is shown.

💡 Hint

Think about user experience and response speed.

Streaming allows tokens to be received and displayed immediately as they are generated, improving responsiveness and user experience.