Handling follow-up questions in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ component_behavior

intermediate

How does LangChain handle follow-up questions in a conversation?

In LangChain, when a user asks a follow-up question, how does the framework typically maintain context to provide a relevant answer?

A By resetting the conversation state after each question to avoid confusion.

B By storing previous conversation turns in a memory component and passing it to the language model for context.

C By ignoring previous questions and only processing the current input.

D By using a separate language model instance for each question without sharing context.

💡 Hint

Think about how memory helps keep track of what was said before.

LangChain uses memory components to keep track of previous conversation turns. This memory is passed along with the new question to the language model, allowing it to understand the context and answer follow-up questions properly.

❓ state_output

intermediate

What is the output when using ConversationBufferMemory in LangChain?

Consider a LangChain conversation using ConversationBufferMemory. After asking two questions, what does the memory contain?

LangChain

from langchain.memory import ConversationBufferMemory
memory = ConversationBufferMemory()
memory.save_context({'input': 'What is AI?'}, {'output': 'AI is artificial intelligence.'})
memory.save_context({'input': 'Who created AI?'}, {'output': 'AI was created by many researchers.'})
print(memory.load_memory_variables({})['chat_history'])

A "AI is artificial intelligence. AI was created by many researchers."

B "What is AI? AI is artificial intelligence. Who created AI? AI was created by many researchers."

C "Human: What is AI?\nAI: AI is artificial intelligence.\nHuman: Who created AI?\nAI: AI was created by many researchers.\n"

D "Human: What is AI? AI was created by many researchers."

💡 Hint

Look for the format that includes both questions and answers labeled clearly.

The ConversationBufferMemory stores the conversation as a string buffer with clear labels for human input and AI output. It keeps all previous turns in order.

📝 Syntax

advanced

Identify the syntax error in this LangChain follow-up handling code

Which option contains a syntax error when trying to initialize a ConversationChain with memory for follow-up questions?

LangChain

from langchain.chains import ConversationChain
from langchain.memory import ConversationBufferMemory

memory = ConversationBufferMemory()
chain = ConversationChain(llm=llm, memory=memory)
response = chain.run('What is LangChain?')

A chain = ConversationChain(llm=llm memory=ConversationBufferMemory())

B ))(yromeMreffuBnoitasrevnoC=yromem ,mll=mll(niahCnoitasrevnoC = niahc

C chain = ConversationChain(llm=llm, memory=ConversationBufferMemory)

D chain = ConversationChain(llm=llm, memory=ConversationBufferMemory())

💡 Hint

Check for missing commas between arguments.

Option A is missing a comma between the llm and memory arguments, causing a syntax error.

🔧 Debug

advanced

Why does the follow-up question lose context in this LangChain example?

Given this code snippet, why does the follow-up question not get answered correctly? memory = ConversationBufferMemory() chain = ConversationChain(llm=llm, memory=memory) chain.run('What is Python?') chain = ConversationChain(llm=llm) chain.run('Who created it?')

A The memory object is not shared between chain runs, so context is lost.

B The ConversationChain does not support follow-up questions by design.

C The llm variable is not defined, causing the chain to fail silently.

D The memory buffer is cleared after each run automatically.

💡 Hint

Think about how the memory object is used across calls.

If the memory object is not the same instance or not properly passed, the chain loses previous conversation context, causing follow-up questions to fail.

🧠 Conceptual

expert

What is the main advantage of using LangChain's memory for follow-up questions?

Why is using a memory component in LangChain important when handling follow-up questions in a multi-turn conversation?

A It prevents the language model from generating any new content, only repeating previous answers.

B It speeds up the language model by caching all previous outputs locally.

C It automatically translates follow-up questions into multiple languages for better understanding.

D It allows the language model to access previous conversation history, enabling coherent and context-aware responses.

💡 Hint

Think about how context helps in conversations.

Memory components store past conversation turns so the language model can generate answers that consider what was said before, making the conversation flow naturally.

Practice

1. What is the main purpose of handling follow-up questions in LangChain conversations?

easy

A. To speed up the response time by skipping context

B. To keep the conversation natural and connected by remembering context

C. To reset the conversation after every question

D. To avoid using any previous conversation history

Solution

1. Step 1: Understand conversation flow

   Handling follow-up questions means the system remembers previous messages to keep the chat natural.

2. Step 2: Identify the purpose of context

   Context helps the system answer related questions without losing track of the topic.

3. Final Answer:

   To keep the conversation natural and connected by remembering context -> Option B

4. Quick Check:

   Follow-up questions need context = A [OK]

Hint: Follow-up means remembering past chat context [OK]

Common Mistakes:

• Thinking follow-ups reset conversation
• Ignoring conversation history
• Assuming follow-ups speed up responses
• Believing context is not needed

2. Which LangChain class is commonly used to manage conversation history for follow-up questions?

easy

A. ConversationChain

B. TextSplitter

C. DocumentLoader

D. VectorStoreRetriever

Solution

1. Step 1: Recall LangChain components

   ConversationChain is designed to handle conversations and keep track of history.

2. Step 2: Match class to purpose

   TextSplitter and DocumentLoader are for documents, VectorStoreRetriever for searching, not conversation management.

3. Final Answer:

   ConversationChain -> Option A

4. Quick Check:

   ConversationChain manages chat history = B [OK]

Hint: ConversationChain handles chat history in LangChain [OK]

Common Mistakes:

• Confusing ConversationChain with document tools
• Choosing unrelated classes like TextSplitter
• Assuming VectorStoreRetriever manages conversations
• Mixing up class purposes

3. Given this code snippet using LangChain's ConversationChain:

from langchain.chains import ConversationChain
from langchain.llms import OpenAI

llm = OpenAI(temperature=0)
conv = ConversationChain(llm=llm)

response1 = conv.predict(input="What is AI?")
response2 = conv.predict(input="Can you explain more?")
print(response2)

What does response2 represent?

medium

A. An error because ConversationChain does not support multiple predicts

B. An answer to 'Can you explain more?' ignoring previous questions

C. An answer to 'Can you explain more?' using the context of 'What is AI?'

D. The same answer as response1 repeated

Solution

1. Step 1: Understand ConversationChain behavior

   ConversationChain keeps track of previous inputs and outputs to provide context-aware answers.

2. Step 2: Analyze the code flow

   response2 uses the previous question 'What is AI?' to answer 'Can you explain more?' with context.

3. Final Answer:

   An answer to 'Can you explain more?' using the context of 'What is AI?' -> Option C

4. Quick Check:

   ConversationChain uses history for follow-ups = C [OK]

Hint: ConversationChain.predict uses past chat context automatically [OK]

Common Mistakes:

• Assuming each predict is independent
• Expecting an error on multiple calls
• Thinking response2 repeats response1
• Ignoring conversation history

4. Identify the error in this LangChain code snippet for handling follow-up questions:

from langchain.chains import ConversationChain
from langchain.llms import OpenAI

llm = OpenAI(temperature=0)
conv = ConversationChain(llm=llm)

response1 = conv.predict(input="Hello, who won the world cup?")
response2 = conv.predict("Who scored the most goals?")
print(response2)

medium

A. The print statement is invalid syntax

B. ConversationChain cannot be called twice

C. OpenAI LLM requires temperature > 0

D. Missing 'input=' keyword in second predict call causes error

Solution

1. Step 1: Check method call syntax

   ConversationChain.predict expects a named argument 'input=...'. The second call misses this keyword.

2. Step 2: Understand consequences

   Without 'input=', Python raises a TypeError because the argument is positional but not expected.

3. Final Answer:

   Missing 'input=' keyword in second predict call causes error -> Option D

4. Quick Check:

   predict requires input= keyword = D [OK]

Hint: Always use input= keyword in predict calls [OK]

Common Mistakes:

• Calling predict without input= keyword
• Thinking ConversationChain disallows multiple calls
• Believing temperature=0 is invalid
• Assuming print syntax is wrong

5. You want to build a LangChain app that answers follow-up questions about a user's previous queries but resets context after 3 questions. Which approach best achieves this?

hard

A. Use ConversationChain and clear its memory after every 3 predictions

B. Create a new ConversationChain instance for each question

C. Use ConversationChain without clearing memory to keep all history

D. Use OpenAI directly without ConversationChain

Solution

1. Step 1: Understand requirement to reset context

   The app needs to keep context but reset after 3 questions to avoid long history.

2. Step 2: Choose method to reset memory

   ConversationChain supports memory clearing; clearing after 3 predictions resets context properly.

3. Step 3: Evaluate other options

   Creating new instances loses all context immediately; keeping all history ignores reset; using OpenAI directly lacks conversation memory.

4. Final Answer:

   Use ConversationChain and clear its memory after every 3 predictions -> Option A

5. Quick Check:

   Reset context by clearing ConversationChain memory = A [OK]

Hint: Clear ConversationChain memory to reset context after set questions [OK]

Common Mistakes:

• Recreating ConversationChain loses partial context
• Not resetting memory causes long context buildup
• Using OpenAI directly loses conversation flow
• Ignoring how to clear memory properly