Memory-augmented retrieval in LangChain - Mini Project: Build & Apply

Memory-augmented retrieval with LangChain

📖 Scenario: You are building a simple chatbot that remembers previous conversations to answer questions better. You will use LangChain's memory feature to store chat history and retrieve it during new queries.

🎯 Goal: Create a LangChain chatbot that uses memory to recall past messages and improve responses.

📋 What You'll Learn

Create a list called chat_history with two example messages

Create a variable called memory using ConversationBufferMemory

Create a ChatOpenAI instance called chat with model name gpt-3.5-turbo

Create a ConversationChain called conversation using chat and memory

💡 Why This Matters

🌍 Real World

Chatbots that remember past conversations provide better, more personalized answers. This is useful in customer support, virtual assistants, and interactive apps.

💼 Career

Understanding memory-augmented retrieval is key for building advanced conversational AI systems used in many tech companies.

1

Set up initial chat history

Create a list called chat_history with these two dictionaries exactly: {'role': 'user', 'content': 'Hello!'} and {'role': 'assistant', 'content': 'Hi! How can I help you?'}.

LangChain

# Create chat_history list with two messages
# Your code here

Hint

Use a Python list with two dictionaries inside. Each dictionary has keys 'role' and 'content'.

2

Create ConversationBufferMemory

Create a variable called memory by instantiating ConversationBufferMemory with memory_key='chat_history' and return_messages=True.

LangChain

chat_history = [
    {'role': 'user', 'content': 'Hello!'},
    {'role': 'assistant', 'content': 'Hi! How can I help you?'}
]
# Create memory using ConversationBufferMemory
# Your code here

Hint

Import ConversationBufferMemory from langchain.memory and create memory with the specified parameters.

3

Create ChatOpenAI instance

Create a variable called chat by instantiating ChatOpenAI with model_name='gpt-3.5-turbo'.

LangChain

from langchain.memory import ConversationBufferMemory
from langchain.chat_models import ChatOpenAI

chat_history = [
    {'role': 'user', 'content': 'Hello!'},
    {'role': 'assistant', 'content': 'Hi! How can I help you?'}
]
memory = ConversationBufferMemory(memory_key='chat_history', return_messages=True)
# Create chat instance with model_name 'gpt-3.5-turbo'
# Your code here

Hint

Import ChatOpenAI from langchain.chat_models and create chat with the given model name.

4

Create ConversationChain with memory

Create a variable called conversation by instantiating ConversationChain with llm=chat and memory=memory.

LangChain

from langchain.memory import ConversationBufferMemory
from langchain.chat_models import ChatOpenAI
from langchain.chains import ConversationChain

chat_history = [
    {'role': 'user', 'content': 'Hello!'},
    {'role': 'assistant', 'content': 'Hi! How can I help you?'}
]
memory = ConversationBufferMemory(memory_key='chat_history', return_messages=True)
chat = ChatOpenAI(model_name='gpt-3.5-turbo')
# Create ConversationChain with llm=chat and memory=memory
# Your code here

Hint

Import ConversationChain from langchain.chains and create conversation with the given parameters.

Practice

1. What is the main purpose of memory-augmented retrieval in langchain?

easy

A. To generate random answers without context

B. To speed up database queries without using memory

C. To delete old conversation data automatically

D. To combine stored memory with retrieval for context-aware responses

Solution

1. Step 1: Understand memory-augmented retrieval concept

   It is designed to use stored memory to improve retrieval results by adding context.

2. Step 2: Identify the purpose in langchain

   Langchain uses it to give smarter, context-aware answers by combining memory and retrieval.

3. Final Answer:

   To combine stored memory with retrieval for context-aware responses -> Option D

4. Quick Check:

   Memory + retrieval = context-aware answers [OK]

Hint: Memory-augmented means memory plus retrieval for smarter answers [OK]

Common Mistakes:

• Thinking it only speeds queries without memory
• Believing it deletes old data automatically
• Assuming it generates random answers

2. Which of the following is the correct way to initialize a memory-augmented retriever in langchain?

easy

A. retriever = MemoryRetriever(base_retriever, memory_store)

B. retriever = MemoryRetriever(memory=memory_store, retriever=base_retriever)

C. retriever = MemoryRetriever(memory_store, base_retriever)

D. retriever = MemoryRetriever()

Solution

1. Step 1: Check langchain retriever initialization pattern

   The MemoryRetriever requires named parameters for memory and retriever to work properly.

2. Step 2: Identify correct syntax

   retriever = MemoryRetriever(memory=memory_store, retriever=base_retriever) uses named parameters memory= and retriever= which matches the expected pattern.

3. Final Answer:

   retriever = MemoryRetriever(memory=memory_store, retriever=base_retriever) -> Option B

4. Quick Check:

   Use named args memory= and retriever= [OK]

Hint: Look for named parameters memory= and retriever= in constructor [OK]

Common Mistakes:

• Passing positional arguments instead of named
• Omitting required parameters
• Using empty constructor without arguments

3. Given this code snippet, what will be the output?

memory_store = SimpleMemory()
base_retriever = SomeRetriever()
retriever = MemoryRetriever(memory=memory_store, retriever=base_retriever)
response = retriever.get_relevant_documents('Hello')
print(response)

medium

A. A list of documents relevant to 'Hello' combined with memory context

B. An error because MemoryRetriever has no method get_relevant_documents

C. An empty list because memory_store is empty

D. A string 'Hello' printed directly

Solution

1. Step 1: Understand method get_relevant_documents

   MemoryRetriever wraps base_retriever and adds memory context to results.

2. Step 2: Analyze output of get_relevant_documents

   It returns a list of documents relevant to the query plus memory info, not an error or empty list.

3. Final Answer:

   A list of documents relevant to 'Hello' combined with memory context -> Option A

4. Quick Check:

   Retriever returns relevant docs with memory [OK]

Hint: MemoryRetriever adds memory context to base retriever results [OK]

Common Mistakes:

• Assuming method does not exist
• Expecting empty list if memory is empty
• Thinking output is a plain string

4. You wrote this code but get an AttributeError: 'MemoryRetriever' object has no attribute 'add_memory'. What is the likely cause?

retriever = MemoryRetriever(memory=memory_store, retriever=base_retriever)
retriever.add_memory('New info')

medium

A. You need to call add_memory on base_retriever, not MemoryRetriever

B. You forgot to import add_memory from langchain

C. MemoryRetriever does not have an add_memory method; memory_store should be updated instead

D. MemoryRetriever requires initialization with add_memory=True

Solution

1. Step 1: Check MemoryRetriever methods

   MemoryRetriever delegates memory management to the memory_store object, it does not have add_memory method itself.

2. Step 2: Correct usage for adding memory

   To add memory, call add_memory or equivalent on the memory_store instance, not on MemoryRetriever.

3. Final Answer:

   MemoryRetriever does not have an add_memory method; memory_store should be updated instead -> Option C

4. Quick Check:

   Add memory on memory_store, not retriever [OK]

Hint: Add memory to memory_store, not MemoryRetriever object [OK]

Common Mistakes:

• Trying to call add_memory on MemoryRetriever
• Assuming add_memory is imported separately
• Thinking add_memory is a constructor option

5. You want to build a chatbot that remembers user preferences and uses them to improve answers. Which approach best uses memory-augmented retrieval in langchain to achieve this?

hard

A. Use a MemoryRetriever with a persistent memory store that updates with user inputs and a retriever querying relevant documents

B. Use only a retriever without memory to keep responses fast and simple

C. Store user preferences in a separate database and never integrate with retriever

D. Use MemoryRetriever but reset memory after every user message to avoid stale data

Solution

1. Step 1: Identify chatbot memory needs

   The chatbot must remember user preferences persistently to improve answers over time.

2. Step 2: Choose correct memory-augmented retrieval setup

   Using MemoryRetriever with persistent memory store that updates with user inputs and a retriever for relevant docs fits this need best.

3. Final Answer:

   Use a MemoryRetriever with a persistent memory store that updates with user inputs and a retriever querying relevant documents -> Option A

4. Quick Check:

   Persistent memory + retriever = smart chatbot [OK]

Hint: Combine persistent memory with retriever for smart chatbots [OK]

Common Mistakes:

• Ignoring memory and using only retriever
• Separating preferences without integration
• Resetting memory each message losing context