Metadata filtering in vector stores in LangChain - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is metadata filtering in vector stores?

Metadata filtering is a way to narrow down search results in vector stores by using extra information (metadata) attached to each vector, like tags or categories, to find more relevant matches.

beginner

Why use metadata filtering with vector search?

It helps find results that not only match by similarity but also meet specific criteria, like date, type, or author, making searches more precise and useful.

intermediate

How do you apply metadata filters in LangChain vector stores?

You pass a filter object with key-value pairs describing the metadata conditions when querying the vector store, so only vectors matching those conditions are returned.

intermediate

Give an example of a metadata filter in LangChain.

For example, to find documents tagged with 'finance' and created after 2023, you might use a filter like {"category": "finance", "year": {"$gt": 2023}} when querying.

beginner

What happens if you don’t use metadata filtering in vector stores?

You get results based only on vector similarity, which might include irrelevant items because they don’t meet any extra criteria you care about.

What does metadata filtering in vector stores help you do?

A Find vectors matching specific extra information

B Increase vector size for better accuracy

C Remove duplicates from the vector store

D Automatically update vector embeddings

Metadata filtering helps find vectors that match specific extra information like tags or categories.

In LangChain, how do you specify metadata filters when querying?

A By increasing the number of returned results

B By changing the vector dimension

C By sorting vectors alphabetically

D By passing a filter object with key-value pairs

You specify metadata filters by passing a filter object with key-value pairs describing the conditions.

Which of these is NOT a benefit of metadata filtering?

A More precise search results

B Faster vector embedding computation

C Filtering by categories or dates

D Reducing irrelevant matches

Metadata filtering does not affect how fast embeddings are computed; it filters search results.

What might happen if you skip metadata filtering in a vector search?

A You get only exact keyword matches

B The vector store deletes all data

C You get results based only on similarity, possibly irrelevant

D The search returns no results

Without metadata filtering, results are based only on similarity and may include irrelevant items.

Which metadata filter example is valid in LangChain?

A {"category": "finance", "year": {"$gt": 2023}}

B {"vector_size": 512}

C {"embedding": "text"}

D {"sort": "ascending"}

This example shows filtering by category and year, which is a valid metadata filter.

Explain how metadata filtering improves vector search results in LangChain.

Think about how adding conditions like tags or dates helps find better matches.

Describe the steps to apply a metadata filter when querying a vector store in LangChain.

Focus on how you tell the vector store what extra info to match.

Practice

1. What is the main purpose of metadata filtering in vector stores?

easy

A. To delete irrelevant data from the vector store

B. To increase the size of the vector store

C. To speed up vector calculations without filtering

D. To narrow search results using extra information about data

Solution

1. Step 1: Understand metadata filtering concept

   Metadata filtering uses extra information (metadata) to limit search results to relevant items.

2. Step 2: Identify the main purpose

   The main goal is to narrow down results, not to delete data or speed up calculations without filtering.

3. Final Answer:

   To narrow search results using extra information about data -> Option D

4. Quick Check:

   Metadata filtering = Narrow search results [OK]

Hint: Metadata filters results by extra info, not by size or speed [OK]

Common Mistakes:

• Confusing filtering with deleting data
• Thinking metadata speeds up vector math alone
• Believing filtering increases store size

2. Which of the following is the correct way to apply metadata filtering in a Langchain vector store search?

easy

A. search(query, filter=[('category', 'news')])

B. search(query, filter='category=news')

C. search(query, filter={'category': 'news'})

D. search(query, filter='category:news')

Solution

1. Step 1: Recall correct filter syntax

   Langchain expects a dictionary for metadata filtering, e.g., {'key': 'value'}.

2. Step 2: Match syntax to options

   Only search(query, filter={'category': 'news'}) uses a dictionary correctly; others use strings or lists incorrectly.

3. Final Answer:

   search(query, filter={'category': 'news'}) -> Option C

4. Quick Check:

   Filter syntax = dictionary format [OK]

Hint: Use dictionary for filters: filter={'key': 'value'} [OK]

Common Mistakes:

• Using string instead of dictionary for filter
• Passing list of tuples instead of dict
• Using colon syntax inside string

3. Given this code snippet using Langchain vector store:

results = vector_store.search('climate change', filter={'source': 'news', 'year': 2023})
print(len(results))

If the vector store has 10 documents with source 'news' and year 2023, and 5 with source 'news' but year 2022, what will be printed?

medium

A. 15

B. 10

C. 5

D. 0

Solution

1. Step 1: Understand filter effect

   The filter requires both 'source' = 'news' and 'year' = 2023 to match.

2. Step 2: Count matching documents

   Only 10 documents match both conditions; 5 with year 2022 do not match.

3. Final Answer:

   10 -> Option B

4. Quick Check:

   Filter matches 10 docs with both conditions [OK]

Hint: Filter matches all conditions exactly, not partial [OK]

Common Mistakes:

• Counting documents matching only one filter key
• Ignoring year condition
• Assuming filter returns all 'news' documents

4. You wrote this code but get an error:

results = vector_store.search('AI', filter=['category', 'tech'])

What is the main problem causing the error?

medium

A. Filter should be a dictionary, not a list

B. Search query must be a dictionary

C. Filter keys must be integers

D. Filter cannot be used with string queries

Solution

1. Step 1: Check filter type

   The filter parameter expects a dictionary with key-value pairs.

2. Step 2: Identify incorrect usage

   The code uses a list instead of a dictionary, causing a type error.

3. Final Answer:

   Filter should be a dictionary, not a list -> Option A

4. Quick Check:

   Filter type must be dict, not list [OK]

Hint: Always use dict for filter, not list or other types [OK]

Common Mistakes:

• Passing list instead of dict for filter
• Thinking query must be dict
• Believing filter keys must be numbers

5. You want to find documents in a Langchain vector store about 'machine learning' but only from the year 2022 or later, and with the tag 'tutorial'. Which filter dictionary correctly applies this condition?

hard

A. {'tag': 'tutorial', 'year': {'$gte': 2022}}

B. {'tag': 'tutorial', 'year': 2022}

C. {'tag': ['tutorial'], 'year': 2022}

D. {'tag': 'tutorial', 'year': [2022, 2023, 2024]}

Solution

1. Step 1: Understand filtering for range conditions

   To filter for year 2022 or later, a comparison operator like '$gte' (greater than or equal) is needed.

2. Step 2: Analyze options for correct syntax

   {'tag': 'tutorial', 'year': {'$gte': 2022}} uses {'year': {'$gte': 2022}} which correctly expresses the condition; others do not support range filtering properly.

3. Final Answer:

   {'tag': 'tutorial', 'year': {'$gte': 2022}} -> Option A

4. Quick Check:

   Use comparison operators for range filters [OK]

Hint: Use {'key': {'$gte': value}} for filtering ranges [OK]

Common Mistakes:

• Using exact value instead of range operator
• Passing list instead of operator for year
• Misunderstanding how to filter numeric ranges