Open-source embedding models in LangChain - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ component_behavior

intermediate

Embedding Model Output Shape

Given the following LangChain code snippet using an open-source embedding model, what is the shape of the output vector for a single input text?

LangChain

from langchain.embeddings import HuggingFaceEmbeddings
embedding_model = HuggingFaceEmbeddings(model_name='sentence-transformers/all-MiniLM-L6-v2')
text = "Hello, world!"
vector = embedding_model.embed_query(text)
print(len(vector))

A 512

B 768

C 384

D 1024

💡 Hint

Check the model documentation for the output dimension of 'all-MiniLM-L6-v2'.

The 'sentence-transformers/all-MiniLM-L6-v2' model outputs embeddings of size 384. The embed_query method returns a vector of this length.

📝 Syntax

intermediate

Correct Initialization of Open-Source Embedding Model

Which option correctly initializes a HuggingFace embedding model in LangChain to use the 'all-MiniLM-L6-v2' model?

A embedding_model = HuggingFaceEmbeddings(model_name='sentence-transformers/all-MiniLM-L6-v2')

B embedding_model = HuggingFaceEmbeddings('sentence-transformers/all-MiniLM-L6-v2')

C embedding_model = HuggingFaceEmbeddings(model='all-MiniLM-L6-v2')

D embedding_model = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2')

💡 Hint

The parameter name for specifying the model is 'model_name'.

The HuggingFaceEmbeddings class requires the model_name keyword argument to specify the model. Passing the model name as a positional argument or using a different keyword will cause errors.

🔧 Debug

advanced

Error When Using Embedding Model with Missing Dependencies

You run this code snippet but get an ImportError related to 'transformers'. What is the cause?

LangChain

from langchain.embeddings import HuggingFaceEmbeddings
embedding_model = HuggingFaceEmbeddings(model_name='sentence-transformers/all-MiniLM-L6-v2')
vector = embedding_model.embed_query('Test input')

A The model name is incorrect and does not exist.

B The LangChain version is outdated and incompatible.

C The input text is empty, causing the error.

D The 'transformers' library is not installed in the environment.

💡 Hint

Check if the 'transformers' package is installed.

HuggingFace embedding models rely on the 'transformers' library. If it is not installed, importing or using the model raises ImportError.

❓ state_output

advanced

Embedding Vector Consistency Across Calls

If you call embed_query twice with the same input text on the same HuggingFace embedding model instance, what will be the relationship between the two output vectors?

LangChain

embedding_model = HuggingFaceEmbeddings(model_name='sentence-transformers/all-MiniLM-L6-v2')
vec1 = embedding_model.embed_query('Repeat this sentence')
vec2 = embedding_model.embed_query('Repeat this sentence')
print(vec1 == vec2)

A True, but only if the model is in training mode.

B True, because the model produces deterministic embeddings for the same input.

C False, because the model output depends on external state.

D False, because the model adds random noise each call.

💡 Hint

Embedding models usually produce the same output for the same input unless randomness is introduced.

Open-source embedding models like 'all-MiniLM-L6-v2' produce deterministic embeddings for the same input text when called multiple times.

🧠 Conceptual

expert

Choosing an Open-Source Embedding Model for Multilingual Support

Which open-source embedding model is best suited for generating embeddings that support multiple languages effectively in LangChain?

A sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2

B sentence-transformers/all-MiniLM-L6-v2

C bert-base-uncased

D gpt2

💡 Hint

Look for models with 'multilingual' in their name designed for multiple languages.

The 'sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2' model is trained to handle multiple languages well, making it suitable for multilingual embedding tasks.

Practice

1. What is the main purpose of open-source embedding models in Langchain?

easy

A. To generate images from text

B. To create user interfaces for apps

C. To store large databases efficiently

D. To convert text into numbers that computers can understand

Solution

1. Step 1: Understand embedding models

   Embedding models convert text into numerical vectors so computers can process meaning.

2. Step 2: Identify Langchain's role

   Langchain uses these models to help build language apps that understand text better.

3. Final Answer:

   To convert text into numbers that computers can understand -> Option D

4. Quick Check:

   Embedding models = convert text to numbers [OK]

Hint: Remember embeddings turn words into numbers [OK]

Common Mistakes:

• Confusing embeddings with UI design
• Thinking embeddings store data
• Mixing embeddings with image generation

2. Which code snippet correctly creates an embedding model instance using Langchain's open-source model?

easy

A. embedding = create_embedding('all-MiniLM-L6-v2')

B. embedding = OpenAIEmbeddings()

C. embedding = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2')

D. embedding = EmbeddingModel('OpenAI')

Solution

1. Step 1: Recall Langchain embedding syntax

   Langchain uses classes like HuggingFaceEmbeddings with a model_name parameter for open-source models.

2. Step 2: Check each option

   embedding = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2') matches the correct syntax for creating a HuggingFace embedding instance.

3. Final Answer:

   embedding = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2') -> Option C

4. Quick Check:

   Correct class and parameter = embedding = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2') [OK]

Hint: Look for class name and model_name parameter [OK]

Common Mistakes:

• Using OpenAIEmbeddings for open-source models
• Calling a non-existent create_embedding function
• Passing wrong arguments to constructors

3. What will be the output type when you run this code snippet in Langchain?

from langchain.embeddings import HuggingFaceEmbeddings
embedding = HuggingFaceEmbeddings(model_name='all-MiniLM-L6-v2')
vector = embedding.embed_query('Hello world')

medium

A. A dictionary with word counts

B. A list of numbers representing the text

C. A string with the original text

D. An error because embed_query is invalid

Solution

1. Step 1: Understand embed_query method

   The embed_query method converts input text into a vector, which is a list of numbers.

2. Step 2: Check output type

   The variable 'vector' will hold a list (array) of floats representing the text embedding.

3. Final Answer:

   A list of numbers representing the text -> Option B

4. Quick Check:

   embed_query output = list of numbers [OK]

Hint: embed_query returns numeric vectors, not strings [OK]

Common Mistakes:

• Expecting a string instead of numbers
• Thinking output is a dictionary
• Assuming embed_query method does not exist

4. Identify the error in this Langchain code using an open-source embedding model:

from langchain.embeddings import HuggingFaceEmbeddings
embedding = HuggingFaceEmbeddings('all-MiniLM-L6-v2')
vector = embedding.embed_query('Test')

medium

A. Missing model_name keyword argument in HuggingFaceEmbeddings constructor

B. embed_query method does not exist in HuggingFaceEmbeddings

C. The import statement is incorrect

D. The string 'Test' should be a list

Solution

1. Step 1: Check constructor usage

   HuggingFaceEmbeddings requires model_name as a keyword argument, not a positional argument.

2. Step 2: Verify method and import

   embed_query exists and import is correct; input can be a string.

3. Final Answer:

   Missing model_name keyword argument in HuggingFaceEmbeddings constructor -> Option A

4. Quick Check:

   Constructor needs model_name=... [OK]

Hint: Use model_name= when creating HuggingFaceEmbeddings [OK]

Common Mistakes:

• Passing model name as positional argument
• Thinking embed_query is missing
• Changing input type unnecessarily

5. You want to build a semantic search using Langchain with an open-source embedding model. Which approach correctly combines embeddings and a vector store?

hard

A. Create embeddings with HuggingFaceEmbeddings, then store vectors in FAISS for fast similarity search

B. Use OpenAIEmbeddings and store raw text in a SQL database

C. Generate embeddings with HuggingFaceEmbeddings and store them as plain text files

D. Use HuggingFaceEmbeddings without any vector store for search

Solution

1. Step 1: Understand semantic search components

   Semantic search needs embeddings to represent text and a vector store to find similar vectors quickly.

2. Step 2: Match correct tools

   HuggingFaceEmbeddings creates vectors; FAISS is a popular vector store for fast similarity search.

3. Step 3: Evaluate other options

   OpenAIEmbeddings is not open-source; storing raw text or plain files won't enable vector search; no vector store means no fast search.

4. Final Answer:

   Create embeddings with HuggingFaceEmbeddings, then store vectors in FAISS for fast similarity search -> Option A

5. Quick Check:

   Embedding + vector store = semantic search [OK]

Hint: Combine embeddings with vector store like FAISS [OK]

Common Mistakes:

• Using non-open-source embeddings
• Storing embeddings as plain text
• Skipping vector store for search