Sentence transformers in Prompt Engineering / GenAI - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

What is the main purpose of sentence transformers?

Sentence transformers are used to convert sentences into vectors. What is the main reason for doing this?

A To represent sentences as fixed-size numerical vectors for similarity comparison

B To translate sentences from one language to another

C To generate new sentences from a given input

D To count the number of words in a sentence

💡 Hint

Think about how computers understand text for tasks like search or clustering.

Sentence transformers convert sentences into fixed-size vectors so that similar sentences have vectors close to each other. This helps in tasks like semantic search and clustering.

❓ Predict Output

intermediate

Output of embedding similarity calculation

Given two sentences embedded using a sentence transformer, what is the cosine similarity output?

Prompt Engineering / GenAI

from sentence_transformers import SentenceTransformer
from sklearn.metrics.pairwise import cosine_similarity

model = SentenceTransformer('all-MiniLM-L6-v2')
sentences = ['I love machine learning.', 'Machine learning is great.']
embeddings = model.encode(sentences)
similarity = cosine_similarity([embeddings[0]], [embeddings[1]])[0][0]
print(round(similarity, 2))

A 0.15

B 0.85

C 1.00

D 0.50

💡 Hint

These sentences have similar meaning, so expect a high similarity but less than 1.

The cosine similarity between embeddings of similar sentences is close to 1 but not exactly 1. Here, it is about 0.85.

❓ Model Choice

advanced

Choosing the best sentence transformer model for large-scale semantic search

You want to build a semantic search engine that balances speed and accuracy on millions of sentences. Which sentence transformer model is best?

A 'all-MiniLM-L6-v2' for fast and reasonably accurate embeddings

B 'bert-base-uncased' for the most accurate embeddings but slower speed

C 'distilbert-base-uncased' for the smallest model but less accuracy

D 'gpt-3' for generating embeddings with zero-shot learning

💡 Hint

Consider the trade-off between speed and accuracy for large datasets.

'all-MiniLM-L6-v2' is optimized for fast embedding generation with good accuracy, making it suitable for large-scale semantic search.

❓ Hyperparameter

advanced

Effect of changing pooling strategy in sentence transformers

Sentence transformers use pooling to create sentence embeddings from token embeddings. What happens if you change from mean pooling to max pooling?

A Max pooling always improves embedding quality regardless of task

B Max pooling averages all token embeddings, smoothing the sentence representation

C Max pooling reduces embedding size by half compared to mean pooling

D Max pooling captures the most prominent features, possibly making embeddings more sensitive to key words

💡 Hint

Think about how max pooling selects values compared to averaging.

Max pooling picks the highest value per dimension, highlighting strong features, which can make embeddings more sensitive to important words.

🔧 Debug

expert

Why does this sentence transformer embedding code raise an error?

Consider this code snippet:

from sentence_transformers import SentenceTransformer
model = SentenceTransformer('all-MiniLM-L6-v2')
embeddings = model.encode('This is a test sentence')
print(embeddings.shape)

What error will this code raise and why?

A AttributeError because embeddings is a 1D array and has no attribute 'shape'

B ValueError because the model name is invalid

C No error; the code runs and prints the shape

D TypeError because encode expects a list of sentences, not a single string

💡 Hint

Check the documentation for the encode method input types and output.

The encode method accepts a single string or list of strings and returns a numpy array with shape. So no error occurs and shape prints correctly.

Practice

1. What is the main purpose of sentence transformers in AI?

easy

A. To count the number of words in a sentence

B. To translate sentences from one language to another

C. To convert sentences into numbers that computers can understand

D. To generate new sentences from scratch

Solution

1. Step 1: Understand the role of sentence transformers

   Sentence transformers convert sentences into numerical vectors so computers can process them.

2. Step 2: Compare options with this understanding

   Only To convert sentences into numbers that computers can understand describes this conversion; others describe different tasks.

3. Final Answer:

   To convert sentences into numbers that computers can understand -> Option C

4. Quick Check:

   Sentence transformers = convert sentences to numbers [OK]

Hint: Remember: transformers turn text into numbers [OK]

Common Mistakes:

• Confusing sentence transformers with translation models
• Thinking they generate new sentences
• Assuming they only count words

2. Which of the following is the correct way to import a sentence transformer model in Python?

easy

A. from sentence_transformers import sentence_transformer

B. import SentenceTransformer from sentence_transformers

C. import sentence_transformers.SentenceTransformer

D. from sentence_transformers import SentenceTransformer

Solution

1. Step 1: Recall the correct Python import syntax for sentence transformers

   The correct syntax is 'from sentence_transformers import SentenceTransformer' with exact capitalization.

2. Step 2: Check each option for syntax correctness

   from sentence_transformers import SentenceTransformer matches the correct syntax; others have wrong order, case, or module names.

3. Final Answer:

   from sentence_transformers import SentenceTransformer -> Option D

4. Quick Check:

   Correct import syntax = from sentence_transformers import SentenceTransformer [OK]

Hint: Use 'from module import Class' format for imports [OK]

Common Mistakes:

• Swapping import order
• Using wrong capitalization
• Confusing module and class names

3. What will be the output type of the following code snippet?

from sentence_transformers import SentenceTransformer
model = SentenceTransformer('all-MiniLM-L6-v2')
sentence = 'Hello world'
embedding = model.encode(sentence)
print(type(embedding))

medium

A. <class 'list'>

B. <class 'numpy.ndarray'>

C. <class 'str'>

D. <class 'int'>

Solution

1. Step 1: Understand the output of model.encode()

   The encode method returns a numerical vector as a numpy array representing the sentence embedding.

2. Step 2: Identify the type printed

   Printing type(embedding) shows <class 'numpy.ndarray'> because embeddings are numpy arrays.

3. Final Answer:

   <class 'numpy.ndarray'> -> Option B

4. Quick Check:

   model.encode() output type = numpy.ndarray [OK]

Hint: model.encode returns numpy arrays for embeddings [OK]

Common Mistakes:

• Assuming output is a list
• Thinking output is a string
• Expecting an integer type

4. Identify the error in this code snippet using sentence transformers:

from sentence_transformers import SentenceTransformer
model = SentenceTransformer('all-MiniLM-L6-v2')
sentences = ['Hello world', 'Hi there']
embeddings = model.encode(sentences)
print(embeddings.shape)

medium

A. There is no error; the code runs correctly

B. model.encode() cannot take a list of sentences

C. embeddings does not have a shape attribute

D. The model name 'all-MiniLM-L6-v2' is incorrect

Solution

1. Step 1: Check model name validity

   'all-MiniLM-L6-v2' is a valid pre-trained model name for sentence transformers.

2. Step 2: Verify model.encode() input and output

   model.encode() accepts a list of sentences and returns a numpy array with shape attribute.

3. Step 3: Confirm no errors in code

   All syntax and usage are correct; printing embeddings.shape works as expected.

4. Final Answer:

   There is no error; the code runs correctly -> Option A

5. Quick Check:

   Valid model and input = code runs fine [OK]

Hint: model.encode accepts lists and returns arrays with shape [OK]

Common Mistakes:

• Thinking model.encode only accepts single sentences
• Assuming embeddings lack shape attribute
• Believing model name is invalid

5. You want to find the most similar sentence to 'I love machine learning' from a list using sentence transformers. Which approach is best?

hard

A. Encode all sentences, then use cosine similarity to find the closest embedding

B. Compare sentences by counting common words directly

C. Use a translation model to translate sentences before comparison

D. Manually check each sentence for similarity without encoding

Solution

1. Step 1: Understand the goal of similarity search

   Finding the most similar sentence requires comparing sentence meanings numerically.

2. Step 2: Identify the best method for semantic similarity

   Encoding sentences into embeddings and using cosine similarity is the standard and effective approach.

3. Step 3: Evaluate other options

   Counting words or manual checks ignore meaning; translation is unrelated here.

4. Final Answer:

   Encode all sentences, then use cosine similarity to find the closest embedding -> Option A

5. Quick Check:

   Semantic similarity = encode + cosine similarity [OK]

Hint: Use embeddings + cosine similarity for best sentence matching [OK]

Common Mistakes:

• Relying on word count instead of meaning
• Using translation unnecessarily
• Skipping encoding step