Spam detection pipeline in NLP - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Model Choice

intermediate

Choosing the best model for spam detection

You want to build a spam detection system that classifies emails as spam or not spam. Which model is best suited for this binary text classification task?

A A linear Support Vector Machine (SVM) with TF-IDF features

B K-Means clustering with raw email text

C A Convolutional Neural Network (CNN) designed for image recognition

D Principal Component Analysis (PCA) for dimensionality reduction

💡 Hint

Think about models that work well with text features and binary classification.

SVM with TF-IDF features is a strong, simple model for text classification. K-Means is unsupervised and not for classification. CNNs for images won't work well on raw text. PCA is for reducing features, not classification.

❓ Predict Output

intermediate

Output of text preprocessing step

Given this Python code that preprocesses email text, what is the output?

NLP

import re
text = "Hello!!! This is spam??? Visit http://spam.com now."
cleaned = re.sub(r'http\S+', '', text)
cleaned = re.sub(r'[^a-zA-Z ]', '', cleaned).lower().split()
print(cleaned)

A ['hello', 'this', 'is', 'spam', 'visit', 'now']

B ['hello!!!', 'this', 'is', 'spam???', 'visit', 'http://spam.com', 'now']

C ['hello', 'this', 'is', 'spam', 'visit', 'httpspamcom', 'now']

D ['hello', 'this', 'is', 'spam', 'visit', 'http', 'spamcom', 'now']

💡 Hint

Look at how URLs and punctuation are removed, and text is lowercased and split.

The regex removes URLs first, then removes all non-letter characters, then lowercases and splits into words.

❓ Hyperparameter

advanced

Choosing the best hyperparameter for TF-IDF vectorizer

In a spam detection pipeline, you use a TF-IDF vectorizer. Which max_features value is best to balance performance and speed on a large email dataset?

A max_features=10

B max_features=1000000

C max_features=None

D max_features=10000

💡 Hint

Too few features may miss important words; too many may slow training.

10 features is too small to capture text variety. 1,000,000 is too large and slow. None uses all features, which can be very large. 10,000 is a good balance.

❓ Metrics

advanced

Interpreting spam detection model metrics

Your spam detection model has these results on test data: 90% accuracy, 70% precision, 95% recall. What does this mean?

A The model correctly identifies most spam emails but also marks many non-spam as spam.

B The model rarely misses spam emails but sometimes wrongly flags non-spam as spam.

C The model is very precise but misses many spam emails.

D The model has balanced precision and recall, so it is perfect.

💡 Hint

Recall is about catching spam; precision is about avoiding false alarms.

High recall (95%) means most spam is caught. Lower precision (70%) means some non-spam is wrongly flagged. Accuracy is high but less informative if classes are imbalanced.

🔧 Debug

expert

Debugging model training failure in spam detection

Why does this spam detection training code raise a ValueError?

from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.linear_model import LogisticRegression
texts = ["Free money now", "Hello friend", "Win a prize"]
labels = [1, 0]
vectorizer = TfidfVectorizer()
X = vectorizer.fit_transform(texts)
model = LogisticRegression()
model.fit(X, labels)

A fit_transform returns a dense matrix, but LogisticRegression needs sparse

B LogisticRegression requires labels to be strings, not integers

C The labels list length does not match the number of texts

D TfidfVectorizer cannot process short texts

💡 Hint

Check if the number of labels matches the number of input samples.

The labels list has 2 items but texts has 3. The model expects one label per text sample.

Practice

1. What is the main purpose of a spam detection pipeline in NLP?

easy

A. To convert text messages into numbers and train a model to identify spam

B. To translate messages into different languages

C. To summarize long emails automatically

D. To generate new text messages based on spam examples

Solution

1. Step 1: Understand the role of a spam detection pipeline

   A spam detection pipeline processes text data to prepare it for a machine learning model that can classify messages as spam or not spam.

2. Step 2: Identify the key function

   The pipeline converts text into numbers (features) and trains a model to spot spam messages automatically.

3. Final Answer:

   To convert text messages into numbers and train a model to identify spam -> Option A

4. Quick Check:

   Spam detection pipeline = convert text + train model [OK]

Hint: Spam detection means turning text into numbers to train a model [OK]

Common Mistakes:

• Thinking it translates or summarizes text
• Confusing spam detection with text generation
• Ignoring the conversion of text to numbers

2. Which of the following code snippets correctly creates a simple spam detection pipeline using scikit-learn's Pipeline with a TfidfVectorizer and a LogisticRegression model?

easy

A. Pipeline([('vectorizer', TfidfVectorizer()), ('model', LogisticRegression())])

B. Pipeline(('vectorizer', TfidfVectorizer()), ('model', LogisticRegression()))

C. Pipeline({'vectorizer': TfidfVectorizer(), 'model': LogisticRegression()})

D. Pipeline(['vectorizer' = TfidfVectorizer(), 'model' = LogisticRegression()])

Solution

1. Step 1: Recall the correct syntax for scikit-learn Pipeline

   The Pipeline constructor expects a list of tuples, each tuple containing a name and a transformer or estimator.

2. Step 2: Check each option's syntax

   Pipeline([('vectorizer', TfidfVectorizer()), ('model', LogisticRegression())]) uses a list of tuples correctly. Other options use incorrect syntax like using '=' inside lists, passing tuples as separate arguments, or dictionary syntax.

3. Final Answer:

   Pipeline([('vectorizer', TfidfVectorizer()), ('model', LogisticRegression())]) -> Option A

4. Quick Check:

   Pipeline syntax = list of (name, step) tuples [OK]

Hint: Pipeline needs a list of (name, step) tuples inside brackets [OK]

Common Mistakes:

• Using parentheses instead of brackets for the list
• Using dictionary syntax inside Pipeline
• Assigning steps with '=' inside a list

3. Given the following code, what will be the output of print(predictions) if the input messages are ["Win a free prize now", "Meeting at noon"] and the model predicts 1 for spam and 0 for not spam?

from sklearn.pipeline import Pipeline
from sklearn.feature_extraction.text import TfidfVectorizer
from sklearn.linear_model import LogisticRegression

pipeline = Pipeline([
    ('vectorizer', TfidfVectorizer()),
    ('model', LogisticRegression())
])

# Assume pipeline is already trained
messages = ["Win a free prize now", "Meeting at noon"]
predictions = pipeline.predict(messages)
print(predictions)

medium

A. [0 1]

B. [1 0]

C. [1 1]

D. [0 0]

Solution

1. Step 1: Understand the input and model output

   The input has one spam-like message "Win a free prize now" and one normal message "Meeting at noon". The model labels spam as 1 and not spam as 0.

2. Step 2: Predict expected labels

   The first message is likely spam, so prediction is 1. The second is normal, so prediction is 0.

3. Final Answer:

   [1 0] -> Option B

4. Quick Check:

   Spam message = 1, normal message = 0 [OK]

Hint: Spam message predicts 1, normal message predicts 0 [OK]

Common Mistakes:

• Swapping labels 0 and 1
• Assuming both messages are spam
• Confusing output format with list of strings

4. Identify the error in this spam detection pipeline code and choose the correct fix:

from sklearn.pipeline import Pipeline
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.linear_model import LogisticRegression

pipeline = Pipeline([
    ('vectorizer', CountVectorizer),
    ('model', LogisticRegression())
])

pipeline.fit(train_messages, train_labels)

medium

A. Add parentheses to pipeline.fit() call

B. Replace LogisticRegression() with LogisticRegression

C. Remove the pipeline and train model directly

D. Change CountVectorizer to CountVectorizer() to create an instance

Solution

1. Step 1: Check the pipeline steps for correct instantiation

   CountVectorizer is a class and must be instantiated with parentheses to create an object.

2. Step 2: Identify the error and fix

   The code uses CountVectorizer without parentheses, causing an error. Adding parentheses fixes it.

3. Final Answer:

   Change CountVectorizer to CountVectorizer() to create an instance -> Option D

4. Quick Check:

   Instantiate classes with () in pipeline steps [OK]

Hint: Always instantiate transformers with () in pipeline steps [OK]

Common Mistakes:

• Forgetting parentheses after class names
• Confusing model and vectorizer instantiation
• Trying to remove pipeline instead of fixing syntax

5. You want to improve your spam detection pipeline by adding a step to remove common stop words before vectorizing. Which pipeline modification correctly adds this step using CountVectorizer with stop words removal?

hard

A. Pipeline([('stopwords', StopWordsRemover()), ('vectorizer', CountVectorizer()), ('model', LogisticRegression())])

B. Pipeline([('vectorizer', CountVectorizer()), ('stopwords', StopWordsRemover()), ('model', LogisticRegression())])

C. Pipeline([('vectorizer', CountVectorizer(stop_words='english')), ('model', LogisticRegression())])

D. Pipeline([('vectorizer', CountVectorizer(stop_words=None)), ('model', LogisticRegression())])

Solution

1. Step 1: Understand how to remove stop words in CountVectorizer

   CountVectorizer has a parameter stop_words which can be set to 'english' to remove common English stop words automatically.

2. Step 2: Check pipeline options for correct usage

   Pipeline([('vectorizer', CountVectorizer(stop_words='english')), ('model', LogisticRegression())]) correctly sets stop_words='english' inside CountVectorizer. Other options either use a non-existent StopWordsRemover step or set stop_words=None, which disables removal.

3. Final Answer:

   Pipeline([('vectorizer', CountVectorizer(stop_words='english')), ('model', LogisticRegression())]) -> Option C

4. Quick Check:

   Use stop_words='english' in CountVectorizer to remove stop words [OK]

Hint: Use stop_words='english' inside CountVectorizer [OK]

Common Mistakes:

• Trying to add a separate stop words remover step
• Setting stop_words to None disables removal
• Misplacing stop words removal after vectorizing