Sentiment analysis pipeline in NLP - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the main goal of a sentiment analysis pipeline?

The main goal is to automatically identify and classify the emotional tone (positive, negative, or neutral) expressed in text data.

beginner

Name the typical steps in a sentiment analysis pipeline.

Typical steps include: 1) Text collection, 2) Text cleaning and preprocessing, 3) Feature extraction, 4) Model training or prediction, 5) Evaluation of results.

intermediate

Why is text preprocessing important in sentiment analysis?

Preprocessing cleans the text by removing noise like punctuation, stopwords, and normalizing words, which helps the model understand the true sentiment better.

intermediate

What is a common method for feature extraction in sentiment analysis?

A common method is converting text into numerical vectors using techniques like Bag of Words, TF-IDF, or word embeddings (e.g., Word2Vec, GloVe).

intermediate

How do we evaluate the performance of a sentiment analysis model?

We use metrics like accuracy, precision, recall, and F1-score to measure how well the model predicts sentiment classes compared to true labels.

Which step comes first in a sentiment analysis pipeline?

A Text collection

B Model training

C Feature extraction

D Evaluation

Text collection is the first step to gather the data before any processing or modeling.

What does TF-IDF stand for in feature extraction?

A Term Frequency - Inverse Document Frequency

B Total Frequency - Indexed Document Frequency

C Text Frequency - Inverse Data Frequency

D Term Factor - Indexed Document Factor

TF-IDF measures how important a word is in a document relative to a collection of documents.

Which metric balances precision and recall in model evaluation?

A Accuracy

B Confusion matrix

C F1-score

D Loss

F1-score is the harmonic mean of precision and recall, balancing both.

Why remove stopwords during preprocessing?

A They are misspelled words

B They are rare words

C They add important sentiment meaning

D They are common words that do not add meaning

Stopwords like 'the', 'is', 'and' are common and usually do not help in understanding sentiment.

Which model type is commonly used for sentiment classification?

A Linear regression

B Neural networks

C Decision trees

D K-means clustering

Neural networks, especially deep learning models, are widely used for sentiment classification.

Describe the full process of a sentiment analysis pipeline from raw text to sentiment prediction.

Think about how you would turn a sentence into a sentiment label step-by-step.

Explain why feature extraction is necessary in sentiment analysis and name two common techniques.

Models need numbers, not words, to learn patterns.

Practice

1. What is the main purpose of a sentiment analysis pipeline in natural language processing?

easy

A. To automatically detect feelings or opinions in text

B. To translate text from one language to another

C. To count the number of words in a sentence

D. To generate new text based on input

Solution

1. Step 1: Understand the goal of sentiment analysis

   Sentiment analysis is about finding emotions or opinions in text data.

2. Step 2: Identify the pipeline's role

   A sentiment analysis pipeline automates this process to detect feelings like positive or negative.

3. Final Answer:

   To automatically detect feelings or opinions in text -> Option A

4. Quick Check:

   Sentiment analysis = detect feelings [OK]

Hint: Sentiment analysis finds emotions in text fast [OK]

Common Mistakes:

• Confusing sentiment analysis with translation
• Thinking it counts words instead of feelings
• Assuming it generates new text

2. Which of the following is the correct way to create a sentiment analysis pipeline using the Hugging Face Transformers library in Python?

easy

A. pipeline = Pipeline('text-classification')

B. pipeline = create_pipeline('sentiment')

C. pipeline = sentiment_pipeline()

D. pipeline = pipeline('sentiment-analysis')

Solution

1. Step 1: Recall the Hugging Face pipeline syntax

   The correct function is pipeline with the task name as a string.

2. Step 2: Match the exact task name for sentiment analysis

   The task name is 'sentiment-analysis', so pipeline('sentiment-analysis') is correct.

3. Final Answer:

   pipeline = pipeline('sentiment-analysis') -> Option D

4. Quick Check:

   Use pipeline('sentiment-analysis') to create sentiment pipeline [OK]

Hint: Use pipeline('sentiment-analysis') exactly [OK]

Common Mistakes:

• Using wrong function names like create_pipeline
• Missing quotes around task name
• Using incorrect task names like 'sentiment'

3. What will be the output of this Python code using Hugging Face's sentiment analysis pipeline?

from transformers import pipeline
sentiment = pipeline('sentiment-analysis')
result = sentiment('I love sunny days!')
print(result)

medium

A. [{'label': 'NEGATIVE', 'score': 0.99}]

B. [{'label': 'POSITIVE', 'score': 0.99}]

C. SyntaxError

D. []

Solution

1. Step 1: Understand the input text sentiment

   The sentence 'I love sunny days!' expresses a positive feeling.

2. Step 2: Predict output from sentiment pipeline

   The pipeline returns a list with a dictionary containing label 'POSITIVE' and a high confidence score.

3. Final Answer:

   [{'label': 'POSITIVE', 'score': 0.99}] -> Option B

4. Quick Check:

   Positive sentence = POSITIVE label [OK]

Hint: Positive words give POSITIVE label with high score [OK]

Common Mistakes:

• Expecting NEGATIVE label for positive text
• Thinking output is a string, not a list of dict
• Confusing syntax errors with runtime output

4. You wrote this code but get an error: NameError: name 'pipeline' is not defined. What is the likely fix?

sentiment = pipeline('sentiment-analysis')
result = sentiment('I hate rain.')
print(result)

medium

A. Add from transformers import pipeline before using pipeline

B. Change 'sentiment-analysis' to 'sentiment'

C. Replace pipeline with sentiment_pipeline

D. Remove parentheses from pipeline call

Solution

1. Step 1: Identify cause of NameError

   The error means Python does not know what pipeline is because it was not imported.

2. Step 2: Fix by importing pipeline function

   Adding from transformers import pipeline defines pipeline so the code runs correctly.

3. Final Answer:

   Add from transformers import pipeline before using pipeline -> Option A

4. Quick Check:

   Import missing = NameError fixed [OK]

Hint: Always import pipeline before using it [OK]

Common Mistakes:

• Changing task name instead of importing
• Assuming pipeline is built-in without import
• Removing parentheses causing syntax errors

5. You want to analyze customer reviews but some reviews are empty strings or just spaces. How should you modify your sentiment analysis pipeline to handle this before prediction?

hard

A. Replace empty reviews with the word 'neutral' and analyze

B. Pass all reviews directly to the pipeline without changes

C. Filter out empty or whitespace-only reviews before passing to the pipeline

D. Use a different pipeline for empty reviews

Solution

1. Step 1: Understand the problem with empty inputs

   Empty or whitespace-only texts do not contain sentiment and can cause errors or meaningless results.

2. Step 2: Apply filtering before analysis

   Removing or skipping these empty reviews ensures the pipeline only processes valid text, improving accuracy and avoiding errors.

3. Final Answer:

   Filter out empty or whitespace-only reviews before passing to the pipeline -> Option C

4. Quick Check:

   Remove empty inputs before analysis [OK]

Hint: Skip empty reviews to avoid errors [OK]

Common Mistakes:

• Passing empty strings causing errors
• Replacing empty with unrelated words
• Using multiple pipelines unnecessarily