Sentiment analysis pipeline in NLP - Model Pipeline Trace

Model Pipeline - Sentiment analysis pipeline

This pipeline reads text reviews and learns to tell if the feeling is positive or negative. It cleans the text, turns words into numbers, trains a model, and then predicts feelings on new reviews.

Data Flow - 5 Stages

1Raw Text Input

1000 reviews x 1 column→Collect raw text reviews→1000 reviews x 1 column

"I love this product!"

↓

2Text Cleaning

1000 reviews x 1 column→Lowercase, remove punctuation and stopwords→1000 reviews x 1 column

"love product"

↓

3Tokenization & Vectorization

1000 reviews x 1 column→Convert words to sequences of numbers→1000 reviews x 10 tokens

[12, 45, 78, 0, 0, 0, 0, 0, 0, 0]

↓

4Train/Test Split

1000 reviews x 10 tokens→Split data into training (80%) and testing (20%) sets→Training: 800 reviews x 10 tokens, Testing: 200 reviews x 10 tokens

Training sample: [12, 45, 78, ...], Testing sample: [34, 56, 23, ...]

↓

5Model Training

Training: 800 reviews x 10 tokens→Train neural network to classify sentiment→Trained model

Model learns patterns to predict positive or negative

Training Trace - Epoch by Epoch

Loss
0.7 |****
0.6 |*** 
0.5 |**  
0.4 |*   
0.3 |*   
     1 2 3 4 5 Epochs

Epoch	Loss ↓	Accuracy ↑	Observation
1	0.65	0.60	Model starts learning, accuracy is low
2	0.50	0.75	Loss decreases, accuracy improves
3	0.40	0.82	Model learns better features
4	0.35	0.86	Training converges, accuracy rises
5	0.30	0.89	Good performance, loss low

Prediction Trace - 5 Layers

Layer 1: Input Text

Layer 2: Tokenization

Layer 3: Embedding Layer

Layer 4: Neural Network Layers

Layer 5: Prediction

Model Quiz - 3 Questions

What happens to the text during the 'Text Cleaning' stage?

A The model is trained

B Punctuation and stopwords are removed

C Numbers are assigned to words

D Data is split into train and test sets

Key Insight

This visualization shows how raw text is cleaned and turned into numbers so a model can learn patterns. As training progresses, the model gets better at guessing feelings, shown by loss going down and accuracy going up. The final prediction step turns model output into a simple positive or negative label.

Practice

1. What is the main purpose of a sentiment analysis pipeline in natural language processing?

easy

A. To automatically detect feelings or opinions in text

B. To translate text from one language to another

C. To count the number of words in a sentence

D. To generate new text based on input

Solution

1. Step 1: Understand the goal of sentiment analysis

   Sentiment analysis is about finding emotions or opinions in text data.

2. Step 2: Identify the pipeline's role

   A sentiment analysis pipeline automates this process to detect feelings like positive or negative.

3. Final Answer:

   To automatically detect feelings or opinions in text -> Option A

4. Quick Check:

   Sentiment analysis = detect feelings [OK]

Hint: Sentiment analysis finds emotions in text fast [OK]

Common Mistakes:

• Confusing sentiment analysis with translation
• Thinking it counts words instead of feelings
• Assuming it generates new text

2. Which of the following is the correct way to create a sentiment analysis pipeline using the Hugging Face Transformers library in Python?

easy

A. pipeline = Pipeline('text-classification')

B. pipeline = create_pipeline('sentiment')

C. pipeline = sentiment_pipeline()

D. pipeline = pipeline('sentiment-analysis')

Solution

1. Step 1: Recall the Hugging Face pipeline syntax

   The correct function is pipeline with the task name as a string.

2. Step 2: Match the exact task name for sentiment analysis

   The task name is 'sentiment-analysis', so pipeline('sentiment-analysis') is correct.

3. Final Answer:

   pipeline = pipeline('sentiment-analysis') -> Option D

4. Quick Check:

   Use pipeline('sentiment-analysis') to create sentiment pipeline [OK]

Hint: Use pipeline('sentiment-analysis') exactly [OK]

Common Mistakes:

• Using wrong function names like create_pipeline
• Missing quotes around task name
• Using incorrect task names like 'sentiment'

3. What will be the output of this Python code using Hugging Face's sentiment analysis pipeline?

from transformers import pipeline
sentiment = pipeline('sentiment-analysis')
result = sentiment('I love sunny days!')
print(result)

medium

A. [{'label': 'NEGATIVE', 'score': 0.99}]

B. [{'label': 'POSITIVE', 'score': 0.99}]

C. SyntaxError

D. []

Solution

1. Step 1: Understand the input text sentiment

   The sentence 'I love sunny days!' expresses a positive feeling.

2. Step 2: Predict output from sentiment pipeline

   The pipeline returns a list with a dictionary containing label 'POSITIVE' and a high confidence score.

3. Final Answer:

   [{'label': 'POSITIVE', 'score': 0.99}] -> Option B

4. Quick Check:

   Positive sentence = POSITIVE label [OK]

Hint: Positive words give POSITIVE label with high score [OK]

Common Mistakes:

• Expecting NEGATIVE label for positive text
• Thinking output is a string, not a list of dict
• Confusing syntax errors with runtime output

4. You wrote this code but get an error: NameError: name 'pipeline' is not defined. What is the likely fix?

sentiment = pipeline('sentiment-analysis')
result = sentiment('I hate rain.')
print(result)

medium

A. Add from transformers import pipeline before using pipeline

B. Change 'sentiment-analysis' to 'sentiment'

C. Replace pipeline with sentiment_pipeline

D. Remove parentheses from pipeline call

Solution

1. Step 1: Identify cause of NameError

   The error means Python does not know what pipeline is because it was not imported.

2. Step 2: Fix by importing pipeline function

   Adding from transformers import pipeline defines pipeline so the code runs correctly.

3. Final Answer:

   Add from transformers import pipeline before using pipeline -> Option A

4. Quick Check:

   Import missing = NameError fixed [OK]

Hint: Always import pipeline before using it [OK]

Common Mistakes:

• Changing task name instead of importing
• Assuming pipeline is built-in without import
• Removing parentheses causing syntax errors

5. You want to analyze customer reviews but some reviews are empty strings or just spaces. How should you modify your sentiment analysis pipeline to handle this before prediction?

hard

A. Replace empty reviews with the word 'neutral' and analyze

B. Pass all reviews directly to the pipeline without changes

C. Filter out empty or whitespace-only reviews before passing to the pipeline

D. Use a different pipeline for empty reviews

Solution

1. Step 1: Understand the problem with empty inputs

   Empty or whitespace-only texts do not contain sentiment and can cause errors or meaningless results.

2. Step 2: Apply filtering before analysis

   Removing or skipping these empty reviews ensures the pipeline only processes valid text, improving accuracy and avoiding errors.

3. Final Answer:

   Filter out empty or whitespace-only reviews before passing to the pipeline -> Option C

4. Quick Check:

   Remove empty inputs before analysis [OK]

Hint: Skip empty reviews to avoid errors [OK]

Common Mistakes:

• Passing empty strings causing errors
• Replacing empty with unrelated words
• Using multiple pipelines unnecessarily