Domain-specific sentiment in NLP - Practice Problems & Coding Challenges

Challenge - 5 Problems

🧠 Conceptual

intermediate

Why is domain-specific sentiment analysis important?

Imagine you want to analyze customer reviews about medical devices. Why might a general sentiment model fail here?

A Because general sentiment models always perform better on any domain without retraining.

B Because domain-specific sentiment ignores the context of words and focuses only on word frequency.

C Because words like 'positive' or 'negative' have different meanings in medical contexts compared to general language.

D Because medical reviews are always neutral and don't need sentiment analysis.

💡 Hint

Think about how words can change meaning depending on the topic.

In domain-specific sentiment, words may have different sentiment meanings. For example, 'positive' in medical tests can mean a bad result, unlike general positive feelings.

❓ Predict Output

intermediate

Output of domain-specific sentiment prediction code

What is the output of this Python code that predicts sentiment using a domain-specific dictionary?

NLP

domain_sentiment_dict = {'stable': 1, 'critical': -1, 'improved': 1, 'declined': -1}
text = 'The patient condition is stable but later declined'
sentiment_score = sum(domain_sentiment_dict.get(word, 0) for word in text.lower().split())
print(sentiment_score)

A 2

B 0

C -1

D 1

💡 Hint

Check which words in the text match the dictionary and sum their scores.

'stable' has score 1, 'declined' has score -1, others 0, so total is 1 + (-1) = 0.

❓ Model Choice

advanced

Choosing a model for domain-specific sentiment analysis

You want to build a sentiment model for financial news articles. Which model choice is best?

A Use a rule-based sentiment model designed for movie reviews.

B Train a sentiment model from scratch using only financial news labeled data.

C Use a pre-trained general sentiment model without any fine-tuning.

D Fine-tune a pre-trained language model on labeled financial news sentiment data.

💡 Hint

Consider leveraging existing knowledge and adapting it to your domain.

Fine-tuning a pre-trained model on domain data combines general language understanding with domain-specific sentiment knowledge, improving accuracy.

❓ Metrics

advanced

Evaluating domain-specific sentiment model performance

You trained a domain-specific sentiment classifier. Which metric best shows how well it distinguishes positive and negative sentiment?

A F1-score

B Accuracy

C Mean Squared Error

D Perplexity

💡 Hint

Think about metrics that balance precision and recall for classification.

F1-score balances precision and recall, making it suitable for sentiment classification especially with imbalanced classes.

🔧 Debug

expert

Debugging domain-specific sentiment model training code

What error does this code raise when training a sentiment model with domain-specific data?

NLP

from sklearn.feature_extraction.text import CountVectorizer
from sklearn.linear_model import LogisticRegression
texts = ['good profit', 'bad loss', 'stable growth']
labels = [1, 0]
vectorizer = CountVectorizer()
X = vectorizer.fit_transform(texts)
model = LogisticRegression()
model.fit(X, labels)

A ValueError: Found input variables with inconsistent numbers of samples

B TypeError: 'int' object is not iterable

C AttributeError: 'CountVectorizer' object has no attribute 'fit_transform'

D No error, model trains successfully

💡 Hint

Check if the number of texts matches the number of labels.

There are 3 texts but only 2 labels, causing a mismatch error during training.

Practice

1. What is the main advantage of using domain-specific sentiment analysis over general sentiment analysis?

easy

A. It works for all topics equally well.

B. It requires no training data.

C. It ignores the context of words.

D. It understands feelings better in a specific area.

Solution

1. Step 1: Understand domain-specific sentiment

   Domain-specific sentiment focuses on feelings related to a particular topic or area, making it more precise.

2. Step 2: Compare with general sentiment

   General sentiment tries to work on all topics but may miss nuances in specialized areas.

3. Final Answer:

   It understands feelings better in a specific area. -> Option D

4. Quick Check:

   Domain focus improves understanding = C [OK]

Hint: Domain-specific means better feelings understanding in one area [OK]

Common Mistakes:

• Thinking it needs no training data
• Assuming it works equally well everywhere
• Believing it ignores word context

2. Which of the following is the correct way to prepare data for domain-specific sentiment training?

easy

A. Collect labeled data from the target domain.

B. Train on unlabeled data from a different domain.

C. Use only positive reviews from all domains.

D. Use random text from any topic without labels.

Solution

1. Step 1: Identify training data needs

   Domain-specific sentiment requires labeled examples from the target domain to learn correctly.

2. Step 2: Evaluate options

   Only collecting labeled data from the target domain provides labeled examples from the correct domain, which is essential for training.

3. Final Answer:

   Collect labeled data from the target domain. -> Option A

4. Quick Check:

   Labeled target data needed = D [OK]

Hint: Training needs labeled data from the right domain [OK]

Common Mistakes:

• Using unlabeled or random data
• Mixing data from unrelated domains
• Ignoring the need for labels

3. Given this Python snippet for domain-specific sentiment prediction:

from sklearn.feature_extraction.text import CountVectorizer
from sklearn.linear_model import LogisticRegression

texts = ['Great battery life', 'Poor screen quality', 'Excellent camera']
labels = [1, 0, 1]  # 1=positive, 0=negative

vectorizer = CountVectorizer()
X = vectorizer.fit_transform(texts)
model = LogisticRegression()
model.fit(X, labels)

new_text = ['Battery lasts long']
X_new = vectorizer.transform(new_text)
pred = model.predict(X_new)

What is the expected output of pred?

medium

A. [1]

B. [0]

C. Error due to missing labels

D. [1, 0]

Solution

1. Step 1: Understand training data and labels

   The model is trained on positive and negative examples related to product features.

2. Step 2: Predict sentiment for new text

   'Battery lasts long' is similar to 'Great battery life', which is labeled positive (1), so prediction should be positive.

3. Final Answer:

   [1] -> Option A

4. Quick Check:

   Similar positive text predicts 1 = A [OK]

Hint: New text similar to positive training predicts positive [OK]

Common Mistakes:

• Expecting multiple predictions for single input
• Confusing labels or expecting error
• Ignoring vectorizer transform step

4. You have this code snippet for domain-specific sentiment training:

texts = ['Good food', 'Bad service']
labels = [1, 0]
vectorizer = CountVectorizer()
X = vectorizer.fit_transform(texts)
model = LogisticRegression()
model.fit(X, labels)

new_text = ['Bad food']
X_new = vectorizer.transform(new_text)
pred = model.predict(X_new)
print(pred)

The output is always [1] even for negative phrases. What is the likely error?

medium

A. Labels are reversed in training data.

B. The vectorizer was not fit before transform.

C. The model was trained on too few examples.

D. The new text was not transformed correctly.

Solution

1. Step 1: Check training data size

   Only two examples are used, which is too small for the model to learn properly.

2. Step 2: Analyze model behavior

   With limited data, the model may predict the majority class or fail to distinguish negative phrases.

3. Final Answer:

   The model was trained on too few examples. -> Option C

4. Quick Check:

   Small training data causes poor predictions = A [OK]

Hint: Too few training examples cause wrong predictions [OK]

Common Mistakes:

• Assuming vectorizer not fit causes this
• Thinking labels are reversed
• Believing transform step is incorrect

5. You want to improve domain-specific sentiment analysis for movie reviews. Which approach best combines domain knowledge and model accuracy?

hard

A. Train a sentiment model on general tweets and apply it to movie reviews.

B. Collect labeled movie reviews, fine-tune a pre-trained language model, and test on movie data.

C. Use a dictionary of positive and negative words from unrelated domains.

D. Train a model only on unlabeled movie reviews using clustering.

Solution

1. Step 1: Identify domain-specific data needs

   Using labeled movie reviews ensures the model learns relevant sentiment patterns.

2. Step 2: Use advanced model fine-tuning

   Fine-tuning a pre-trained language model adapts general knowledge to the movie domain, improving accuracy.

3. Final Answer:

   Collect labeled movie reviews, fine-tune a pre-trained language model, and test on movie data. -> Option B

4. Quick Check:

   Labeled domain data + fine-tuning = best accuracy [OK]

Hint: Fine-tune with labeled domain data for best results [OK]

Common Mistakes:

• Using unrelated domain data only
• Relying on unlabeled data without supervision
• Using generic word lists without context