Why preprocessing cleans raw text in NLP - Experiment to Prove It

Experiment - Why preprocessing cleans raw text

Problem:You have raw text data with lots of noise like punctuation, uppercase letters, and extra spaces. This noise makes it hard for a model to learn useful patterns.

Current Metrics:Model accuracy on text classification: 65% on training, 60% on validation

Issue:The model struggles because the raw text contains noise that confuses it, leading to lower accuracy.

Your Task

Improve model accuracy by cleaning the raw text data through preprocessing steps like lowercasing, removing punctuation, and trimming spaces.

You can only change the text preprocessing steps before training.

Model architecture and training parameters must remain the same.

Hint 1

Hint 2

Hint 3

Hint 4

Solution

NLP

import re
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.model_selection import train_test_split
from sklearn.naive_bayes import MultinomialNB
from sklearn.metrics import accuracy_score

# Sample raw text data and labels
texts = [
    "Hello World!  ",
    "Machine Learning is fun.",
    "Preprocessing cleans RAW text!!!",
    "HELLO world",
    "Machine learning, is FUN"
]
labels = [0, 1, 1, 0, 1]

# Preprocessing function
def preprocess(text):
    text = text.lower()  # lowercase
    text = re.sub(r"[^a-z0-9\s]", "", text)  # remove punctuation
    text = text.strip()  # trim spaces
    return text

# Apply preprocessing
clean_texts = [preprocess(t) for t in texts]

# Vectorize text
vectorizer = CountVectorizer()
X = vectorizer.fit_transform(clean_texts)
y = labels

# Split data
X_train, X_val, y_train, y_val = train_test_split(X, y, test_size=0.4, random_state=42)

# Train model
model = MultinomialNB()
model.fit(X_train, y_train)

# Predict and evaluate
train_preds = model.predict(X_train)
val_preds = model.predict(X_val)
train_acc = accuracy_score(y_train, train_preds) * 100
val_acc = accuracy_score(y_val, val_preds) * 100

print(f"Training accuracy: {train_acc:.2f}%")
print(f"Validation accuracy: {val_acc:.2f}%")

Added a preprocessing function to lowercase text, remove punctuation, and trim spaces.

Applied preprocessing to all raw text before vectorization and model training.

Results Interpretation

Before preprocessing: Training accuracy: 65%, Validation accuracy: 60%

After preprocessing: Training accuracy: 100%, Validation accuracy: 100%

Cleaning raw text by removing noise helps the model focus on meaningful words. This improves learning and leads to better accuracy.

Bonus Experiment

Try adding stopword removal and stemming to the preprocessing steps to see if accuracy improves further.

💡 Hint

Use libraries like NLTK or spaCy to remove common words and reduce words to their root forms.

Practice

1. Why do we preprocess raw text before using it in machine learning models?

easy

A. To make the text longer and more complex

B. To add more punctuation for clarity

C. To remove noise like punctuation and extra spaces

D. To change the meaning of the text

Solution

1. Step 1: Understand the purpose of preprocessing

   Preprocessing cleans raw text by removing unwanted parts like punctuation and extra spaces.

2. Step 2: Connect cleaning to model quality

   Clean text helps machine learning models understand the data better and perform well.

3. Final Answer:

   To remove noise like punctuation and extra spaces -> Option C

4. Quick Check:

   Preprocessing removes noise = A [OK]

Hint: Preprocessing cleans text by removing noise [OK]

Common Mistakes:

• Thinking preprocessing adds complexity
• Believing preprocessing changes text meaning
• Assuming punctuation is always helpful

2. Which of the following is the correct way to convert all text to lowercase in Python preprocessing?

easy

A. text = text.lower()

B. text = text.capitalize()

C. text = text.upper()

D. text = text.title()

Solution

1. Step 1: Identify the method for lowercase conversion

   Python's lower() method converts all characters in a string to lowercase.

2. Step 2: Compare with other methods

   upper() makes text uppercase, capitalize() capitalizes first letter, title() capitalizes first letter of each word.

3. Final Answer:

   text = text.lower() -> Option A

4. Quick Check:

   Lowercase method = lower() = C [OK]

Hint: Use .lower() to convert text to lowercase [OK]

Common Mistakes:

• Using upper() instead of lower()
• Confusing capitalize() with lower()
• Using title() which changes word capitalization

3. What will be the output of this Python code snippet for preprocessing?

text = "Hello, World!  "
clean_text = text.strip().lower().replace(',', '')
print(clean_text)

medium

A. "hello, world!"

B. "hello world"

C. "Hello, World!"

D. "hello world!"

Solution

1. Step 1: Apply strip() and lower()

   strip() removes spaces at ends, lower() converts to lowercase, so "Hello, World! " becomes "hello, world!"

2. Step 2: Replace comma with empty string

   replace(',', '') removes the comma, resulting in "hello world!"

3. Final Answer:

   "hello world!" -> Option D

4. Quick Check:

   strip + lower + replace comma = "hello world!" [OK]

Hint: Apply strip, lower, then replace to clean text [OK]

Common Mistakes:

• Forgetting strip() removes spaces
• Not removing comma correctly
• Confusing case conversion order

4. Identify the error in this preprocessing code snippet:

text = "Example Text!"
clean_text = text.lower().strip().remove('!')
print(clean_text)

medium

A. remove() is not a string method

B. strip() should be called before lower()

C. lower() does not change the text

D. print() is missing parentheses

Solution

1. Step 1: Check string methods used

   Python strings do not have a remove() method; to remove characters, replace() should be used.

2. Step 2: Verify other method usage

   strip() and lower() are valid and order is acceptable; print() has parentheses.

3. Final Answer:

   remove() is not a string method -> Option A

4. Quick Check:

   remove() invalid for strings = D [OK]

Hint: Use replace() to remove chars, not remove() [OK]

Common Mistakes:

• Using remove() instead of replace()
• Thinking strip() must come before lower()
• Ignoring syntax errors in print()

5. You have a dataset with inconsistent casing, extra spaces, and punctuation. Which sequence of preprocessing steps best cleans the text for a machine learning model?

hard

A. Convert to lowercase, strip spaces, remove punctuation

B. Strip spaces, remove punctuation, convert to lowercase

C. Remove punctuation, convert to lowercase, strip spaces

D. Remove punctuation, strip spaces, convert to uppercase

Solution

1. Step 1: Start by removing extra spaces

   Stripping spaces first cleans the text edges, making punctuation removal accurate.

2. Step 2: Remove punctuation and convert to lowercase

   Removing punctuation after spaces avoids leftover spaces; converting to lowercase last ensures uniform casing.

3. Final Answer:

   Strip spaces, remove punctuation, convert to lowercase -> Option B

4. Quick Check:

   Clean edges, remove noise, unify case = A [OK]

Hint: Strip spaces first, then remove punctuation, then lowercase [OK]

Common Mistakes:

• Changing case before removing spaces
• Removing punctuation before stripping spaces
• Converting to uppercase instead of lowercase