Why preprocessing cleans raw text in NLP - Quick Recap

Recall & Review

beginner

What is the main purpose of preprocessing raw text in NLP?

The main purpose is to clean and prepare the text so that the machine learning model can understand it better and make accurate predictions.

beginner

Name two common preprocessing steps used to clean raw text.

Removing punctuation and converting all text to lowercase are two common preprocessing steps.

beginner

Why do we remove stop words during text preprocessing?

Stop words are common words like 'the', 'is', and 'and' that do not add much meaning. Removing them helps the model focus on important words.

intermediate

How does preprocessing help improve model accuracy?

By cleaning text, removing noise, and standardizing words, preprocessing reduces confusion for the model and helps it learn patterns more clearly.

intermediate

What problems can raw text cause if not preprocessed?

Raw text can have typos, inconsistent capitalization, extra spaces, and irrelevant symbols that confuse the model and lower prediction quality.

Why do we convert text to lowercase during preprocessing?

A To treat words like 'Apple' and 'apple' as the same

B To make the text longer

C To remove punctuation

D To add stop words

Converting to lowercase helps the model treat words with different cases as the same word.

What is a stop word in text preprocessing?

A A common word that adds little meaning

B A misspelled word

C A word with punctuation

D A rare word with special meaning

Stop words are common words like 'the' or 'and' that usually do not add important meaning.

Which of these is NOT a typical preprocessing step?

A Removing punctuation

B Adding random words

C Tokenizing text

D Removing extra spaces

Adding random words is not a preprocessing step; it would confuse the model.

How does preprocessing affect machine learning models?

A It changes the meaning of the text

B It makes the text harder to understand

C It removes all words

D It cleans and standardizes text for better learning

Preprocessing cleans and standardizes text so models can learn patterns more effectively.

What problem can raw text with typos cause?

A Makes text shorter

B Improves model accuracy

C Confuses the model and lowers accuracy

D Removes stop words automatically

Typos add noise and confuse the model, reducing prediction quality.

Explain why preprocessing is important for cleaning raw text in NLP.

Think about how messy text can confuse a model.

List common preprocessing steps used to clean raw text and why each is useful.

Consider how each step simplifies or clarifies the text.