Why machines need numerical text representation in NLP - Challenge Your Understanding

Challenge - 5 Problems

🧠 Conceptual

intermediate

Why can't machines understand raw text directly?

Machines process numbers, not words. Why is it necessary to convert text into numbers before feeding it to a machine learning model?

A Because machines only understand numerical data and cannot process raw text directly.

B Because numerical text representation removes all grammar and meaning from the text.

C Because converting text to numbers makes the text shorter and easier to read for humans.

D Because raw text contains too many spelling mistakes that machines cannot fix.

💡 Hint

Think about how computers store and process information internally.

Computers operate using numbers (binary digits). Text must be converted into numbers so machines can perform calculations and learn patterns.

❓ Predict Output

intermediate

Output of simple text to number mapping

What is the output of this Python code that converts words to their length?

NLP

words = ['cat', 'dog', 'elephant']
lengths = [len(word) for word in words]
print(lengths)

A [3, 3, 8]

B ['cat', 'dog', 'elephant']

C [5, 5, 5]

D [0, 0, 0]

💡 Hint

len(word) returns the number of characters in each word.

The code creates a list of lengths of each word: 'cat' and 'dog' have 3 letters, 'elephant' has 8.

❓ Model Choice

advanced

Choosing the right text representation for sentiment analysis

You want to build a model to detect positive or negative feelings in movie reviews. Which numerical text representation is best to capture word meanings and context?

A One-hot encoding of each word ignoring similarity

B Pretrained word embeddings like Word2Vec or GloVe capturing semantic meaning

C Bag-of-Words vector counting word frequencies without order

D Random numbers assigned to each word

💡 Hint

Consider which method captures word meanings and relationships best.

Pretrained embeddings represent words as vectors capturing semantic similarity, improving sentiment detection over simple counts or random numbers.

❓ Metrics

advanced

Evaluating text classification model performance

After converting text to numbers and training a classifier, which metric best tells you how well the model correctly identifies positive reviews?

A Recall - proportion of actual positive reviews correctly identified

B Accuracy - overall correct predictions divided by total predictions

C Precision - proportion of predicted positive reviews that are actually positive

D Loss - the error value during training

💡 Hint

Think about the metric that measures correctness of positive predictions.

Precision measures how many predicted positives are truly positive, important when false positives are costly.

🔧 Debug

expert

Debugging numerical text representation error

Given this code snippet converting text to numbers, what error will it raise?

NLP

text = 'hello world'
word_to_index = {'hello': 1, 'world': 2}
numbers = [word_to_index[word] for word in text.split() + ['!']]
print(numbers)

A No error, output will be [1, 2, 0]

B SyntaxError due to invalid list concatenation

C TypeError because split() returns a string not a list

D KeyError because '!' is not in word_to_index dictionary

💡 Hint

Check if all words exist in the dictionary before accessing.

The list includes '!' which is not a key in word_to_index, causing a KeyError when accessed.

Practice

1. Why do machines need text to be converted into numbers before learning?

easy

A. Because words are too short to process

B. Because numbers are easier to read for humans

C. Because machines only understand numbers, not words

D. Because text is always incorrect

Solution

1. Step 1: Understand machine input requirements

   Machines process data as numbers, not as text or words.

2. Step 2: Recognize the need for conversion

   Text must be converted into numbers so machines can analyze and learn from it.

3. Final Answer:

   Because machines only understand numbers, not words -> Option C

4. Quick Check:

   Text to numbers = machines understand [OK]

Hint: Machines need numbers, not words, to learn [OK]

Common Mistakes:

• Thinking machines understand words directly
• Confusing human readability with machine input
• Assuming text length matters more than format

2. Which of the following is a correct way to represent text numerically in Python?

easy

A. text_vector = {'word': 1, 'machine': 2}

B. text_vector = ['word', 'machine']

C. text_vector = 'word machine'

D. text_vector = 12345

Solution

1. Step 1: Identify numerical representation

   text_vector = {'word': 1, 'machine': 2} shows a dictionary mapping words to numbers, which is a common numerical representation.

2. Step 2: Check other options

   Options B and C are text or list of words, not numbers; A is just a number without relation to text.

3. Final Answer:

   text_vector = {'word': 1, 'machine': 2} -> Option A

4. Quick Check:

   Mapping words to numbers = correct representation [OK]

Hint: Look for word-to-number mapping in code [OK]

Common Mistakes:

• Choosing plain text or list as numerical representation
• Confusing numbers unrelated to words
• Ignoring dictionary or vector formats

3. What will be the output of this Python code snippet?

from sklearn.feature_extraction.text import CountVectorizer
texts = ['hello world', 'hello machine']
vectorizer = CountVectorizer()
X = vectorizer.fit_transform(texts)
print(X.toarray())
print(vectorizer.get_feature_names_out())

medium

A. [[1 0 1]
[1 1 0]] and ['hello' 'machine' 'world']

B. [[1 1]
[1 1]] and ['hello' 'machine' 'world']

C. [[1 1]
[1 0]] and ['hello' 'world']

D. [[1 0]
[0 1]] and ['machine' 'world']

Solution

1. Step 1: Understand CountVectorizer output

   CountVectorizer creates a vocabulary sorted alphabetically: ['hello', 'machine', 'world'].

2. Step 2: Map texts to vectors

   'hello world' maps to [1, 0, 1], 'hello machine' maps to [1, 1, 0].

3. Final Answer:

   [[1 0 1] [1 1 0]] and ['hello' 'machine' 'world'] -> Option A

4. Quick Check:

   Text to count vectors and vocabulary = [[1 0 1] [1 1 0]] and ['hello' 'machine' 'world'] [OK]

Hint: Vocabulary is alphabetical; counts match word presence [OK]

Common Mistakes:

• Mixing order of vocabulary words
• Confusing counts with binary presence
• Misreading array shapes

4. Identify the error in this code that tries to convert text to numbers:

texts = ['cat dog', 'dog mouse']
vectorizer = CountVectorizer()
X = vectorizer.transform(texts)
print(X.toarray())

medium

A. texts should be a single string, not a list

B. CountVectorizer must be fitted before transform

C. toarray() is not a valid method

D. CountVectorizer cannot handle multiple texts

Solution

1. Step 1: Check CountVectorizer usage

   CountVectorizer requires calling fit() or fit_transform() before transform() to build vocabulary.

2. Step 2: Identify missing step

   The code calls transform() without fitting, causing an error.

3. Final Answer:

   CountVectorizer must be fitted before transform -> Option B

4. Quick Check:

   fit() before transform() = correct usage [OK]

Hint: Always fit before transform with CountVectorizer [OK]

Common Mistakes:

• Skipping fit() step
• Passing list instead of string (which is allowed)
• Misunderstanding toarray() method

5. You want to prepare text data for a machine learning model. Which approach best explains why you should convert text into numbers first?

hard

A. Because text data is too large to store in memory

B. Because converting text to numbers removes spelling errors

C. Because numbers are easier for humans to read than text

D. Because numerical data allows models to calculate patterns and relationships

Solution

1. Step 1: Understand model data needs

   Machine learning models work by finding patterns in numbers, not raw text.

2. Step 2: Explain importance of numerical conversion

   Converting text to numbers lets models calculate similarities and differences to learn effectively.

3. Final Answer:

   Because numerical data allows models to calculate patterns and relationships -> Option D

4. Quick Check:

   Numbers enable pattern learning in models [OK]

Hint: Models learn patterns from numbers, not raw text [OK]

Common Mistakes:

• Thinking conversion is for memory saving
• Believing numbers are for human reading
• Assuming conversion fixes spelling