Word similarity and analogies in NLP - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is word similarity in NLP?

Word similarity measures how close or related two words are in meaning, often using numbers to show how similar they are.

beginner

How do word embeddings help find word similarity?

Word embeddings turn words into numbers (vectors) so we can use math to find how close words are, showing their similarity.

intermediate

What is a common method to measure similarity between word vectors?

Cosine similarity measures the angle between two word vectors to find how similar their meanings are.

beginner

Explain word analogies with an example.

Word analogies show relationships like 'king is to queen as man is to woman'. It means the difference between king and queen is like the difference between man and woman.

intermediate

How can word embeddings solve analogies?

By using vector math: for example, vector('king') - vector('man') + vector('woman') is close to vector('queen'). This helps find the missing word in analogies.

What does a high cosine similarity between two word vectors indicate?

A The words appear in the same sentence

B The words are spelled similarly

C The words have similar meanings

D The words have opposite meanings

Cosine similarity measures how close two word vectors are in meaning, so a high value means similar meanings.

Which of these is an example of a word analogy?

A 'cat' is to 'kitten' as 'dog' is to 'puppy'

B 'cat' rhymes with 'hat'

C 'cat' and 'dog' are both animals

D 'cat' is spelled with three letters

Word analogies show relationships between pairs of words, like parent to child.

What is the main purpose of word embeddings?

A To translate words into another language

B To count how many times a word appears

C To check spelling mistakes

D To convert words into numbers for math operations

Word embeddings turn words into vectors so computers can understand and compare their meanings.

In the analogy 'man is to king as woman is to ?', which word fits best?

A lady

B queen

C girl

D prince

The relationship between man and king is similar to woman and queen.

Which metric is commonly used to measure similarity between word vectors?

A Cosine similarity

B Euclidean distance

C Jaccard index

D Manhattan distance

Cosine similarity measures the angle between vectors, which works well for word meaning comparison.

Describe how word embeddings help in finding word similarity and solving analogies.

Think about how numbers can represent words and how math can find relationships.

Explain the concept of word analogies with a simple example.

Use a real-life example comparing two pairs of related words.