Bird
0
0

Which aspect of generated text quality does the BLEU metric primarily assess?

easy📝 Conceptual Q1 of 15
NLP - Text Generation
Which aspect of generated text quality does the BLEU metric primarily assess?
AThe overlap of n-grams between candidate and reference texts
BThe semantic similarity using word embeddings
CThe grammatical correctness of the candidate text
DThe length difference between candidate and reference texts
Step-by-Step Solution
Solution:

  1. Step 1: Understand BLEU's purpose

    BLEU measures how many n-grams in the candidate text appear in the reference text(s).

  2. Step 2: Eliminate other options

    Semantic similarity (B) is not BLEU's focus; grammatical correctness (C) and length difference (D) are not directly measured by BLEU.

  3. Final Answer:

    The overlap of n-grams between candidate and reference texts -> Option A

  4. Quick Check:

    BLEU uses n-gram precision [OK]
Quick Trick: BLEU counts matching n-grams, not semantics or grammar [OK]
Common Mistakes:
MISTAKES
  • Confusing BLEU with semantic similarity metrics
  • Assuming BLEU measures grammar or fluency
  • Thinking BLEU penalizes length differences directly

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More NLP Quizzes
Sentiment Analysis Advanced - Lexicon-based approaches (VADER) - Quiz 3easy Sentiment Analysis Advanced - Hybrid approaches - Quiz 5medium Sequence Models for NLP - Why sequence models understand word order - Quiz 13medium Text Generation - Language modeling concept - Quiz 5medium Text Generation - Language modeling concept - Quiz 15hard Text Similarity and Search - Edit distance (Levenshtein) - Quiz 10hard Topic Modeling - Topic coherence evaluation - Quiz 2easy Topic Modeling - Choosing number of topics - Quiz 12easy Word Embeddings - Word2Vec (CBOW and Skip-gram) - Quiz 12easy Word Embeddings - Pre-trained embedding usage - Quiz 6medium