Bird
0
0

Which sampling method is most affected by the temperature parameter in language models?

easy📝 Conceptual Q2 of 15
NLP - Text Generation
Which sampling method is most affected by the temperature parameter in language models?
AGreedy sampling
BRandom uniform sampling
CTemperature-scaled softmax sampling
DTop-k sampling
Step-by-Step Solution
Solution:

  1. Step 1: Identify sampling methods

    Greedy picks highest probability, top-k limits choices, uniform ignores probabilities.

  2. Step 2: Temperature affects probability distribution

    Temperature scales logits before softmax, changing probabilities used in sampling.

  3. Final Answer:

    Temperature-scaled softmax sampling -> Option C

  4. Quick Check:

    Temperature affects softmax probabilities [OK]
Quick Trick: Temperature changes softmax probabilities, not greedy picks [OK]
Common Mistakes:
MISTAKES
  • Thinking temperature affects greedy sampling
  • Confusing top-k with temperature scaling
  • Assuming uniform sampling uses temperature

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More NLP Quizzes
Sequence Models for NLP - Attention mechanism basics - Quiz 4medium Sequence Models for NLP - Embedding layer usage - Quiz 2easy Text Generation - Beam search decoding - Quiz 12easy Text Similarity and Search - Semantic similarity with embeddings - Quiz 10hard Topic Modeling - Latent Dirichlet Allocation (LDA) - Quiz 6medium Topic Modeling - Choosing number of topics - Quiz 5medium Topic Modeling - LDA with Gensim - Quiz 11easy Topic Modeling - Topic coherence evaluation - Quiz 12easy Word Embeddings - GloVe embeddings - Quiz 13medium Word Embeddings - FastText embeddings - Quiz 4medium