Bird
0
0

In the context of temperature scaling for logits, what is the correct way to adjust logits before applying softmax?

medium📝 Debug Q6 of 15
NLP - Text Generation
In the context of temperature scaling for logits, what is the correct way to adjust logits before applying softmax?
ASubtract temperature from logits
BMultiply logits by temperature
CAdd temperature to logits
DDivide logits by temperature
Step-by-Step Solution
Solution:

  1. Step 1: Understand temperature scaling

    Temperature scaling adjusts the sharpness of the probability distribution by dividing logits by the temperature value.

  2. Step 2: Apply correct operation

    Multiplying logits by temperature increases their magnitude incorrectly; the correct operation is dividing logits by temperature.

  3. Final Answer:

    Divide logits by temperature -> Option D

  4. Quick Check:

    Check if logits are divided, not multiplied [OK]
Quick Trick: Divide logits by temperature before softmax [OK]
Common Mistakes:
MISTAKES
  • Multiplying logits by temperature instead of dividing
  • Adding or subtracting temperature to logits
  • Not applying temperature scaling at all

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More NLP Quizzes
Sequence Models for NLP - Attention mechanism basics - Quiz 4medium Sequence Models for NLP - Embedding layer usage - Quiz 2easy Text Generation - Beam search decoding - Quiz 12easy Text Similarity and Search - Semantic similarity with embeddings - Quiz 10hard Topic Modeling - Latent Dirichlet Allocation (LDA) - Quiz 6medium Topic Modeling - Choosing number of topics - Quiz 5medium Topic Modeling - LDA with Gensim - Quiz 11easy Topic Modeling - Topic coherence evaluation - Quiz 12easy Word Embeddings - GloVe embeddings - Quiz 13medium Word Embeddings - FastText embeddings - Quiz 4medium