Bird
0
0

Which component in the attention mechanism represents the 'query'?

easy📝 Conceptual Q2 of 15
NLP - Sequence Models for NLP
Which component in the attention mechanism represents the 'query'?
AThe vector used to normalize scores
BThe vector containing all possible answers
CThe output vector after attention
DThe vector representing what we want to find
Step-by-Step Solution
Solution:

  1. Step 1: Define the query in attention

    The query is the vector representing what we want to find or focus on in the input.

  2. Step 2: Match options to this definition

    The vector representing what we want to find correctly describes the query as what we want to find.

  3. Final Answer:

    The vector representing what we want to find -> Option D

  4. Quick Check:

    Query = What we want to find [OK]
Quick Trick: Query asks what to focus on [OK]
Common Mistakes:
MISTAKES
  • Confusing query with keys or values
  • Thinking query is output
  • Mixing query with normalization step

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More NLP Quizzes
Sentiment Analysis Advanced - Aspect-based sentiment analysis - Quiz 5medium Sequence Models for NLP - Embedding layer usage - Quiz 13medium Sequence Models for NLP - GRU for text - Quiz 2easy Sequence Models for NLP - Padding and sequence length - Quiz 7medium Text Similarity and Search - Semantic similarity with embeddings - Quiz 8hard Text Similarity and Search - Semantic similarity with embeddings - Quiz 11easy Topic Modeling - Choosing number of topics - Quiz 10hard Topic Modeling - LDA with scikit-learn - Quiz 8hard Word Embeddings - Pre-trained embedding usage - Quiz 11easy Word Embeddings - GloVe embeddings - Quiz 13medium