Practice
1. For an anomaly detection system using an Autoencoder, which metric is most appropriate to evaluate its performance?
easy
Solution
Step 1: Identify the key metric for Autoencoders.
Autoencoders are evaluated based on how well they can reconstruct the input data, making reconstruction error a critical metric.Step 2: Eliminate wrong options.
Accuracy is incorrect because accuracy is not informative for imbalanced datasets. Precision and D are more relevant for classification tasks, not reconstruction tasks.Final Answer:
Option B -> Option BQuick Check:
Autoencoder = reconstruction error focus [OK]
Hint: Autoencoder = reconstruction error focus [OK]
Common Mistakes:
2. In a content-based filtering system, what is a likely failure mode if item embeddings are not updated frequently?
medium
Solution
Step 1: Consider the impact of infrequent updates
Without frequent updates, item embeddings may not reflect recent changes, leading to stale recommendations.Step 2: Eliminate wrong options
A: Computational cost is not directly affected by update frequency. B: Interpretability is unrelated to update frequency. D: Overfitting is more about model complexity than update frequency.Final Answer:
Option C -> Option CQuick Check:
Infrequent updates lead to stale recommendations. [OK]
Hint: Infrequent updates lead to stale recommendations. [OK]
Common Mistakes:
3. When designing an intent classification system, should you prioritize using a deep learning model or a simpler model like logistic regression?
medium
Solution
Step 1: Consider dataset size and complexity.
Deep learning models require large datasets to perform well, while simpler models can suffice for smaller datasets.Step 2: Evaluate the trade-offs.
Always use deep learning for better accuracy: Deep learning isn't always better, especially with small datasets. Use logistic regression for faster training times: Logistic regression is faster but may not capture complex patterns. Use logistic regression if interpretability is crucial: Logistic regression is interpretable but may lack accuracy on complex tasks. Use deep learning if you have a large labeled dataset: Deep learning is suitable for large datasets where complex patterns exist.Final Answer:
Option B -> Option BQuick Check:
Deep learning needs large datasets. [OK]
Hint: Deep learning needs large datasets. [OK]
Common Mistakes:
4. In a two-stage retrieval system, what is a likely failure mode if the candidate generation stage has a low recall?
medium
Solution
Step 1: Understand the impact of low recall
Low recall in candidate generation means not enough relevant items are passed to the ranking stage.Step 2: Eliminate wrong options
The ranking stage will have too many candidates to process. is incorrect because low recall means fewer candidates, not more. The system will return irrelevant results to the user. is incorrect because irrelevant results are more about precision issues. The system will have high computational costs in the ranking stage. is incorrect because low recall reduces computational costs, not increases them.Final Answer:
Option C -> Option CQuick Check:
Low recall means not enough relevant items. [OK]
Hint: Low recall means not enough relevant items. [OK]
Common Mistakes:
5. As a vision-language model scales to handle 10x more data, which component is most likely to become a bottleneck first?
hard
Solution
Step 1: Consider the impact of scaling data
Handling 10x more data increases the load on data preprocessing significantly.Step 2: Identify the first bottleneck
Data preprocessing often becomes a bottleneck before training or inference as it needs to handle and prepare large volumes of data efficiently.Final Answer:
Option C -> Option CQuick Check:
Scaling data stresses preprocessing first. [OK]
Hint: Scaling data stresses preprocessing first. [OK]
Common Mistakes: