Practice
Solution
Step 1: Understand shadow mode request routing
Shadow mode runs new models in parallel without affecting live traffic. So, requests are sent to both models.Step 2: Identify response behavior
Only the production model's prediction is returned to the client; shadow model predictions are logged for evaluation.Final Answer:
Option A -> Option AQuick Check:
Shadow mode duplicates requests but returns production output [check]
Solution
Step 1: Identify deployment isolation needs
Decoupling feature deployments requires independent service lifecycles, which microservices provide.Step 2: Evaluate alternatives
Monoliths (A and C) share deployment units, risking system-wide impact. Serverless (D) can be tightly coupled if functions share state or deployment.Final Answer:
Option A -> Option AQuick Check:
Microservices enable independent deploys and reduce blast radius [check]
Solution
Step 1: Identify rate limiting with burst support
The token bucket algorithm allows tokens to accumulate up to a max bucket size, enabling bursts beyond the steady refill rate.Step 2: Eliminate other options
Fixed window counters cause spikes at window boundaries and don't handle bursts well. Leaky bucket smooths traffic but disallows bursts. Simple queues drop excess requests without rate control.Final Answer:
Option D -> Option DQuick Check:
Token bucket allows bursts by token accumulation [check]
Solution
Step 1: Understand Kafka's role in update pipeline
Kafka streams code updates to vector index workers; if down, updates stop flowing.Step 2: Trace impact on components
Retriever can still serve existing embeddings (A and B incorrect); system does not lose all events permanently due to Kafka's durability (D incorrect).Step 3: Identify generator failure
Without fresh embeddings, generator lacks up-to-date context, causing failures or degraded completions (C correct).Final Answer:
Option A -> Option AQuick Check:
Kafka down blocks embedding updates, generator lacks context [check]
Solution
Step 1: Analyze component scaling characteristics
Load Balancers typically handle stateless TCP connections and can be scaled horizontally; Reverse Proxies cache but can be scaled with eviction policies; DNS load balancing is not a runtime bottleneck.Step 2: Identify CPU-intensive bottleneck
API Gateway performs authentication, rate limiting, and transformations per request, which are CPU and memory intensive and harder to scale linearly.Final Answer:
Option A -> Option AQuick Check:
API Gateway CPU load scales with request complexity, causing bottleneck [check]
