Practice
Solution
Step 1: Understand Duplicate Detection behavior at Step 5
If the URL has been seen before, it is filtered out to prevent redundant crawling.Step 2: Eliminate other options
Re-queuing duplicates wastes resources; marking for delayed re-crawl is a separate process; Politeness Policy Manager handles timing, not duplication.Final Answer:
Option A -> Option AQuick Check:
Duplicate Detection discards seen URLs to avoid redundancy [check]
Solution
Step 1: Identify real-time aggregation needs
Millions of listings require low-latency updates; immediate consistency is not mandatory.Step 2: Evaluate architectures
Relational DB (A) is costly and slow at scale; batch jobs (C) have high latency; NoSQL denormalization (D) risks write amplification and stale data. Stream processing (B) provides scalable, low-latency aggregation with eventual consistency.Final Answer:
Option A -> Option AQuick Check:
Stream processing enables scalable real-time aggregation with eventual consistency [check]
Solution
Step 1: Analyze write scalability and read patterns
High write throughput and millions of users require scalable writes and efficient feed reads.Step 2: Evaluate referencing with denormalization
Referencing separates concerns; denormalizing popular posts into feeds optimizes read performance without large documents.Final Answer:
Option D -> Option DQuick Check:
Referencing plus denormalization balances write scale and read speed [check]
Solution
Step 1: Identify role of durable queue
Kafka decouples sender and receiver; without it, sender waits synchronously for receiver's ack.Step 2: Trace failure without Kafka
If Bob's server crashes, no ack arrives, send blocks indefinitely and message is lost with no retry mechanism.Final Answer:
Option D -> Option DQuick Check:
No Kafka -> synchronous send blocks, message lost if receiver crashes [check]
Solution
Step 1: Understand modular hashing failure on node removal
Modular hashing requires remapping all keys, causing performance degradation and cache misses.Step 2: Evaluate options
The system automatically replicates keys to other nodes without delay incorrectly assumes automatic replication without delay; Clients continue to query the removed node causing request failures is invalid as clients rely on updated routing.Final Answer:
Option B -> Option BQuick Check:
Without consistent hashing, remapping causes cache stampede, no instant replication [check]
