Bird
Raised Fist0

Why might a sink connector silently drop some records when writing to an external system?

hard🧠 Conceptual Q10 of Q15
Kafka - Connect

Why might a sink connector silently drop some records when writing to an external system?

ABecause Kafka topics do not support duplicates
BBecause sink connectors only process new topics
CBecause of duplicate keys in the sink connector's internal map, last record wins
DBecause tasks.max is set too low
Step-by-Step Solution
Solution:

  1. Step 1: Understand sink connector internal behavior

    Some sink connectors use internal maps keyed by record keys; duplicates overwrite previous entries.

  2. Step 2: Recognize effect on records

    Duplicate keys cause earlier records to be silently dropped, last record wins.

  3. Final Answer:

    Because of duplicate keys in the sink connector's internal map, last record wins -> Option C

  4. Quick Check:

    Duplicate keys overwrite previous records [OK]
Quick Trick: Duplicate keys overwrite previous records in sink connector [OK]
Common Mistakes:
MISTAKES
  • Assuming Kafka topics prevent duplicates
  • Thinking sink connectors skip topics
  • Believing tasks.max affects record dropping

Want More Practice?

15+ quiz questions · All difficulty levels · Free

Free Signup - Practice All Questions
More Kafka Quizzes
Kafka Connect - Kafka Connect architecture - Quiz 1easy Kafka Connect - Kafka Connect architecture - Quiz 12easy Kafka Streams - Why stream processing transforms data - Quiz 11easy Kafka with Java/Python - Error handling in clients - Quiz 6medium Kafka with Java/Python - Python consumer - Quiz 3easy Message Delivery Semantics - At-least-once delivery - Quiz 9hard Message Delivery Semantics - Consumer offset commit strategies - Quiz 3easy Message Delivery Semantics - Exactly-once semantics (EOS) - Quiz 12easy Monitoring and Operations - Why monitoring prevents outages - Quiz 6medium Monitoring and Operations - Log compaction - Quiz 2easy