Kafka - Consumers
To ensure a Kafka consumer commits offsets only after successfully processing a batch of messages, which configuration should be used?
To ensure a Kafka consumer commits offsets only after successfully processing a batch of messages, which configuration should be used?
hard📝 Application Q8 of 15
Step-by-Step Solution
Solution:
Step 1: Understand auto commit behavior
Whenenable.auto.commitis true, offsets are committed automatically at intervals, which may commit offsets before processing completes.Step 2: Manual commit for batch processing
Settingenable.auto.committo false allows the application to commit offsets manually after processing a batch successfully.Step 3: Other options
auto.offset.resetcontrols offset reset behavior,max.poll.recordscontrols batch size but not commit behavior, and auto commit with low interval risks premature commits.Final Answer:
Set enable.auto.commit to false and commit offsets manually after processing -> Option DQuick Check:
Manual commit requires disabling auto commit [OK]
Quick Trick: Disable auto commit to manually commit offsets after processing [OK]
Common Mistakes:
- Relying on auto commit for batch processing
- Confusing offset reset with commit control
- Setting max.poll.records to control commits
Master "Consumers" in Kafka
Want More Practice?
15+ quiz questions · All difficulty levels · Free
Free Signup - Practice All QuestionsMore Kafka Quizzes