Kafka - Performance Tuning
You want to optimize a Kafka producer for maximum throughput but still ensure messages are not lost. Which combination of settings is best?
You want to optimize a Kafka producer for maximum throughput but still ensure messages are not lost. Which combination of settings is best?
hard📝 Application Q15 of 15
Step-by-Step Solution
Solution:
Step 1: Maximize throughput with batching and linger
Large batch.size (65536) and linger.ms (20ms) allow grouping many messages before sending.Step 2: Ensure reliability and compression
acks=allensures all replicas confirm, preventing loss. Compression (snappy) reduces data size, improving throughput.Final Answer:
batch.size=65536, linger.ms=20, acks=all, compression.type=snappy -> Option DQuick Check:
Large batch + linger + acks=all + compression = batch.size=65536, linger.ms=20, acks=all, compression.type=snappy [OK]
Quick Trick: Big batch + linger + acks=all + compression = best throughput + safety [OK]
Common Mistakes:
MISTAKES- Choosing acks=0 losing reliability
- Using too small batch sizes
- Ignoring compression benefits
Master "Performance Tuning" in Kafka
Want More Practice?
15+ quiz questions · All difficulty levels · Free
Free Signup - Practice All QuestionsMore Kafka Quizzes