Rebalancing behavior in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is rebalancing in Kafka consumer groups?

Rebalancing is the process where Kafka redistributes partitions among consumers in a group when consumers join, leave, or fail. It ensures all partitions are assigned to active consumers.

beginner

When does Kafka trigger a rebalance?

Kafka triggers a rebalance when a consumer joins or leaves the group, or when a consumer crashes. This helps keep partition assignments balanced.

intermediate

What happens to message processing during a Kafka rebalance?

During rebalance, consumers stop fetching messages temporarily. This pause ensures partitions are reassigned safely but can cause a short delay in processing.

intermediate

How can you minimize rebalance impact in Kafka?

You can minimize rebalance impact by tuning session timeouts, using static group membership, and handling partition assignments efficiently in your consumer code.

advanced

What is static membership in Kafka rebalancing?

Static membership allows consumers to keep their identity across restarts, reducing unnecessary rebalances and improving stability during consumer restarts.

What triggers a Kafka consumer group rebalance?

A A consumer joins or leaves the group

B A message is produced to a topic

C A consumer reads a message

D A topic is deleted

Rebalance happens when consumers join or leave the group to redistribute partitions.

During rebalance, what happens to message consumption?

A Consumers continue reading without interruption

B Consumers pause fetching messages temporarily

C Messages are lost

D New partitions are created

Consumers pause fetching messages during rebalance to safely reassign partitions.

Which Kafka feature helps reduce unnecessary rebalances?

A Static membership

B Dynamic partitioning

C Auto commit

D Message batching

Static membership keeps consumer identity stable, reducing rebalances.

What is a common cause of frequent rebalances?

A Topic compaction

B Long consumer processing time

C High message production rate

D Consumers frequently joining and leaving

Frequent consumer group membership changes cause frequent rebalances.

How can you tune Kafka to reduce rebalance delays?

A Decrease session timeout

B Disable consumer groups

C Increase session timeout

D Increase message size

Increasing session timeout gives consumers more time before considered dead, reducing rebalance frequency.

Explain what happens during Kafka consumer group rebalancing and why it is necessary.

Think about how Kafka keeps consumers working evenly.

Describe ways to reduce the impact of rebalancing on Kafka consumers.

Focus on configuration and consumer behavior.