Consumer configuration in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the purpose of the group.id configuration in Kafka consumer?

The group.id identifies the consumer group this consumer belongs to. Consumers in the same group share the work of consuming topics, allowing for load balancing and fault tolerance.

beginner

What does the auto.offset.reset setting control in Kafka consumer configuration?

It controls what happens when there is no initial offset or if the current offset is invalid. Common values are earliest (start from the beginning) or latest (start from the end).

intermediate

Explain the role of enable.auto.commit in Kafka consumer configuration.

This setting controls whether the consumer automatically commits offsets periodically. If true, offsets are committed automatically; if false, the application must commit offsets manually.

intermediate

What is the effect of setting max.poll.records in Kafka consumer?

It limits the maximum number of records returned in a single call to poll(). This helps control the batch size for processing and can affect latency and throughput.

intermediate

Why is session.timeout.ms important in Kafka consumer configuration?

It defines the time the consumer can be out of contact with the Kafka broker before being considered dead. This helps Kafka detect failed consumers and trigger rebalancing.

What does setting enable.auto.commit to false mean?

A The consumer will not consume any messages.

B The consumer will commit offsets automatically.

C The consumer will not commit offsets automatically; manual commit is required.

D The consumer will reset offsets to earliest.

When enable.auto.commit is false, the application must manually commit offsets to track progress.

Which configuration controls the consumer group a Kafka consumer belongs to?

A group.id

B auto.offset.reset

C max.poll.records

D session.timeout.ms

group.id sets the consumer group identity.

If you want a consumer to start reading from the beginning of a topic when no offset is found, which auto.offset.reset value should you use?

A earliest

B none

C latest

D auto

The earliest value makes the consumer start from the beginning of the topic.

What does max.poll.records affect in Kafka consumer?

A The maximum number of consumer groups.

B The maximum number of messages fetched in one poll call.

C The maximum size of a message.

D The maximum time to wait for a poll.

max.poll.records limits how many records are returned per poll.

Why is session.timeout.ms important?

A It sets the timeout for message processing.

B It sets the maximum poll interval.

C It controls the offset commit interval.

D It defines how long a consumer can be silent before considered dead.

session.timeout.ms helps Kafka detect failed consumers by timing out silent ones.

Describe the key Kafka consumer configuration settings needed to manage offset commits and consumer group membership.

Think about how Kafka tracks what messages a consumer has read and how consumers work together.

Explain how max.poll.records and session.timeout.ms affect consumer performance and reliability.

Consider how many messages are processed at once and how Kafka knows if a consumer is alive.