ZooKeeper role (and KRaft replacement) in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the primary role of ZooKeeper in Apache Kafka?

ZooKeeper manages the Kafka cluster metadata, including broker information, topic configurations, and leader election for partitions. It helps keep the cluster coordinated and consistent.

beginner

How does ZooKeeper help with leader election in Kafka?

ZooKeeper keeps track of which broker is the leader for each partition. When a leader fails, ZooKeeper helps elect a new leader to maintain availability and consistency.

intermediate

What is KRaft in the context of Kafka?

KRaft (Kafka Raft) is Kafka's built-in consensus mechanism designed to replace ZooKeeper. It manages metadata internally using the Raft protocol, simplifying Kafka's architecture.

intermediate

Name one advantage of KRaft over ZooKeeper in Kafka.

KRaft removes the need for an external ZooKeeper service, reducing operational complexity and improving scalability by managing metadata within Kafka brokers themselves.

advanced

What happens to Kafka's metadata management when switching from ZooKeeper to KRaft?

Kafka brokers themselves form a quorum using the Raft protocol to manage metadata, eliminating the external dependency on ZooKeeper and enabling a more streamlined cluster management.

What does ZooKeeper primarily manage in a Kafka cluster?

A Cluster metadata and leader election

B Message storage

C Consumer offset tracking only

D Network communication

ZooKeeper manages cluster metadata and helps with leader election in Kafka.

What protocol does KRaft use to manage Kafka metadata internally?

A Paxos

B Raft

C Two-phase commit

D Gossip

KRaft uses the Raft consensus protocol to manage metadata inside Kafka brokers.

Which of the following is a benefit of using KRaft over ZooKeeper?

A Removes external dependency on ZooKeeper

B Increases operational complexity

C Requires an external service

D Slower metadata updates

KRaft removes the need for an external ZooKeeper service, simplifying Kafka's operation.

In Kafka with ZooKeeper, what triggers a new leader election?

A Message production

B New topic creation

C Consumer joining

D Broker failure

When a broker fails, ZooKeeper helps elect a new leader for the affected partitions.

Which Kafka component is responsible for metadata management in KRaft mode?

A ZooKeeper

B Kafka producers

C Kafka brokers forming a quorum

D Kafka consumers

In KRaft mode, Kafka brokers themselves form a quorum to manage metadata.

Explain the role of ZooKeeper in Kafka and why Kafka is moving towards KRaft.

Think about how Kafka manages metadata and what problems KRaft solves.

Describe how KRaft changes the architecture of Kafka compared to using ZooKeeper.

Focus on the shift from external to internal metadata management.