Producer API basics in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is the main role of a Kafka Producer?

A Kafka Producer sends data (messages) to Kafka topics. It acts like a sender delivering messages to a mailbox (topic) where consumers can later read them.

beginner

What is a Kafka topic in the context of the Producer API?

A topic is like a category or folder where messages are stored. Producers send messages to a specific topic, and consumers read from it.

intermediate

What does the 'key' in a Kafka Producer record do?

The key helps Kafka decide which partition of the topic the message goes to. Messages with the same key go to the same partition, keeping order.

intermediate

What is the purpose of the 'acks' setting in Kafka Producer configuration?

The 'acks' setting controls how many Kafka servers must confirm a message before the producer considers it sent. It balances speed and safety.

beginner

How does the Producer API handle message serialization?

The Producer API converts data into bytes before sending. You choose serializers (like StringSerializer) to turn your data into bytes Kafka can send.

What does a Kafka Producer do?

A Manages Kafka cluster nodes

B Reads messages from Kafka topics

C Stores messages permanently

D Sends messages to Kafka topics

A Kafka Producer's job is to send messages to topics where consumers can later read them.

Which Kafka Producer setting controls message durability confirmation?

A acks

B batch.size

C linger.ms

D buffer.memory

The 'acks' setting controls how many Kafka servers must confirm a message before the producer considers it sent.

Why is the 'key' important in a Kafka Producer record?

A It determines the partition for the message

B It encrypts the message

C It sets the message priority

D It defines the message format

The key helps Kafka decide which partition the message goes to, ensuring order for messages with the same key.

What must a Kafka Producer do before sending data?

A Create a consumer group

B Serialize the data into bytes

C Compress the data manually

D Delete old messages

The Producer API serializes data into bytes using serializers before sending it to Kafka.

Which component receives messages sent by a Kafka Producer?

A Kafka Consumer

B Kafka Broker

C Kafka Topic

D Kafka Zookeeper

Messages sent by a Producer are stored in Kafka Topics.

Explain how a Kafka Producer sends messages and what role the topic and key play in this process.

Think about sending mail to a mailbox and sorting by address.

Describe the importance of the 'acks' setting in Kafka Producer configuration and how it affects message delivery.

Consider how many people need to say 'I got it' before you feel safe.

Practice

1. What is the main purpose of the Kafka Producer API?

easy

A. To send messages to Kafka topics

B. To read messages from Kafka topics

C. To manage Kafka cluster configurations

D. To monitor Kafka broker health

Solution

1. Step 1: Understand Kafka Producer role

   The Producer API is designed to send data to Kafka topics, acting as the message sender.

2. Step 2: Differentiate from other Kafka APIs

   Reading messages is done by the Consumer API, not the Producer API.

3. Final Answer:

   To send messages to Kafka topics -> Option A

4. Quick Check:

   Producer API = send messages [OK]

Hint: Producer API sends data; Consumer API reads data [OK]

Common Mistakes:

• Confusing Producer with Consumer API
• Thinking Producer manages cluster
• Assuming Producer monitors brokers

2. Which of the following is the correct way to create a Kafka Producer in Java?

easy

A. Producer<String> producer = new Producer(props);

B. KafkaProducer producer = new KafkaProducer<>(props);

C. KafkaProducer producer = new KafkaProducer();

D. KafkaProducer producer = KafkaProducer.create(props);

Solution

1. Step 1: Recall KafkaProducer constructor usage

   The KafkaProducer class requires properties and type parameters for key and value types.

2. Step 2: Check each option's syntax

   KafkaProducer producer = new KafkaProducer<>(props); correctly uses generics and constructor with properties. Others miss generics, constructor, or use invalid methods.

3. Final Answer:

   KafkaProducer producer = new KafkaProducer<>(props); -> Option B

4. Quick Check:

   Correct constructor with generics = KafkaProducer producer = new KafkaProducer<>(props); [OK]

Hint: Use new KafkaProducer<>(props) with key and value types [OK]

Common Mistakes:

• Omitting generics for key and value
• Using wrong constructor or method
• Not passing properties object

3. What will be the output of the following Java code snippet?

Properties props = new Properties();
props.put("bootstrap.servers", "localhost:9092");
props.put("key.serializer", "org.apache.kafka.common.serialization.StringSerializer");
props.put("value.serializer", "org.apache.kafka.common.serialization.StringSerializer");
KafkaProducer producer = new KafkaProducer<>(props);
ProducerRecord record = new ProducerRecord<>("my-topic", "key1", "value1");
producer.send(record);
System.out.println("Message sent");
producer.close();

medium

A. No output

B. Compilation error

C. Message sent

D. Runtime exception due to missing topic

Solution

1. Step 1: Analyze producer setup and send call

   The code sets up properties correctly, creates a producer, and sends a message to "my-topic" with key and value.

2. Step 2: Check output statement and close

   After sending, it prints "Message sent" and closes the producer. No errors expected if Kafka broker is running.

3. Final Answer:

   Message sent -> Option C

4. Quick Check:

   Successful send prints message [OK]

Hint: If send() succeeds, print statement runs [OK]

Common Mistakes:

• Assuming send() is synchronous and blocks
• Thinking missing topic causes error here
• Ignoring need for running Kafka broker

4. Identify the error in this Kafka Producer code snippet:

Properties props = new Properties();
props.put("bootstrap.servers", "localhost:9092");
props.put("key.serializer", "StringSerializer");
props.put("value.serializer", "StringSerializer");
KafkaProducer producer = new KafkaProducer<>(props);
ProducerRecord record = new ProducerRecord<>("topic", "key", "value");
producer.send(record);
producer.close();

medium

A. Missing topic name in ProducerRecord

B. Properties object not initialized

C. Producer not closed properly

D. Incorrect serializer class names

Solution

1. Step 1: Check serializer class names in properties

   The serializer values must be full class names like "org.apache.kafka.common.serialization.StringSerializer".

2. Step 2: Verify other code parts

   Topic name is present, producer is closed properly, and properties object is initialized correctly.

3. Final Answer:

   Incorrect serializer class names -> Option D

4. Quick Check:

   Serializer class names must be full package names [OK]

Hint: Use full serializer class names with package [OK]

Common Mistakes:

• Using short class names without package
• Forgetting to close producer
• Leaving topic name empty

5. You want to send messages with keys to ensure ordering per key in Kafka. Which ProducerRecord constructor should you use?

hard

A. ProducerRecord(String topic, K key, V value)

B. ProducerRecord(String topic, V value)

C. ProducerRecord(K key, V value)

D. ProducerRecord(String topic)

Solution

1. Step 1: Understand ordering by key in Kafka

   Kafka guarantees ordering within a partition, and keys determine partition assignment.

2. Step 2: Identify correct ProducerRecord constructor

   To send with a key, use the constructor that includes topic, key, and value.

3. Final Answer:

   ProducerRecord(String topic, K key, V value) -> Option A

4. Quick Check:

   Use constructor with topic, key, and value for ordering [OK]

Hint: Include key in ProducerRecord to maintain order [OK]

Common Mistakes:

• Using constructor without key loses ordering
• Omitting topic causes errors
• Confusing key and value parameters