Why consumers process messages in Kafka - Challenge Your Understanding

Challenge - 5 Problems

❓ Predict Output

intermediate

What is the output of this Kafka consumer code snippet?

Consider a Kafka consumer configured to read messages from a topic. What will be printed when the consumer processes messages?

Kafka

from kafka import KafkaConsumer

consumer = KafkaConsumer('test-topic', bootstrap_servers=['localhost:9092'])
for message in consumer:
    print(f"Received: {message.value.decode('utf-8')}")
    break

A Received: Hello World

B Received: b'Hello World'

C Received: None

D SyntaxError

💡 Hint

Remember that Kafka messages are bytes and need decoding.

KafkaConsumer returns messages as bytes. Decoding with utf-8 converts bytes to string, so the output is the string message content.

🧠 Conceptual

intermediate

Why do Kafka consumers commit offsets after processing messages?

Choose the main reason why Kafka consumers commit offsets after processing messages.

A To encrypt messages for security

B To increase the speed of message consumption

C To delete messages from the Kafka topic

D To track which messages have been processed and avoid reprocessing

💡 Hint

Think about how consumers know where to continue after a restart.

Committing offsets tells Kafka which messages the consumer has processed. This prevents processing the same message multiple times after a restart.

🔧 Debug

advanced

What error will this Kafka consumer code raise?

Identify the error raised by this Kafka consumer code snippet.

Kafka

from kafka import KafkaConsumer

consumer = KafkaConsumer('topic1', bootstrap_servers=['localhost:9092'])
for message in consumer:
    print(message.value.upper())

A AttributeError: 'bytes' object has no attribute 'upper'

B NameError: name 'message' is not defined

C No error, prints uppercase message

D TypeError: unsupported operand type(s) for +: 'int' and 'str'

💡 Hint

Remember the type of message.value in KafkaConsumer.

Kafka messages are bytes. Calling upper() directly on bytes raises AttributeError because bytes do not have upper() method.

🚀 Application

advanced

How to ensure exactly-once processing in Kafka consumers?

Which approach helps Kafka consumers achieve exactly-once processing of messages?

A Use multiple consumers in the same group without coordination

B Use idempotent producers and commit offsets after processing

C Commit offsets before processing messages

D Consume messages without committing offsets

💡 Hint

Think about avoiding duplicates and message loss.

Idempotent producers avoid duplicate writes. Committing offsets after processing ensures messages are processed once and offsets reflect that.

❓ Predict Output

expert

What is the output of this Kafka consumer batch processing code?

Given this Kafka consumer code that processes messages in batches, what will be the output?

Kafka

from kafka import KafkaConsumer

consumer = KafkaConsumer('batch-topic', bootstrap_servers=['localhost:9092'], max_poll_records=3)

batch = []
for message in consumer:
    batch.append(message.value.decode('utf-8'))
    if len(batch) == 3:
        print(batch)
        batch.clear()
        break

A ['msg1', 'msg2']

B ['msg1']

C ['msg1', 'msg2', 'msg3']

D SyntaxError

💡 Hint

max_poll_records controls how many messages are fetched per poll.

The consumer fetches up to 3 messages per poll. The code collects 3 messages, prints them as a list, then breaks the loop.