Why topics organize messages in Kafka - See It in Action

Understanding Kafka Topics and Message Organization

📖 Scenario: You are working on a messaging system where different types of messages need to be organized clearly. Kafka uses topics to keep messages grouped by their purpose or category.

🎯 Goal: Learn how Kafka topics organize messages so that producers send messages to the right place and consumers read only the messages they need.

📋 What You'll Learn

Create a Kafka topic named orders to hold order messages

Create a Kafka topic named payments to hold payment messages

Write a simple producer code snippet to send a message to the orders topic

Write a simple consumer code snippet to read messages from the orders topic

💡 Why This Matters

🌍 Real World

In real systems, topics help separate different kinds of data like orders, payments, and user actions so they don't get mixed up.

💼 Career

Understanding Kafka topics is important for roles in data engineering, backend development, and system architecture where message streaming is used.

1

Create Kafka topics for message organization

Write the Kafka commands to create two topics named orders and payments.

Kafka

# Write Kafka CLI commands to create topics 'orders' and 'payments'
# Your code here

Need a hint?

Use kafka-topics --create command with --topic option to create each topic.

2

Set up a producer to send messages to the orders topic

Write a Kafka producer command to send the message 'Order123 placed' to the orders topic.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
kafka-topics --create --topic payments --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
# Write Kafka producer command to send 'Order123 placed' to 'orders' topic
# Your code here

Need a hint?

Use kafka-console-producer with --topic orders and send the message using input redirection.

3

Set up a consumer to read messages from the orders topic

Write a Kafka consumer command to read messages from the orders topic starting from the beginning.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
kafka-topics --create --topic payments --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
echo 'Order123 placed' | kafka-console-producer --topic orders --bootstrap-server localhost:9092
# Write Kafka consumer command to read from 'orders' topic from the beginning
# Your code here

Need a hint?

Use kafka-console-consumer with --topic orders and --from-beginning to read all messages.

4

Display the message read from the orders topic

Run the consumer command and write the exact output it shows for the message sent to the orders topic.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
kafka-topics --create --topic payments --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
echo 'Order123 placed' | kafka-console-producer --topic orders --bootstrap-server localhost:9092
kafka-console-consumer --topic orders --bootstrap-server localhost:9092 --from-beginning --max-messages 1
# Write the exact output shown by the consumer
# Your code here

Need a hint?

The consumer will print the message exactly as sent: Order123 placed.