Why Kafka exists - See It in Action

Understanding Why Kafka Exists

📖 Scenario: Imagine you work at a company that needs to handle lots of messages from different parts of the system, like orders, payments, and notifications. These messages must be sent quickly and reliably between different services.

🎯 Goal: You will learn why Kafka was created by setting up a simple example of message passing and understanding the problems Kafka solves.

📋 What You'll Learn

Create a topic to hold messages

Produce messages to the topic

Consume messages from the topic

Understand the need for a fast, reliable messaging system

💡 Why This Matters

🌍 Real World

Many companies use Kafka to handle real-time data streams like orders, logs, and user activity.

💼 Career

Understanding Kafka is important for roles in data engineering, backend development, and system architecture.

1

Create a Kafka topic called orders

Write the command to create a Kafka topic named orders with 1 partition and a replication factor of 1.

Kafka

# Write the Kafka topic creation command here

Need a hint?

Use the kafka-topics command with --create and specify the topic name, partitions, and replication factor.

2

Produce messages to the orders topic

Write the command to send the message Order123 to the Kafka topic orders using the console producer.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
# Write the Kafka console producer command to send 'Order123' to 'orders' topic

Need a hint?

Use kafka-console-producer with --topic orders and send the message Order123.

3

Consume messages from the orders topic

Write the command to read messages from the Kafka topic orders using the console consumer, starting from the beginning.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
kafka-console-producer --topic orders --bootstrap-server localhost:9092 <<< "Order123"
# Write the Kafka console consumer command to read messages from 'orders' topic from the beginning

Need a hint?

Use kafka-console-consumer with --topic orders and --from-beginning to read all messages.

4

Display the consumed message to understand Kafka's purpose

Write a command or statement that shows the output message Order123 received from the orders topic.

Kafka

kafka-topics --create --topic orders --bootstrap-server localhost:9092 --partitions 1 --replication-factor 1
kafka-console-producer --topic orders --bootstrap-server localhost:9092 <<< "Order123"
kafka-console-consumer --topic orders --bootstrap-server localhost:9092 --from-beginning --max-messages 1
# Show the output message 'Order123' here

Need a hint?

The consumer command will print the message Order123 to the console.