Confluent Cloud overview in Kafka - Mini Project: Build & Apply

Confluent Cloud Overview with Kafka

📖 Scenario: You are working with Confluent Cloud, a managed Kafka service that helps you handle real-time data streams easily without managing servers.Imagine you want to create a simple Kafka topic and produce some messages to it, then consume those messages to see how data flows in Confluent Cloud.

🎯 Goal: Build a simple Kafka setup in Confluent Cloud by creating a topic, producing messages, and consuming them to understand how Confluent Cloud works.

📋 What You'll Learn

Create a Kafka topic named test-topic

Produce three messages to test-topic with exact values: 'Hello', 'Confluent', 'Cloud'

Consume messages from test-topic and store them in a list called received_messages

Print the received_messages list to show the consumed messages

💡 Why This Matters

🌍 Real World

Confluent Cloud is used by companies to handle real-time data streams like user activity, logs, or sensor data without managing Kafka servers themselves.

💼 Career

Understanding how to create topics, produce, and consume messages in Confluent Cloud is essential for roles in data engineering, backend development, and real-time analytics.

1

Create the Kafka topic

Create a list called topics with a single string element 'test-topic' to represent the Kafka topic you will use.

Kafka

# Create the topics list with 'test-topic'
topics = []
# Your code here

Need a hint?

Think of topics as a list holding the names of Kafka topics you want to work with.

2

Prepare messages to produce

Create a list called messages_to_send with the exact strings 'Hello', 'Confluent', and 'Cloud' to represent messages you will send to the topic.

Kafka

topics = ['test-topic']
# Create the messages_to_send list with 'Hello', 'Confluent', 'Cloud'
messages_to_send = []
# Your code here

Need a hint?

Think of messages_to_send as the data you want to send into your Kafka topic.

3

Simulate consuming messages

Create a list called received_messages and assign it the value of messages_to_send to simulate consuming the messages from the topic.

Kafka

topics = ['test-topic']
messages_to_send = ['Hello', 'Confluent', 'Cloud']
# Assign messages_to_send to received_messages to simulate consumption
received_messages = []
# Your code here

Need a hint?

Since this is a simple overview, just copy the sent messages to received messages to simulate consumption.

4

Print the consumed messages

Write a print statement to display the received_messages list.

Kafka

topics = ['test-topic']
messages_to_send = ['Hello', 'Confluent', 'Cloud']
received_messages = messages_to_send
# Print the received_messages list
# Your code here

Need a hint?

Use print(received_messages) to show the messages you consumed.