Event Hubs for streaming data in Azure - Mini Project: Build & Apply

Event Hubs for streaming data

📖 Scenario: You are working for a company that wants to collect and process streaming data from multiple sensors in real time. To do this, you will set up an Azure Event Hub, which acts like a big mailbox where all sensor data arrives continuously.This project will guide you through creating an Event Hub namespace and an Event Hub, configuring basic settings, and preparing it to receive streaming data.

🎯 Goal: Build a simple Azure Event Hub setup with a namespace and an event hub configured to receive streaming data.

📋 What You'll Learn

Create an Event Hub namespace with the exact name sensorstreamnamespace.

Create an Event Hub inside the namespace with the exact name sensordatahub.

Set the partition count of the Event Hub to 4.

Enable capture on the Event Hub with a retention time of 1 day.

💡 Why This Matters

🌍 Real World

Event Hubs are used to collect and process large streams of data from devices, applications, or sensors in real time, such as telemetry from IoT devices or logs from applications.

💼 Career

Understanding how to set up and configure Event Hubs is essential for cloud engineers and developers working with real-time data ingestion and processing in Azure.

1

Create Event Hub Namespace

Create an Azure Event Hub namespace with the exact name sensorstreamnamespace using the Azure CLI command az eventhubs namespace create. Use the resource group myResourceGroup and location eastus.

Azure

# Use az CLI to create the Event Hub namespace
# Your code here

Need a hint?

Use the Azure CLI command az eventhubs namespace create with the required parameters.

2

Create Event Hub inside Namespace

Create an Event Hub named sensordatahub inside the namespace sensorstreamnamespace using the Azure CLI command az eventhubs eventhub create. Use the resource group myResourceGroup.

Azure

az eventhubs namespace create --resource-group myResourceGroup --name sensorstreamnamespace --location eastus
# Create the Event Hub named sensordatahub inside the namespace
# Your code here

Need a hint?

Use az eventhubs eventhub create with the namespace and event hub names.

3

Set Partition Count

Update the Event Hub sensordatahub to have a partition count of 4 using the Azure CLI command az eventhubs eventhub update. Use the resource group myResourceGroup and namespace sensorstreamnamespace.

Azure

az eventhubs namespace create --resource-group myResourceGroup --name sensorstreamnamespace --location eastus
az eventhubs eventhub create --resource-group myResourceGroup --namespace-name sensorstreamnamespace --name sensordatahub
# Update the partition count to 4
# Your code here

Need a hint?

Use az eventhubs eventhub update to change the partition count.

4

Enable Capture with Retention

Enable capture on the Event Hub sensordatahub with a retention time of 1 day using the Azure CLI command az eventhubs eventhub update. Use the resource group myResourceGroup and namespace sensorstreamnamespace. Set capture to enabled and retention to 1 day.

Azure

az eventhubs namespace create --resource-group myResourceGroup --name sensorstreamnamespace --location eastus
az eventhubs eventhub create --resource-group myResourceGroup --namespace-name sensorstreamnamespace --name sensordatahub
az eventhubs eventhub update --resource-group myResourceGroup --namespace-name sensorstreamnamespace --name sensordatahub --partition-count 4
# Enable capture with retention time of 1 day
# Your code here

Need a hint?

Use --capture-description enabled=true retention-time=1 to enable capture with retention.