Kafka on Kubernetes (Strimzi) - Step-by-Step Execution

Process Flow - Kafka on Kubernetes (Strimzi)

Create Kubernetes Namespace

↓

Apply Strimzi Operator YAML

↓

Operator Installs Kafka Cluster CRDs

↓

Create Kafka Cluster Custom Resource

↓

Operator Deploys Kafka Pods & Services

↓

Kafka Cluster Runs inside Kubernetes

↓

Clients Connect to Kafka via Services

This flow shows how Strimzi operator manages Kafka on Kubernetes: install operator, create Kafka resource, operator deploys Kafka pods, then clients connect.

Execution Sample

Kafka

kubectl create namespace kafka
kubectl apply -f strimzi-cluster-operator.yaml -n kafka
kubectl apply -f kafka-cluster.yaml -n kafka
kubectl get pods -n kafka

Commands to create namespace, install Strimzi operator, deploy Kafka cluster, and check Kafka pods running.

Process Table

Step	Command	Action	Result/Output
1	kubectl create namespace kafka	Create namespace 'kafka'	namespace/kafka created
2	kubectl apply -f strimzi-cluster-operator.yaml -n kafka	Install Strimzi operator	deployment.apps/strimzi-cluster-operator created
3	Operator installs Kafka CRDs	Custom Resource Definitions added	kafkas.kafka.strimzi.io CRD created
4	kubectl apply -f kafka-cluster.yaml -n kafka	Create Kafka cluster resource	kafka.kafka.strimzi.io/my-cluster created
5	Operator deploys Kafka pods	Kafka pods starting	pod/my-cluster-kafka-0 Running pod/my-cluster-kafka-1 Running pod/my-cluster-kafka-2 Running
6	kubectl get pods -n kafka	Check Kafka pods status	NAME READY STATUS RESTARTS AGE my-cluster-kafka-0 1/1 Running 0 2m my-cluster-kafka-1 1/1 Running 0 2m my-cluster-kafka-2 1/1 Running 0 2m
7	Kafka cluster ready	Kafka cluster is running	Kafka cluster pods are all Running and Ready

💡 Kafka pods are Running and Ready, cluster is ready for clients

Status Tracker

Resource	Initial State	After Step 2	After Step 4	After Step 5	Final State
Namespace 'kafka'	Not present	Created	Created	Created	Created
Strimzi Operator	Not installed	Installed	Installed	Installed	Installed
Kafka CRDs	Not present	Installed	Installed	Installed	Installed
Kafka Cluster Resource	Not present	Not present	Created	Created	Created
Kafka Pods	Not present	Not present	Not present	Starting	Running

Key Moments - 3 Insights

Why do we need to create a namespace before installing Strimzi?

The namespace isolates Kafka resources. Step 1 creates it so Strimzi operator and Kafka pods run inside it, as shown in execution_table row 1.

What happens if we apply the Kafka cluster resource before installing Strimzi operator?

The Kafka CRDs won't exist yet, so Kubernetes rejects the Kafka cluster resource. Step 3 shows CRDs must be installed first.

Why do we check pod status after deploying Kafka cluster?

To confirm Kafka pods are running and ready for use. Execution_table rows 5 and 6 show pods transitioning to Running state.

Visual Quiz - 3 Questions

Look at the execution_table at step 3. What does the operator install?

A Kafka Custom Resource Definitions (CRDs)

B Kafka client tools

C Kafka pods

D Kubernetes namespace

💡 Hint

Check the 'Action' and 'Result/Output' columns at step 3 in execution_table.

At which step do Kafka pods start running?

A Step 2

B Step 4

C Step 5

D Step 7

💡 Hint

Look at the 'Action' and 'Result/Output' columns for pod status in execution_table.

If the namespace 'kafka' was not created, what would happen at step 2?

A Operator installs successfully in default namespace

B kubectl apply fails because namespace does not exist

C Kafka cluster deploys anyway

D Pods start running in default namespace

💡 Hint

Refer to variable_tracker for namespace state and execution_table step 1 and 2.

Concept Snapshot

Kafka on Kubernetes with Strimzi:
- Create a Kubernetes namespace for Kafka
- Install Strimzi operator YAML in that namespace
- Operator adds Kafka CRDs to Kubernetes
- Apply Kafka cluster custom resource YAML
- Operator deploys Kafka pods and services
- Check pods are Running before using Kafka
- Clients connect via Kubernetes services

Full Transcript

This visual execution shows how to run Kafka on Kubernetes using Strimzi operator. First, create a namespace called 'kafka' to isolate resources. Then apply the Strimzi operator YAML in that namespace. The operator installs Kafka Custom Resource Definitions (CRDs) into Kubernetes. Next, apply a Kafka cluster custom resource YAML to request a Kafka cluster. The operator sees this and deploys Kafka pods and services inside the namespace. Finally, check the pods are running and ready. Once ready, clients can connect to Kafka through Kubernetes services. This step-by-step flow helps beginners see how Kubernetes and Strimzi work together to run Kafka.