Event choreography vs orchestration in Kafka - When to Use Which

The Big Idea

What if your software could organize itself like a perfectly planned party without anyone getting confused?

The Scenario

Imagine you have many friends planning a surprise party together without a clear leader. Everyone tries to guess what others will do next, calling or texting each other to coordinate. It quickly becomes confusing and chaotic.

The Problem

This manual way is slow and full of mistakes. People forget to tell others important details, plans overlap, or some tasks get missed. It's hard to keep track of who is doing what and when, causing delays and frustration.

The Solution

Event choreography and orchestration are like having a clear plan or a conductor for your party. Choreography lets each friend know their part and react to others' actions naturally, while orchestration assigns a leader who directs everyone step-by-step. Both make coordination smooth and reliable.

Before vs After

✗ Before

friend1: "I'll bring snacks"
friend2: "I'll bring drinks"
friend3: "Wait, who's bringing snacks?"
friend4: "I thought friend1 was!"

✓ After

orchestrator: "Friend1 brings snacks, Friend2 brings drinks, Friend3 decorates"
friend1: "Got it, bringing snacks"
friend2: "Got it, bringing drinks"
friend3: "Got it, decorating"

What It Enables

It enables complex systems to work together smoothly without confusion, making sure every part happens at the right time and place.

Real Life Example

In an online shopping app, event choreography lets the payment, inventory, and shipping services react automatically to each other's updates without a central controller, while orchestration uses a central service to guide the entire order process step-by-step.

Key Takeaways

Manual coordination is confusing and error-prone.

Event choreography lets services react to each other naturally.

Event orchestration uses a central controller to direct the flow.

Practice

1. What is the main difference between event choreography and event orchestration in Kafka-based systems?

easy

A. Choreography lets services react independently; orchestration uses a central controller.

B. Choreography requires a central controller; orchestration lets services react independently.

C. Both use a central controller but differ in message format.

D. Choreography is synchronous; orchestration is asynchronous.

Solution

1. Step 1: Understand event choreography

   Event choreography means each service listens and reacts to events on its own without a central manager.

2. Step 2: Understand event orchestration

   Event orchestration means a central controller tells services what to do and when, managing the flow.

3. Final Answer:

   Choreography lets services react independently; orchestration uses a central controller. -> Option A

4. Quick Check:

   Choreography = independent reaction, Orchestration = central control [OK]

Hint: Choreography = no boss; orchestration = boss controls flow [OK]

Common Mistakes:

• Confusing which uses a central controller
• Thinking both require central control
• Mixing synchronous and asynchronous concepts

2. Which Kafka component is typically used in event orchestration to coordinate services?

easy

A. Kafka Topics with independent consumers

B. A central orchestrator service producing commands

C. Kafka Connect for data integration

D. Kafka Streams for independent event processing

Solution

1. Step 1: Identify orchestration role

   Orchestration needs a central service to control and send commands to other services.

2. Step 2: Match Kafka components

   Kafka Topics and Streams are used for event flow, but orchestration requires a central orchestrator producing commands.

3. Final Answer:

   A central orchestrator service producing commands -> Option B

4. Quick Check:

   Orchestration = central orchestrator service [OK]

Hint: Orchestration needs a central command sender [OK]

Common Mistakes:

• Choosing Kafka Topics as the controller
• Confusing Kafka Connect with orchestration
• Thinking Kafka Streams alone orchestrates

3. Given this Kafka event flow in choreography style:

Service A publishes event 'OrderCreated' to topic 'orders'.
Service B listens to 'orders' and publishes 'PaymentProcessed' to topic 'payments'.
Service C listens to 'payments' and updates inventory.

What happens if Service B fails to publish 'PaymentProcessed' event?

medium

A. Service C will not update inventory because it never receives the event.

B. Service C updates inventory anyway because it listens to 'orders'.

C. Service A retries publishing 'OrderCreated' event automatically.

D. A central orchestrator will resend 'PaymentProcessed' event.

Solution

1. Step 1: Trace event flow in choreography

   Service A publishes 'OrderCreated', Service B reacts and publishes 'PaymentProcessed', Service C listens to 'payments'.

2. Step 2: Analyze failure impact

   If Service B fails to publish 'PaymentProcessed', Service C never receives that event and cannot update inventory.

3. Final Answer:

   Service C will not update inventory because it never receives the event. -> Option A

4. Quick Check:

   Missing event means downstream service does not act [OK]

Hint: In choreography, missing event stops downstream actions [OK]

Common Mistakes:

• Assuming Service C listens to 'orders' directly
• Thinking Service A retries automatically
• Expecting a central orchestrator in choreography

4. You have this orchestration code snippet controlling Kafka services:

orchestrator.sendCommand('ServiceB', 'ProcessPayment')
orchestrator.sendCommand('ServiceC', 'UpdateInventory')

But Service C updates inventory before Service B processes payment. What is the likely problem?

medium

A. Service C is ignoring commands from the orchestrator.

B. Service B is not subscribed to the correct Kafka topic.

C. Commands are sent asynchronously without waiting for Service B to finish.

D. Kafka topics are misconfigured causing message loss.

Solution

1. Step 1: Understand orchestration command flow

   Orchestrator sends commands to services in order, expecting sequential execution.

2. Step 2: Identify asynchronous issue

   If commands are sent asynchronously without waiting for Service B to complete, Service C may act too early.

3. Final Answer:

   Commands are sent asynchronously without waiting for Service B to finish. -> Option C

4. Quick Check:

   Orchestration needs ordered, awaited commands [OK]

Hint: Orchestration requires waiting for each command to finish [OK]

Common Mistakes:

• Blaming Kafka topic subscription
• Assuming Service C ignores commands
• Thinking message loss causes order issue

5. You want to design a Kafka system for an online store where payment processing must strictly happen before inventory update, but you want to avoid a central orchestrator. Which approach fits best and how to ensure order?

hard

A. Use choreography but rely on manual retries to fix order issues.

B. Use event orchestration with a central controller sending commands in order to services.

C. Use orchestration but allow services to process events independently without waiting.

D. Use event choreography with services emitting events and consumers processing in sequence using Kafka partitions and consumer groups.

Solution

1. Step 1: Identify requirement

   Payment must happen before inventory update, but no central orchestrator allowed.

2. Step 2: Choose choreography with ordering

   Event choreography fits because services react independently. To ensure order, use Kafka partitions and consumer groups to process events in sequence.

3. Final Answer:

   Use event choreography with services emitting events and consumers processing in sequence using Kafka partitions and consumer groups. -> Option D

4. Quick Check:

   Choreography + Kafka ordering = correct sequence without central control [OK]

Hint: Choreography + Kafka partitions ensure order without central control [OK]

Common Mistakes:

• Choosing orchestration despite no central controller allowed
• Ignoring Kafka partition ordering
• Relying on manual retries for order