KStream and KTable concepts in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a KStream in Kafka Streams?

A KStream is a continuous flow of records where each record represents a single event or update. It models data as an unbounded, real-time stream of events.

beginner

What is a KTable in Kafka Streams?

A KTable is a changelog stream that represents a table of key-value pairs. It models data as a snapshot of the latest state for each key, updating over time.

intermediate

How does a KStream differ from a KTable?

A KStream represents each event as a separate record (event-driven), while a KTable represents the latest value for each key (state-driven). KStream is like a log of changes; KTable is like a database table with current state.

beginner

What happens when you update a key in a KTable?

The KTable updates the value for that key, replacing the old value with the new one. This means the table always holds the latest state for each key.

intermediate

Can you perform joins between KStreams and KTables?

Yes, Kafka Streams supports joins between KStreams and KTables. For example, joining a KStream with a KTable enriches the stream events with the latest state from the table.

Which Kafka Streams abstraction represents a continuous stream of events?

A KTable

B KConsumer

C KTopic

D KStream

KStream models a continuous flow of event records in Kafka Streams.

What does a KTable represent?

A A Kafka topic partition

B A stream of individual events

C A snapshot of the latest state per key

D A consumer group

KTable represents the latest value for each key, like a table of current state.

If you want to keep track of the latest user profile info, which abstraction should you use?

A KTable

B Kafka Producer

C KStream

D Kafka Topic

KTable holds the latest state per key, ideal for user profiles.

What happens when a key is updated in a KTable?

A The old value is replaced with the new value

B A new event is appended without changing old data

C The key is deleted

D The update is ignored

KTable updates the value for the key to keep the latest state.

Which join enriches a stream of events with the latest state from a table?

A KStream-KStream join

B KStream-KTable join

C Kafka topic join

D KTable-KTable join

Joining a KStream with a KTable adds the latest table state to each stream event.

Explain in your own words the difference between a KStream and a KTable.

Think about a log of events versus a database table.

Describe a real-life example where you would use a KTable instead of a KStream.

Consider situations where you want to know the current status, not every change.

Practice

1. Which statement best describes the difference between KStream and KTable in Kafka Streams?

easy

A. KTable is used for event processing, and KStream is used for batch processing.

B. KStream processes continuous event streams, while KTable maintains the latest state of data.

C. KStream stores data permanently, while KTable only processes events temporarily.

D. KStream and KTable are identical and can be used interchangeably.

Solution

1. Step 1: Understand KStream purpose

   KStream is designed to handle continuous streams of events as they happen.

2. Step 2: Understand KTable purpose

   KTable keeps track of the latest state of data, updating as new information arrives.

3. Final Answer:

   KStream processes continuous event streams, while KTable maintains the latest state of data. -> Option B

4. Quick Check:

   KStream = events, KTable = state [OK]

Hint: Remember: Stream = events, Table = current state [OK]

Common Mistakes:

• Thinking KStream stores data permanently
• Confusing KTable as batch processor
• Assuming KStream and KTable are the same

2. Which of the following is the correct way to create a KTable from a Kafka topic named users in Java?

easy

A. builder.createKTable("users");

B. builder.stream("users").toTable();

C. builder.table("users");

D. builder.getTable("users");

Solution

1. Step 1: Recall KTable creation syntax

   In Kafka Streams Java API, KTable is created using builder.table(topicName).

2. Step 2: Check options for correct method

   Only builder.table("users") matches the correct syntax.

3. Final Answer:

   builder.table("users") -> Option C

4. Quick Check:

   KTable created with builder.table(topic) [OK]

Hint: Use builder.table() to create KTable from topic [OK]

Common Mistakes:

• Using builder.stream() then toTable() which is invalid
• Trying non-existent methods like createKTable()
• Confusing KStream and KTable creation methods

3. Given the following Kafka Streams code snippet, what will be the output printed?

var stream = builder.stream("orders");
var table = builder.table("orders");
stream.foreach((k, v) -> System.out.println("Stream: " + k + ":" + v));
table.toStream().foreach((k, v) -> System.out.println("Table: " + k + ":" + v));

Assuming the topic orders has these records in order: (1, "A"), (1, "B"), (2, "C").

medium

A. Stream prints all three records; Table prints only latest for each key: (1, "B") and (2, "C")

B. Stream prints only latest record per key; Table prints all records

C. Both Stream and Table print all three records

D. Stream prints no records; Table prints all three records

Solution

1. Step 1: Understand KStream output

   KStream processes every event as it arrives, so it prints all three records: Stream: 1:A, Stream: 1:B, Stream: 2:C.

2. Step 2: Understand KTable.toStream() output

   KTable.toStream() emits the latest update per key. It will print updates for key 1 twice (first "A", then "B") and key 2 once ("C"). However, in practice, KTable.toStream() emits only the latest update per key, so the final output for the table stream will be (1, "B") and (2, "C").

3. Final Answer:

   Stream prints all three records; Table prints only latest for each key: (1, "B") and (2, "C") -> Option A

4. Quick Check:

   KStream emits all events; KTable.toStream() emits latest per key [OK]

Hint: KStream prints all events; KTable.toStream() prints latest per key [OK]

Common Mistakes:

• Thinking KTable.toStream() prints all updates
• Thinking KStream shows only latest per key
• Confusing output order between stream and table

4. You wrote this code to convert a KStream to a KTable:

var stream = builder.stream("events");
var table = stream.toTable();

But it throws a compilation error. What is the likely cause?

medium

A. toTable() method does not exist on KStream interface.

B. You cannot convert a KStream to a KTable at all.

C. You must specify a key serde when converting to KTable.

D. You need to call toTable() with a materialized state store.

Solution

1. Step 1: Check KStream toTable() method requirements

   In Kafka Streams, toTable() requires a Materialized parameter to define state store details.

2. Step 2: Identify missing parameter causing error

   Not providing Materialized causes compilation error because Kafka Streams needs to know how to store the table.

3. Final Answer:

   You need to call toTable() with a materialized state store. -> Option D

4. Quick Check:

   toTable() needs Materialized param [OK]

Hint: toTable() requires Materialized argument [OK]

Common Mistakes:

• Assuming toTable() exists without parameters
• Thinking conversion is impossible
• Ignoring state store configuration

5. You want to build a Kafka Streams application that tracks the latest price of products and also processes every price update event for analytics. Which combination should you use?

hard

A. Use a KTable to keep latest prices and a KStream to process all price update events.

B. Use only a KStream for both latest prices and event processing.

C. Use only a KTable because it handles both events and state.

D. Use a KStream for latest prices and a KTable for event processing.

Solution

1. Step 1: Identify need for latest state tracking

   Tracking latest prices requires a KTable because it maintains the current state per product.

2. Step 2: Identify need for processing all events

   Processing every price update event for analytics requires a KStream to handle all incoming events.

3. Step 3: Combine both correctly

   Use KTable for latest prices and KStream for event processing simultaneously.

4. Final Answer:

   Use a KTable to keep latest prices and a KStream to process all price update events. -> Option A

5. Quick Check:

   KTable = state, KStream = all events [OK]

Hint: Use KTable for state, KStream for event analytics [OK]

Common Mistakes:

• Using only KStream loses latest state
• Using only KTable misses event details
• Swapping roles of KStream and KTable