GroupBy and aggregation in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What does the GroupBy operation do in Kafka Streams?

It groups records by a key so that aggregation functions can be applied to each group separately.

beginner

Name a common aggregation function used after GroupBy in Kafka Streams.

Common aggregation functions include count(), reduce(), and aggregate().

intermediate

What is the difference between reduce() and aggregate() in Kafka Streams?

reduce() combines values of the same type, while aggregate() allows different types for input and output and supports an initializer.

intermediate

Why is it important to use a Materialized state store in aggregation?

It stores the aggregation results so they can be queried or used later, enabling fault tolerance and stateful processing.

beginner

What happens if you perform GroupBy without an aggregation in Kafka Streams?

Grouping alone does not produce output; aggregation is needed to combine grouped records into meaningful results.

In Kafka Streams, which method is used to group records by a new key?

A reduce()

B groupByKey()

C aggregate()

D groupBy()

groupBy() is used to group records by a new key, while groupByKey() groups by the existing key.

Which aggregation function counts the number of records in each group?

A count()

B aggregate()

C map()

D reduce()

count() returns the number of records in each group.

What type of Kafka Streams store is typically used to keep aggregation results?

A WindowStore

B KeyValueStore

C TimestampedKeyValueStore

D InMemoryStore

KeyValueStore is commonly used to store aggregated results for stateful processing.

Which method allows you to initialize an aggregation with a custom starting value?

A count()

B reduce()

C aggregate()

D groupBy()

aggregate() lets you provide an initializer for the aggregation.

What is the output type of reduce() in Kafka Streams?

A Same as input value type

B Different from input value type

C Always a Long

D Always a String

reduce() combines values of the same type, so output type matches input value type.

Explain how GroupBy and aggregation work together in Kafka Streams to process data.

Think about grouping first, then combining.

Describe the difference between reduce() and aggregate() methods in Kafka Streams aggregation.

Focus on input/output types and initialization.