Deserialization in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is deserialization in Kafka?

Deserialization is the process of converting bytes received from Kafka into a usable data format like a string or an object.

beginner

Why do we need deserialization in Kafka consumers?

Kafka sends data as bytes. Consumers need to deserialize these bytes to understand and use the data in their programs.

intermediate

What is a Deserializer interface in Kafka?

It is a Kafka interface that defines how to convert byte arrays into objects. You implement it to tell Kafka how to read your data.

beginner

Name two common deserializers used in Kafka.

Common deserializers are StringDeserializer for strings and ByteArrayDeserializer for raw bytes.

intermediate

What happens if deserialization fails in a Kafka consumer?

If deserialization fails, the consumer cannot read the message properly, which may cause errors or message loss.

What does deserialization do in Kafka?

A Converts bytes to usable data

B Converts data to bytes

C Sends data to Kafka

D Deletes data from Kafka

Deserialization converts bytes received from Kafka into usable data formats.

Which Kafka interface is used for deserialization?

A Serializer

B Consumer

C Producer

D Deserializer

The Deserializer interface defines how to convert bytes into objects.

What is a common deserializer for string data in Kafka?

A ByteArrayDeserializer

B StringDeserializer

C StringSerializer

D IntegerDeserializer

StringDeserializer converts byte data into strings.

If deserialization fails, what is a likely outcome?

A Message is sent again

B Message is read correctly

C Consumer crashes or errors occur

D Producer retries sending

Deserialization failure causes errors or crashes in the consumer.

Why must Kafka consumers deserialize data?

A To convert bytes into usable objects

B To send data to Kafka

C To compress data

D To encrypt data

Consumers deserialize bytes to convert them into usable objects.

Explain what deserialization means in Kafka and why it is important.

Think about how data travels as bytes and needs to be understood by your program.

Describe what happens if a Kafka consumer receives data but cannot deserialize it.

Consider what happens when your program can't read the data it gets.

Practice

1.

What is the main purpose of deserialization in Kafka consumers?

easy

A. To send messages to Kafka topics

B. To compress data before sending to Kafka

C. To convert raw bytes from Kafka into usable data formats

D. To create Kafka topics automatically

Solution

1. Step 1: Understand Kafka message flow

   Kafka stores messages as raw bytes in topics.

2. Step 2: Role of deserialization in consumers

   Deserialization converts these raw bytes back into readable data for the consumer application.

3. Final Answer:

   To convert raw bytes from Kafka into usable data formats -> Option C

4. Quick Check:

   Deserialization = Convert bytes to data [OK]

Hint: Deserialization means reading bytes as data [OK]

Common Mistakes:

• Confusing deserialization with serialization
• Thinking deserialization sends data
• Assuming deserialization compresses data

2.

Which of the following is the correct way to specify a String deserializer in a Kafka consumer configuration?

props.put("key.deserializer", ?);

easy

A. "org.apache.kafka.common.serialization.StringDeserializer"

B. "org.apache.kafka.common.serialization.IntegerSerializer"

C. "org.apache.kafka.common.serialization.ByteArrayDeserializer"

D. "org.apache.kafka.common.serialization.StringSerializer"

Solution

1. Step 1: Identify deserializer for String keys

   The correct class for String deserialization is StringDeserializer.

2. Step 2: Check option correctness

   "org.apache.kafka.common.serialization.StringDeserializer" uses StringDeserializer, which matches the key.deserializer property.

3. Final Answer:

   "org.apache.kafka.common.serialization.StringDeserializer" -> Option A

4. Quick Check:

   String deserializer = StringDeserializer [OK]

Hint: Deserializer ends with 'Deserializer', not 'Serializer' [OK]

Common Mistakes:

• Using Serializer instead of Deserializer
• Mixing IntegerSerializer with deserializer property
• Choosing ByteArrayDeserializer for String data

3.

Given the following Kafka consumer code snippet, what will be the output if the message value is a JSON string but the deserializer is set to StringDeserializer?

props.put("value.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
ConsumerRecord<String, String> record = consumer.poll(Duration.ofMillis(100)).iterator().next();
System.out.println(record.value());

medium

A. Binary data printed as garbage characters

B. The JSON string as plain text

C. Null value printed

D. A deserialization error exception

Solution

1. Step 1: Understand StringDeserializer behavior

   StringDeserializer converts bytes to a UTF-8 string without parsing JSON.

2. Step 2: Output of printing record.value()

   The JSON string is printed as plain text exactly as received.

3. Final Answer:

   The JSON string as plain text -> Option B

4. Quick Check:

   StringDeserializer outputs raw string [OK]

Hint: StringDeserializer prints raw string, no JSON parsing [OK]

Common Mistakes:

• Expecting automatic JSON parsing
• Thinking deserialization fails on JSON strings
• Assuming binary garbage output

4.

What is the likely cause of this error in a Kafka consumer?

org.apache.kafka.common.errors.SerializationException: Error deserializing key/value for partition

Given the consumer uses IntegerDeserializer but the producer sends String keys.

medium

A. Mismatch between producer's String keys and consumer's IntegerDeserializer

B. Kafka topic does not exist

C. Consumer group ID is missing

D. Network connection failure

Solution

1. Step 1: Analyze deserialization error cause

   The error occurs when deserializer cannot convert bytes to expected type.

2. Step 2: Check key type mismatch

   Producer sends String keys, but consumer expects Integer keys, causing failure.

3. Final Answer:

   Mismatch between producer's String keys and consumer's IntegerDeserializer -> Option A

4. Quick Check:

   Deserializer mismatch = SerializationException [OK]

Hint: Producer and consumer deserializers must match data type [OK]

Common Mistakes:

• Ignoring type mismatch between producer and consumer
• Blaming unrelated network or topic errors
• Confusing serialization with deserialization errors

5.

You want to consume messages where the value is a JSON object representing a user with fields id (int) and name (string). Which deserialization approach is best to convert the Kafka message value into a User Java object?

hard

A. Use ByteArrayDeserializer and manually convert bytes to User

B. Use StringDeserializer and cast the string to User

C. Use IntegerDeserializer for the value

D. Use a custom deserializer that parses JSON into a User object

Solution

1. Step 1: Understand data format and target type

   The message value is JSON, and we want a User Java object.

2. Step 2: Choose deserialization method

   A custom deserializer can parse JSON and create User instances directly.

3. Step 3: Evaluate other options

   StringDeserializer returns raw JSON string, casting won't convert to User. IntegerDeserializer is wrong type. ByteArrayDeserializer requires manual parsing.

4. Final Answer:

   Use a custom deserializer that parses JSON into a User object -> Option D

5. Quick Check:

   Custom deserializer = JSON to object [OK]

Hint: Custom deserializer parses JSON to Java object directly [OK]

Common Mistakes:

• Casting String to object without parsing
• Using wrong deserializer type
• Manually parsing bytes instead of using deserializer