Deserialization in Kafka - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

What is the output of this Kafka deserialization code?

Consider the following Kafka consumer code snippet that deserializes messages from a topic. What will be printed when a message with value {"name":"Alice","age":30} is consumed?

Kafka

from kafka import KafkaConsumer
import json

consumer = KafkaConsumer(
    'users',
    bootstrap_servers=['localhost:9092'],
    value_deserializer=lambda m: json.loads(m.decode('utf-8'))
)

for message in consumer:
    print(message.value['name'])
    break

A {'name': 'Alice', 'age': 30}

B Alice

C b'{"name":"Alice","age":30}'

D None

💡 Hint

Think about what the value_deserializer does to the message bytes.

The value_deserializer converts the byte string into a Python dictionary. Accessing message.value['name'] prints the string Alice.

🧠 Conceptual

intermediate

Which deserializer is appropriate for Avro data in Kafka?

You receive Kafka messages encoded in Avro format. Which deserializer should you use to correctly convert the message bytes into usable data?

A A JSON deserializer that decodes UTF-8 strings

B A plain string deserializer that converts bytes to strings

C An Avro deserializer that uses the schema registry to decode bytes

D A protobuf deserializer that parses protobuf messages

💡 Hint

Avro data requires schema information to deserialize properly.

Avro data is binary and requires a deserializer that can use the schema registry to interpret the bytes correctly.

🔧 Debug

advanced

Why does this Kafka consumer raise a deserialization error?

Examine the following Kafka consumer code. It raises a deserialization error when consuming messages. What is the cause?

Kafka

from kafka import KafkaConsumer
import json

consumer = KafkaConsumer(
    'events',
    bootstrap_servers=['localhost:9092'],
    value_deserializer=lambda m: m.decode('utf-8')
)

for message in consumer:
    data = json.loads(message.value)
    print(data['event'])

A The <code>value_deserializer</code> decodes bytes to string, so calling <code>json.loads</code> again on string causes error

B The <code>value_deserializer</code> returns a string, but <code>json.loads</code> expects bytes

C The topic name is incorrect, causing deserialization failure

D The bootstrap server address is invalid

💡 Hint

Check the data type passed to json.loads.

The value_deserializer already decodes bytes to string. Calling json.loads again on a string causes a TypeError because json.loads expects a string, but the code tries to decode twice.

📝 Syntax

advanced

Identify the syntax error in this Kafka deserializer setup

Which option contains a syntax error in the Kafka consumer deserializer configuration?

A value_deserializer=lambda m: None if m is None else json.loads(m.decode('utf-8'))

B value_deserializer=lambda m: json.loads(m.decode('utf-8'))

C value_deserializer=lambda m: json.loads(m.decode('utf-8')) if m else None

D value_deserializer=lambda m: json.loads(m.decode('utf-8')

💡 Hint

Look carefully at the parentheses.

Option D is missing a closing parenthesis for json.loads, causing a syntax error.

🚀 Application

expert

How many items are in the resulting dictionary after deserialization?

A Kafka message value is a JSON string: {"id":123,"tags":["red","blue"],"active":true}. After deserializing with json.loads, how many top-level keys does the resulting Python dictionary have?

Kafka

import json

message_value = b'{"id":123,"tags":["red","blue"],"active":true}'
data = json.loads(message_value.decode('utf-8'))

result = len(data)

A 3

B 1

C 2

D 4

💡 Hint

Count the keys at the top level of the JSON object.

The JSON object has three keys: id, tags, and active. So the length of the dictionary is 3.

Practice

1.

What is the main purpose of deserialization in Kafka consumers?

easy

A. To send messages to Kafka topics

B. To compress data before sending to Kafka

C. To convert raw bytes from Kafka into usable data formats

D. To create Kafka topics automatically

Solution

1. Step 1: Understand Kafka message flow

   Kafka stores messages as raw bytes in topics.

2. Step 2: Role of deserialization in consumers

   Deserialization converts these raw bytes back into readable data for the consumer application.

3. Final Answer:

   To convert raw bytes from Kafka into usable data formats -> Option C

4. Quick Check:

   Deserialization = Convert bytes to data [OK]

Hint: Deserialization means reading bytes as data [OK]

Common Mistakes:

• Confusing deserialization with serialization
• Thinking deserialization sends data
• Assuming deserialization compresses data

2.

Which of the following is the correct way to specify a String deserializer in a Kafka consumer configuration?

props.put("key.deserializer", ?);

easy

A. "org.apache.kafka.common.serialization.StringDeserializer"

B. "org.apache.kafka.common.serialization.IntegerSerializer"

C. "org.apache.kafka.common.serialization.ByteArrayDeserializer"

D. "org.apache.kafka.common.serialization.StringSerializer"

Solution

1. Step 1: Identify deserializer for String keys

   The correct class for String deserialization is StringDeserializer.

2. Step 2: Check option correctness

   "org.apache.kafka.common.serialization.StringDeserializer" uses StringDeserializer, which matches the key.deserializer property.

3. Final Answer:

   "org.apache.kafka.common.serialization.StringDeserializer" -> Option A

4. Quick Check:

   String deserializer = StringDeserializer [OK]

Hint: Deserializer ends with 'Deserializer', not 'Serializer' [OK]

Common Mistakes:

• Using Serializer instead of Deserializer
• Mixing IntegerSerializer with deserializer property
• Choosing ByteArrayDeserializer for String data

3.

Given the following Kafka consumer code snippet, what will be the output if the message value is a JSON string but the deserializer is set to StringDeserializer?

props.put("value.deserializer", "org.apache.kafka.common.serialization.StringDeserializer");
ConsumerRecord<String, String> record = consumer.poll(Duration.ofMillis(100)).iterator().next();
System.out.println(record.value());

medium

A. Binary data printed as garbage characters

B. The JSON string as plain text

C. Null value printed

D. A deserialization error exception

Solution

1. Step 1: Understand StringDeserializer behavior

   StringDeserializer converts bytes to a UTF-8 string without parsing JSON.

2. Step 2: Output of printing record.value()

   The JSON string is printed as plain text exactly as received.

3. Final Answer:

   The JSON string as plain text -> Option B

4. Quick Check:

   StringDeserializer outputs raw string [OK]

Hint: StringDeserializer prints raw string, no JSON parsing [OK]

Common Mistakes:

• Expecting automatic JSON parsing
• Thinking deserialization fails on JSON strings
• Assuming binary garbage output

4.

What is the likely cause of this error in a Kafka consumer?

org.apache.kafka.common.errors.SerializationException: Error deserializing key/value for partition

Given the consumer uses IntegerDeserializer but the producer sends String keys.

medium

A. Mismatch between producer's String keys and consumer's IntegerDeserializer

B. Kafka topic does not exist

C. Consumer group ID is missing

D. Network connection failure

Solution

1. Step 1: Analyze deserialization error cause

   The error occurs when deserializer cannot convert bytes to expected type.

2. Step 2: Check key type mismatch

   Producer sends String keys, but consumer expects Integer keys, causing failure.

3. Final Answer:

   Mismatch between producer's String keys and consumer's IntegerDeserializer -> Option A

4. Quick Check:

   Deserializer mismatch = SerializationException [OK]

Hint: Producer and consumer deserializers must match data type [OK]

Common Mistakes:

• Ignoring type mismatch between producer and consumer
• Blaming unrelated network or topic errors
• Confusing serialization with deserialization errors

5.

You want to consume messages where the value is a JSON object representing a user with fields id (int) and name (string). Which deserialization approach is best to convert the Kafka message value into a User Java object?

hard

A. Use ByteArrayDeserializer and manually convert bytes to User

B. Use StringDeserializer and cast the string to User

C. Use IntegerDeserializer for the value

D. Use a custom deserializer that parses JSON into a User object

Solution

1. Step 1: Understand data format and target type

   The message value is JSON, and we want a User Java object.

2. Step 2: Choose deserialization method

   A custom deserializer can parse JSON and create User instances directly.

3. Step 3: Evaluate other options

   StringDeserializer returns raw JSON string, casting won't convert to User. IntegerDeserializer is wrong type. ByteArrayDeserializer requires manual parsing.

4. Final Answer:

   Use a custom deserializer that parses JSON into a User object -> Option D

5. Quick Check:

   Custom deserializer = JSON to object [OK]

Hint: Custom deserializer parses JSON to Java object directly [OK]

Common Mistakes:

• Casting String to object without parsing
• Using wrong deserializer type
• Manually parsing bytes instead of using deserializer