What is Value in Kafka Message: Explanation and Example

In Kafka, the value in a message is the main data payload that the producer sends and the consumer receives. It contains the actual information or content you want to transmit through Kafka topics, separate from the key which is used for message partitioning or identification.

How It Works

Think of Kafka messages like letters in a mailbox. The key is like the address on the envelope, helping to decide where the letter goes, while the value is the letter inside containing the actual message you want to share. The value holds the important data that applications want to send, such as user information, event details, or sensor readings.

When a producer sends a message to Kafka, it packages the data inside the value. Consumers then read this value to process or react to the information. The value can be any data type, often bytes or strings, and is usually serialized before sending and deserialized after receiving.

Example

This example shows a simple Kafka producer sending a message with a value and a consumer reading it.

python

from kafka import KafkaProducer, KafkaConsumer
import json

# Producer sends a message with a value
producer = KafkaProducer(bootstrap_servers='localhost:9092', value_serializer=lambda v: json.dumps(v).encode('utf-8'))
producer.send('test-topic', value={'user': 'alice', 'action': 'login'})
producer.flush()

# Consumer reads the message value
consumer = KafkaConsumer('test-topic', bootstrap_servers='localhost:9092', value_deserializer=lambda v: json.loads(v.decode('utf-8')))
for message in consumer:
    print('Received value:', message.value)
    break

Output

Received value: {'user': 'alice', 'action': 'login'}

When to Use

Use the value in Kafka messages whenever you want to send actual data between different parts of your system. For example, you might send user activity logs, transaction details, or sensor data as the value. This allows different applications to communicate asynchronously and process data in real time.

The value is essential when you want to share meaningful information, while the key helps organize or route messages but usually does not contain the main data.

Key Points

• The value is the main content or payload of a Kafka message.
• It can be any data type but is often serialized (like JSON or bytes).
• Producers set the value when sending messages; consumers read it to process data.
• The value is separate from the key, which is used for partitioning or message identification.

Key Takeaways

The value in a Kafka message is the actual data payload sent between producer and consumer.

It holds the meaningful information your applications want to share asynchronously.

Values are usually serialized before sending and deserialized after receiving.

The key and value serve different purposes: key for routing, value for content.

Use the value to transmit events, logs, or any data your system needs to process.