Sink connectors in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a sink connector in Kafka Connect?

A sink connector is a component in Kafka Connect that reads data from Kafka topics and writes it to an external system like a database, file system, or search index.

beginner

Name two common external systems where sink connectors send data.

Common external systems include relational databases (like MySQL, PostgreSQL) and search engines (like Elasticsearch).

beginner

How does a sink connector know which Kafka topic to read from?

The sink connector configuration specifies the Kafka topic(s) it should read data from using the 'topics' property.

intermediate

What is the role of the 'tasks.max' setting in sink connectors?

'tasks.max' defines the maximum number of tasks (parallel workers) the sink connector can use to write data to the external system, improving throughput.

intermediate

Why is it important to handle data format compatibility in sink connectors?

Sink connectors must convert Kafka record formats (like Avro, JSON) into the format expected by the external system to avoid errors and data loss.

What does a Kafka sink connector do?

A Reads data from Kafka and writes it to an external system

B Reads data from an external system and writes it to Kafka

C Manages Kafka cluster configuration

D Monitors Kafka topic partitions

A sink connector reads data from Kafka topics and writes it to external systems.

Which configuration property specifies the Kafka topics a sink connector reads from?

A connect.topics

B source.topics

C topics

D sink.topics

The 'topics' property lists the Kafka topics the sink connector consumes.

What does the 'tasks.max' setting control in a sink connector?

A Maximum retries on failure

B Maximum Kafka topic partitions

C Maximum message size

D Maximum number of parallel tasks for writing data

'tasks.max' controls how many parallel tasks the connector can run to improve throughput.

Which of these is NOT a typical sink connector destination?

A Relational databases

B Kafka topics

C File systems

D Search indexes

Kafka topics are source for sink connectors, not a destination.

Why must sink connectors handle data format conversion?

A To match the external system's expected data format

B To encrypt data before sending

C To compress data for faster transfer

D To change Kafka topic names

Data format conversion ensures compatibility with the external system receiving the data.

Explain what a sink connector is and how it works in Kafka Connect.

Think about how data flows from Kafka to other systems.

Describe why data format compatibility is important for sink connectors and how it affects data transfer.

Consider what happens if the external system expects a different format.