Connector configuration in Kafka - Cheat Sheet & Quick Revision

Recall & Review

beginner

What is a Kafka Connector configuration?

It is a set of settings that tell Kafka Connect how to connect to a data source or sink, what data to move, and how to handle it.

beginner

Name two essential properties in a Kafka Connector configuration.

1. "connector.class": specifies the connector plugin to use.<br>2. "tasks.max": defines the maximum number of tasks to run in parallel.

beginner

What does the topics property specify in a source connector configuration?

It lists the Kafka topics where the connector will write the data it reads from the source system.

intermediate

How do you specify the connection details to a database in a JDBC source connector configuration?

You use properties like connection.url, connection.user, and connection.password to provide the database URL, username, and password.

intermediate

Why is the tasks.max property important in connector configuration?

It controls how many parallel tasks the connector can run, which affects throughput and resource use. Setting it too low limits speed; too high may overload the system.

Which property defines the connector plugin to use in Kafka Connect?

A connector.class

B tasks.max

C topics

D connection.url

The property 'connector.class' tells Kafka Connect which connector plugin to load.

What does the 'tasks.max' property control?

A Kafka topic name

B Database connection timeout

C Connector plugin version

D Maximum number of parallel tasks

'tasks.max' sets how many tasks can run at the same time for the connector.

In a source connector, the 'topics' property specifies:

A Maximum tasks

B Where to write data in Kafka

C Connector class name

D Where to read data from Kafka

'topics' lists the Kafka topics where the connector writes data it reads from the source.

Which property is NOT typically part of a JDBC source connector configuration?

A topics.max

B connection.user

C connection.password

D connection.url

'topics.max' is not a valid property; the correct property is 'tasks.max'.

Why should you carefully set 'tasks.max'?

A To specify the connector class

B To set the Kafka topic name

C To balance throughput and resource use

D To define the database URL

'tasks.max' affects how many tasks run in parallel, impacting speed and system load.

Explain the role of the 'connector.class' and 'tasks.max' properties in Kafka Connector configuration.

Think about what tells Kafka Connect what to do and how many workers to use.

Describe how you would configure a JDBC source connector to connect to a database and write data to Kafka topics.

Focus on connection details and where data goes.