Connector configuration in Kafka - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

What is the output of this Kafka connector configuration validation?

Given the following Kafka connector configuration JSON, what will be the result of the connector validation?

Kafka

{
  "name": "my-source-connector",
  "config": {
    "connector.class": "FileStreamSource",
    "tasks.max": "2",
    "file": "/tmp/test.txt",
    "topic": "test-topic"
  }
}

A Validation failed: 'file' property path does not exist.

B Validation failed: 'tasks.max' must be an integer, not a string.

C Validation failed: Missing required property 'topic'.

D Validation successful: Connector configuration is valid.

💡 Hint

Check the data types of the configuration properties.

The 'tasks.max' property can be provided as a string and will be parsed as an integer by Kafka Connect. All required properties are present and valid.

❓ Predict Output

intermediate

What error does this Kafka sink connector configuration produce?

Analyze the following sink connector configuration and determine the error it will cause when deployed.

Kafka

{
  "name": "my-sink-connector",
  "config": {
    "connector.class": "FileStreamSink",
    "tasks.max": 1,
    "file": 12345,
    "topics": "my-topic"
  }
}

A Validation failed: 'topics' property must be 'topic' (singular).

B Validation failed: 'file' property must be a string path, not a number.

C No error, configuration is valid.

D Validation failed: 'tasks.max' must be a string, not an integer.

💡 Hint

Check the data types of each property carefully.

The 'file' property must be a string representing the file path. Providing a number causes a validation error.

🔧 Debug

advanced

Why does this Kafka connector fail to start?

This connector configuration fails to start. Identify the cause.

Kafka

{
  "name": "json-source-connector",
  "config": {
    "connector.class": "JsonFileSource",
    "tasks.max": 3,
    "file": "/data/input.json",
    "topic": "json-topic",
    "value.converter": "org.apache.kafka.connect.json.JsonConverter",
    "value.converter.schemas.enable": "false"
  }
}

A The 'tasks.max' value cannot be greater than 2 for this connector.

B The 'value.converter.schemas.enable' must be a boolean true/false, not a string.

C The connector class 'JsonFileSource' does not exist in Kafka Connect.

D The 'topic' property is misspelled; it should be 'topics'.

💡 Hint

Check if the connector class is a valid built-in or custom connector.

Kafka Connect does not have a built-in connector named 'JsonFileSource'. This causes the connector to fail at startup.

📝 Syntax

advanced

Which configuration JSON is syntactically correct for a Kafka connector?

Select the syntactically correct Kafka connector configuration JSON.

A

{
  "name": "my-connector",
  "config": {
    "connector.class": "FileStreamSource",
    "tasks.max": 1,
    "file": "/tmp/input.txt",
    "topic": "my-topic"
  }
}

B

{
  "name": "my-connector",
  "config": {
    "connector.class": "FileStreamSource",
    "tasks.max": "one",
    "file": "/tmp/input.txt",
    "topic": "my-topic"
  }
}

C

}
}  
"cipot-ym" :"cipot"    
,"txt.tupni/pmt/" :"elif"    
,1 :"xam.sksat"    
,"ecruoSmaertSeliF" :"ssalc.rotcennoc"    
{ :"gifnoc"  
,"rotcennoc-ym" :"eman"  
{

D

{
  "name": "my-connector",
  "config": {
    "connector.class": "FileStreamSource",
    "tasks.max": 1
    "file": "/tmp/input.txt",
    "topic": "my-topic"
  }
}

💡 Hint

Look for missing commas, trailing commas, and correct data types.

Option A is valid JSON with correct commas and data types. Option A misses a comma after 'tasks.max'. Option A has a trailing comma after the last property. Option A uses a string 'one' instead of an integer for 'tasks.max'.

🚀 Application

expert

How many tasks will this Kafka connector run?

Given this connector configuration, how many tasks will Kafka Connect run?

Kafka

{
  "name": "multi-task-connector",
  "config": {
    "connector.class": "FileStreamSource",
    "tasks.max": 4,
    "file": "/var/log/app.log",
    "topic": "app-logs"
  }
}

A Only 1 task will run because the connector supports a single task.

B The number of tasks is decided by the number of partitions in the topic, ignoring 'tasks.max'.

C Kafka Connect will run 0 tasks because 'file' path is invalid.

D Exactly 4 tasks will run as specified by 'tasks.max'.

💡 Hint

Consider the connector type and its support for parallel tasks.

The FileStreamSource connector supports only a single task regardless of 'tasks.max' value. So only 1 task will run.