Kafka - Connect
You want to configure a sink connector to write data to different files based on the Kafka topic name. Which configuration strategy is best?
You want to configure a sink connector to write data to different files based on the Kafka topic name. Which configuration strategy is best?
hard🚀 Application Q9 of Q15
Step-by-Step Solution
Solution:
Step 1: Understand sink connector file routing
FileStreamSinkConnector writes to one file per connector instance.Step 2: Select best way to write to multiple files by topic
Creating one connector per topic with separate file paths is best practice.Final Answer:
Create one connector per topic, each with its own "file" property. -> Option DQuick Check:
One connector per output file for topic-based routing [OK]
Quick Trick: Use multiple connectors to write topic-based files [OK]
Common Mistakes:
MISTAKES- Assuming one connector can write to multiple files automatically
- Misusing tasks.max for file routing
- Setting file to a directory path instead of a file
Master "Connect" in Kafka
Want More Practice?
15+ quiz questions · All difficulty levels · Free
Free Signup - Practice All QuestionsMore Kafka Quizzes