Cross-datacenter replication in Kafka - Practice Problems & Coding Challenges

Challenge - 5 Problems

❓ Predict Output

intermediate

What is the output of this Kafka MirrorMaker2 configuration snippet?

Given the following MirrorMaker2 configuration snippet, what will be the value of source.cluster.bootstrap.servers after parsing?

Kafka

clusters = {
  "source": {
    "bootstrap.servers": "source1:9092,source2:9092"
  },
  "target": {
    "bootstrap.servers": "target1:9092"
  }
}

source_bootstrap = clusters["source"]["bootstrap.servers"]
print(source_bootstrap)

A "target1:9092"

B "source1:9092,source2:9092"

C "source1:9092"

D KeyError

💡 Hint

Look at how the dictionary keys are accessed for the source cluster.

The configuration dictionary has a key 'source' which contains 'bootstrap.servers' with the value 'source1:9092,source2:9092'. Accessing clusters['source']['bootstrap.servers'] returns this string.

🧠 Conceptual

intermediate

Which option best describes the role of MirrorMaker2 in cross-datacenter replication?

Select the correct description of MirrorMaker2's function in Kafka cross-datacenter replication.

A It replicates Kafka topics from one cluster to another to ensure data availability across data centers.

B It compresses Kafka messages to reduce network bandwidth usage within a single cluster.

C It manages Kafka consumer group offsets locally without replication.

D It provides a user interface for Kafka topic configuration.

💡 Hint

Think about what cross-datacenter replication means for Kafka data.

MirrorMaker2 is designed to replicate topics between Kafka clusters in different data centers to improve availability and disaster recovery.

🔧 Debug

advanced

What error does this MirrorMaker2 connector configuration cause?

Consider this MirrorMaker2 connector config snippet: ``` "source.cluster": "clusterA", "target.cluster": "clusterB", "topics": "^important-.*", "tasks.max": "two" ``` What error will occur when starting the connector?

A ValueError: invalid literal for int() with base 10: 'two'

B No error, connector starts successfully

C KeyError: 'tasks.max' not found

D TypeError: unsupported operand type(s) for +: 'int' and 'str'

💡 Hint

Check the expected data type for 'tasks.max' in Kafka connector configs.

'tasks.max' expects an integer value. Providing the string 'two' causes a ValueError when the system tries to convert it to int.

📝 Syntax

advanced

Which option correctly defines a Kafka Connect replication policy class in MirrorMaker2?

Choose the correct Java class name syntax for a custom replication policy in MirrorMaker2 configuration.

A com.example.kafka.replication.customReplicationPolicy

B com.example.kafka.replication.CustomReplicationPolicy()

C com.example.kafka.replication.CustomReplicationPolicy

D com.example.kafka.replication.Custom_Replication_Policy

💡 Hint

Java class names follow a specific naming convention and do not include parentheses.

Java class names use PascalCase without underscores and do not include parentheses when referenced in configs.

🚀 Application

expert

How many topics will be replicated with this MirrorMaker2 topic regex?

If the source Kafka cluster has topics: ["orders", "orders-2023", "payments", "payments-2023", "logs", "logs-archive"], and MirrorMaker2 is configured with: ``` topics = "^(orders|payments)-2023$" ``` How many topics will MirrorMaker2 replicate?

A 3

B 1

C 4

D 2

💡 Hint

Check which topic names exactly match the regex pattern.

The regex matches topics that start with 'orders' or 'payments' and end exactly with '-2023'. Only 'orders-2023' and 'payments-2023' match.