Support Kafka based consumer offsets storage

[akki]

Feature request

Currently, uReplicator supports only Zookeeper based offset storage. But the newer versions of Kafka allow (and encourage) to store offsets in Kafka's built-in topic (__consumer_offset).

So, It'd be nice if uReplicator allows the option to choose offset storage (zookeeper or kafka).

Related tickets

This would also be one step closer in achieving #228.
I also found a similar request in #246 but it was closed.

So I would like to know if the maintainers would be interested to see such a feature?

[akki]

From my understanding, to implement this feature one will need to add a KafkaCheckpointManager (like ZookeeperCheckpointManager) and hook it into the createCheckpointManager method.

If that is the right direction, I might be able to send a PR for this from one of our projects built on top of uReplicator which already has this feature.

[yangy0000]

yes, Kafka based consumer offsets storage is a good feature to have. it would be great if you want to contribute to this

[OneCricketeer]

What is the lifecycle of uReplicator with KIP-382 released?

[yangy0000]

We will keep maintaining, fixing bugs and improving the document, but we don't have any major change for uReplicator right now.