MirrorMaker

This page describes the settings tweaks you may have to do to leverage MirrorMaker to migrate to Warpstream.

MirrorMaker is a Kafka process able to replicate data between Kafka clusters or Kafka-compatible datastores such as Warpstream.

You should tune your producer settings like we recommend there.

If you notice that producing data from the MirrorMaker is taking too much time for the throughput it tries to handle, and encounter consumer group timeouts, then you can try to the following:

  • bump the session.timeout.ms to 2-5min

  • increase the max.poll.interval.ms to 10min

  • set max.poll.records to 100-300 (default is 500)

Last updated

Logo

Apache, Apache Kafka, Kafka, and associated open source project names are trademarks of the Apache Software Foundation. Kinesis is a trademark of Amazon Web Services.