MirrorMaker

This page describes the settings tweaks you may have to do to leverage MirrorMaker to migrate to Warpstream.

MirrorMaker is a Kafka process that replicates data between Kafka clusters or Kafka-compatible data stores such as Warpstream. A video walkthrough can be found below:

You should tune your producer settings like we recommend there.

If you notice that producing data from the MirrorMaker is taking too much time for the throughput it tries to handle and encounters consumer group timeouts, then you can try the following:

• bump the session.timeout.ms to 2-5min

• increase the max.poll.interval.ms to 10min

• set max.poll.records to 100-300 (default is 500)