MirrorMaker
This page describes the settings tweaks you may have to do to leverage MirrorMaker to migrate to Warpstream.
Last updated
Was this helpful?
.svg?alt=media&token=de534435-d87b-4f47-a762-54ed6aae1b02)
.svg?alt=media&token=5df48930-f99f-4779-b05f-359312e79636)
This page describes the settings tweaks you may have to do to leverage MirrorMaker to migrate to Warpstream.
Last updated
Was this helpful?
MirrorMaker is a Kafka process that replicates data between Kafka clusters or Kafka-compatible data stores such as Warpstream. A video walkthrough can be found below:
You should tune your producer settings like we recommend there.
If you notice that producing data from the MirrorMaker is taking too much time for the throughput it tries to handle and encounters consumer group timeouts, then you can try the following:
bump the session.timeout.ms to 2-5min
increase the max.poll.interval.ms to 10min
set max.poll.records to 100-300 (default is 500)