MirrorMaker
This page describes the settings tweaks you may have to do to leverage MirrorMaker to migrate to Warpstream.
MirrorMaker is a Kafka process that replicates data between Kafka clusters or Kafka-compatible data stores such as Warpstream. A video walkthrough can be found below:
You should tune your producer settings like we recommend there.
If you notice that producing data from the MirrorMaker is taking too much time for the throughput it tries to handle and encounters consumer group timeouts, then you can try the following:
bump the
session.timeout.ms
to 2-5minincrease the
max.poll.interval.ms
to 10minset
max.poll.records
to 100-300 (default is 500)
Last updated