Migrating Between Object Storage Buckets

This page describes how to migrate a WarpStream cluster from one object storage bucket to another.

If you need to migrate a WarpStream cluster from one object storage bucket to another, follow these steps:

1. Make sure that the Agents have permission to perform operations on both the old bucket and the new bucket.

2. Deploy the Agents with the bucketURL flag set to the new bucket instead of the old one. This will cause the Agents to write all new files (both for ingestion and compaction) to the new bucket while still allowing them to read historical data from the old bucket.

3. Wait until there are no more data files under the warpstream prefix in the old bucket.