Run the Agents Locally

Instructions on how to run the WarpStream Agent locally for testing / development purposes.

First, install the WarpStream Agent for your platform.

Once you've installed the WarpStream Agent, you can run the playground command to create an ephemeral cluster / account for local development.

Docker

docker run -p 8080 -p 9092:9092 public.ecr.aws/warpstream-labs/warpstream_agent:latest playground

The playground stores data in memory only by default, so any data written will no longer be accessible once the process exits.

Once the docker container is running, you're ready to run any application locally that expects to connect to Kafka, and it'll connect to WarpStream instead if you set the bootstrap URL to localhost:9092.

If you encounter any problems connecting an application running outside of Docker to the WarpStream agent running inside of Docker, follow our instructions below for diagnosing connection issues.

Standalone Binary

Alternatively, if you installed the standalone WarpStream Agent binary and it is in your PATH, you can just run:

warpstream playground

The playground stores data in memory only by default, so any data written will no longer be accessible once the process exits.

Once that completes, run the following command to test the connection:

warpstream kcmd -type diagnose-connection -bootstrap-host localhost -bootstrap-port 9092

If that succeeds, then you're ready to run any application locally that expects to connect to Apache Kafka, and it'll connect to WarpStream instead if you set the bootstrap URL to localhost:9092.

If the diagnostic command returns an error, follow the provided instructions to diagnose and fix it.

Diagnosing Connection Issues

The WarpStream Agent binary ships with a utility for diagnosing connection issues. However, diagnosing connection issues cannot be done in a general purpose manner from within a Docker container. Therefore even if you're running the Agent in a Docker container locally, you'll need to follow our "Installation Script" Agent installation instructions to install the raw WarpStream Agent binary locally before proceeding.

Once the binary is installed, run the following command to test the connection:

warpstream kcmd -type diagnose-connection -bootstrap-host localhost -bootstrap-port 9092

If that succeeds, then you're ready to run any application locally that expects to connect to Apache Kafka, and it'll connect to WarpStream instead if you set the bootstrap URL to localhost:9092.

If the diagnostic command returns an error, follow the provided instructions to diagnose and fix.