LogoLogo
WarpStream.comSlackDiscordContact UsCreate Account
  • Overview
    • Introduction
    • Architecture
      • Service Discovery
      • Write Path
      • Read Path
      • Life of a Request (Simplified)
    • Change Log
  • Getting Started
    • Install the WarpStream Agent / CLI
    • Run the Demo
    • "Hello World" for Apache Kafka
  • BYOC
    • Run the Agents Locally
    • Deploy the Agents
      • Object Storage Configuration
      • Kubernetes Known Issues
      • Rolling Restarts and Upgrades
    • Infrastructure as Code
      • Terraform Provider
      • Helm charts
      • Terraform Modules
    • Monitoring
      • Pre-made Datadog Dashboard
      • Pre-made Grafana Dashboard
      • Important Metrics and Logs
      • Recommended List of Alerts
      • Monitoring Consumer Groups
      • Hosted Prometheus Endpoint
    • Client Configuration
      • Tuning for Performance
      • Configure Clients to Eliminate AZ Networking Costs
        • Force Interzone Load Balancing
      • Configuring Kafka Client ID Features
      • Known Issues
    • Authentication
      • SASL Authentication
      • Mutual TLS (mTLS)
      • Basic Authentication
    • Advanced Agent Deployment Options
      • Agent Roles
      • Agent Groups
      • Protect Data in Motion with TLS Encryption
      • Low Latency Clusters
      • Network Architecture Considerations
      • Agent Configuration Reference
      • Reducing Infrastructure Costs
      • Client Configuration Auto-tuning
    • Hosted Metadata Endpoint
    • Managed Data Pipelines
      • Cookbooks
    • Schema Registry
      • WarpStream BYOC Schema Registry
      • Schema Validation
      • WarpStream Schema Linking
    • Port Forwarding (K8s)
    • Orbit
    • Enable SAML Single Sign-on (SSO)
    • Trusted Domains
    • Diagnostics
      • GoMaxProcs
      • Small Files
  • Reference
    • ACLs
    • Billing
      • Direct billing
      • AWS Marketplace
    • Benchmarking
    • Compression
    • Protocol and Feature Support
      • Kafka vs WarpStream Configuration Reference
      • Compacted topics
    • Secrets Overview
    • Security and Privacy Considerations
    • API Reference
      • API Keys
        • Create
        • Delete
        • List
      • Virtual Clusters
        • Create
        • Delete
        • Describe
        • List
        • DescribeConfiguration
        • UpdateConfiguration
      • Virtual Clusters Credentials
        • Create
        • Delete
        • List
      • Monitoring
        • Describe All Consumer Groups
      • Pipelines
        • List Pipelines
        • Create Pipeline
        • Delete Pipeline
        • Describe Pipeline
        • Create Pipeline Configuration
        • Change Pipeline State
      • Invoices
        • Get Pending Invoice
        • Get Past Invoice
    • CLI Reference
      • warpstream agent
      • warpstream demo
      • warpstream cli
      • warpstream playground
    • Integrations
      • Arroyo
      • AWS Lambda Triggers
      • ClickHouse
      • Debezium
      • Decodable
      • DeltaStream
      • docker-compose
      • DuckDB
      • ElastiFlow
      • Estuary
      • Fly.io
      • Imply
      • InfluxDB
      • Kestra
      • Materialize
      • MinIO
      • MirrorMaker
      • MotherDuck
      • Ockam
      • OpenTelemetry Collector
      • ParadeDB
      • Parquet
      • Quix Streams
      • Railway
      • Redpanda Console
      • RisingWave
      • Rockset
      • ShadowTraffic
      • SQLite
      • Streambased
      • Streamlit
      • Timeplus
      • Tinybird
      • Upsolver
    • Partitions Auto-Scaler (beta)
    • Serverless Clusters
Powered by GitBook
On this page
  • Step 1: Setting up the WarpStream credentials
  • Prerequisites
  • Create a WarpStream credential
  • Step 2: Connect DeltaStream to WarpStream
  • Next Steps

Was this helpful?

  1. Reference
  2. Integrations

DeltaStream

Learn how to connect DeltaStream and WarpStream.

PreviousDecodableNextdocker-compose

Last updated 5 months ago

Was this helpful?

DeltaStream is a serverless stream processing platform that integrates with streaming storage services. DeltaStream provides a SQL-based interface wherein you can easily create stream processing applications such as streaming pipelines, materialized views, microservices, and many more.

This document walks you through setting up WarpStream to be used as a data in DeltaStream.

Step 1: Setting up the WarpStream credentials

Prerequisites

  • DeltaStream account: get access to DeltaStream .

  • WarpStream account: get access to WarpStream .

  • The WarpStream cluster is up and running with active, populated topics.

Create a WarpStream credential

  • Navigate to your WarpStream console and select the appropriate Cluster.

  • Select Credentials from the top row navigation.

  • Name the credential and then click to create. dsCred in this example.

  • Follow the instructions, and save the credentials in a safe place.

Step 2: Connect DeltaStream to WarpStream

  • Back in DeltaStream, navigate to the Resources section, click Add Store, and select Kafka.

  • Fill in the Kafka dialog as follows:

    • Name - In this example WarpStream

    • Region - Select from the available areas (the one most applicable)

    • URLs to connect - Applicable bootstrap server and port, here serverless.warpstream.com:9092

    • SASL Hash Function - select SHA512

    • Username - This is the username from the credential you created in WarpStream

    • Password - This is the password from the credential you created in WarpStream

Next Steps

Everything is now configured for you to define and start executing against your Apache Kafka®-compatible WarpStream data stores.

DeltaStream Objects
queries
Store
by registering here
by registering here