Premium feature
End-to-end streaming pipelines (managed CDC connectors, stream processors, and long-lived jobs) are available on Premium and higher tiers. Starter and Professional workspaces may offer batch-only ingestion. If streaming nodes are disabled, contact your admin about upgrading or enabling the streaming add-on.Core concepts
- Stream
- Offset and checkpoint
- Processing graph
A stream is an ordered sequence of events or change records you read from a source system or message bus.
Use cases
Operational analytics
Feed product, billing, and support events into near-real-time dashboards without hourly batch refreshes.
Replication and sync
Mirror database rows to analytics stores using CDC while minimizing impact on OLTP systems.
Event-driven automation
Drive webhooks and downstream jobs when high-value events pass quality checks in-stream.
Data lake hydration
Continuously land raw and conformed topics into object storage or lakehouse tables for downstream batch consolidation.
How streaming fits batch work
Many teams run streaming for freshness and batch for reconciliation: nightly jobs compare stream-loaded tables to source-of-truth snapshots and repair drift. Planasonix lets you reference the same connections and schemas in both worlds.Next steps
Pick a source
Review CDC sources for databases and buses your estate uses.
Design processing
Read Stream processing for windows, transforms, and node patterns.
Observe and alert
Attach alerts to lag, error rate, and consumer health metrics.