Pipeline variables vs global variables
- Pipeline variables
- Global variables
Pipeline variables belong to one pipeline (or a closely related set of graphs you treat as one product). Use them for values that are specific to that flow: landing-zone paths, topic names, feature flags for that job, or default batch sizes.Typical properties:
- Name: Identifier you use in expressions (for example,
landing_bucket). - Default value: Used when nothing else overrides the variable.
- Type or validation (when exposed in the UI): Reduces misconfiguration before run time.
Variable syntax and usage
You insert variables into text fields that support interpolation—connection parameters, paths, SQL fragments, JSON templates, and similar. Common patterns:- Use descriptive names:
raw_sales_bucketbeatsb1. - Avoid secrets in variables when your organization provides a secret store or credential references; store credentials in connections and pass non-secret locators via variables.
- Document required variables in the pipeline description or template readme so consumers know what they must set.
Environment-specific overrides
On plans with environments, you map the same pipeline todevelopment, staging, production, or custom stages. Environment-specific variable overrides replace defaults when you deploy or run in that environment.
Typical workflow:
- Define pipeline variables with safe defaults (often dev-like values).
- In each environment, set overrides for buckets, databases, API base URLs, and batch limits.
- Run or schedule the pipeline in an environment; Planasonix resolves variables using that environment’s layer.
Why override per environment instead of duplicating pipelines?
Why override per environment instead of duplicating pipelines?
Duplication drifts: one copy gets a fix, the other does not. Variables plus environments keep one graph, one review story, and a clear matrix of “what changes between stages.”
Coordinating with Git (enterprise)
Coordinating with Git (enterprise)
When Git integration is enabled, variable names and default metadata often live in versioned artifacts, while secret values and some override values may remain in the managed platform. That split supports PR review without leaking production credentials into the repository.
Related reading
Environments
Deploy across stages with consistent override behavior.
Git integration
Version pipeline definitions alongside application code.