# Planasonix ## Docs - [Chat](https://docs.planasonix.com/ai-copilot/chat.md): Ask questions, get suggestions, and troubleshoot pipelines with AI chat. - [Knowledge base](https://docs.planasonix.com/ai-copilot/knowledge-base.md): Build an organization knowledge base to improve AI Copilot responses. - [AI Copilot overview](https://docs.planasonix.com/ai-copilot/overview.md): Accelerate pipeline development with AI-powered assistance. - [Pipeline generation](https://docs.planasonix.com/ai-copilot/pipeline-generation.md): Generate complete pipelines from natural language descriptions. - [SQL assistance](https://docs.planasonix.com/ai-copilot/sql-assistance.md): Get AI-powered help writing and optimizing SQL queries. - [Pipeline agents](https://docs.planasonix.com/api-reference/agents.md): Manage on-premises pipeline execution agents. - [AI Copilot](https://docs.planasonix.com/api-reference/ai.md): AI-powered pipeline assistance and code generation. - [Authentication](https://docs.planasonix.com/api-reference/auth.md): Authenticate users and manage sessions. - [Authentication](https://docs.planasonix.com/api-reference/authentication.md): Authenticate API requests using API keys. - [Data catalog](https://docs.planasonix.com/api-reference/catalog.md): Discover and document data assets. - [Connections](https://docs.planasonix.com/api-reference/connections.md): Create, test, and manage data source and destination connections. - [Data contracts](https://docs.planasonix.com/api-reference/contracts.md): Define and enforce data quality contracts. - [Import and convert](https://docs.planasonix.com/api-reference/convert.md): Import pipelines from other ETL platforms. - [Credentials](https://docs.planasonix.com/api-reference/credentials.md): Securely manage connection credentials. - [Dead letter queue](https://docs.planasonix.com/api-reference/dlq.md): Manage failed records in the dead letter queue. - [Git integration](https://docs.planasonix.com/api-reference/git.md): Version control pipelines with Git. - [Iceberg REST Catalog](https://docs.planasonix.com/api-reference/iceberg-catalog.md): Spec-compliant Apache Iceberg REST Catalog API for querying Planasonix-managed tables from any engine. - [API reference](https://docs.planasonix.com/api-reference/introduction.md): Programmatically interact with Planasonix using the REST API. - [Lineage and impact analysis](https://docs.planasonix.com/api-reference/lineage.md): Trace data lineage and analyze change impact. - [Orchestration API](https://docs.planasonix.com/api-reference/orchestration-api.md): Programmatically trigger syncs, backfills, and manage jobs. - [Pipelines](https://docs.planasonix.com/api-reference/pipelines.md): Create, manage, and execute data pipelines. - [Projects and folders](https://docs.planasonix.com/api-reference/projects.md): Organize pipelines into projects and folders. - [Reverse ETL](https://docs.planasonix.com/api-reference/reverse-etl.md): Manage reverse ETL syncs and destinations. - [Runs](https://docs.planasonix.com/api-reference/runs.md): View and manage pipeline execution runs. - [Schedules](https://docs.planasonix.com/api-reference/schedules.md): Create and manage pipeline execution schedules. - [Streams](https://docs.planasonix.com/api-reference/streams.md): Manage real-time data streams and CDC sources. - [Templates](https://docs.planasonix.com/api-reference/templates.md): Save and share reusable pipeline templates. - [Triggers](https://docs.planasonix.com/api-reference/triggers.md): Configure event-based pipeline triggers. - [User and settings](https://docs.planasonix.com/api-reference/user-settings.md): Manage user profile, preferences, API keys, and organization settings. - [AI providers](https://docs.planasonix.com/connections/ai-providers.md): Connect to AI and LLM providers like OpenAI, Anthropic, and Google AI for AI-powered transforms. - [APIs and webhooks](https://docs.planasonix.com/connections/apis-and-webhooks.md): Connect to REST APIs, GraphQL endpoints, and receive data via webhooks. - [Cloud storage](https://docs.planasonix.com/connections/cloud-storage.md): Connect to S3, Azure Blob, GCS, and other cloud and file storage providers. - [Credentials management](https://docs.planasonix.com/connections/credentials.md): Securely manage connection credentials, OAuth tokens, and API keys. - [Data warehouses](https://docs.planasonix.com/connections/data-warehouses.md): Connect to cloud data warehouses and lakehouses including Snowflake, BigQuery, Databricks, Redshift, and more. - [Databases](https://docs.planasonix.com/connections/databases.md): Connect to relational and NoSQL databases including PostgreSQL, MySQL, SQL Server, Oracle, MongoDB, and more. - [Delta Lake destination](https://docs.planasonix.com/connections/delta-lake.md): Write Delta Lake tables to Amazon S3, Google Cloud Storage, or Azure Blob Storage with ACID transactions, schema tracking, and column statistics. - [Hosted Iceberg REST Catalog](https://docs.planasonix.com/connections/iceberg-catalog.md): Connect any query engine to Planasonix-managed Iceberg tables using the hosted REST catalog - [Engine Connection Guides](https://docs.planasonix.com/connections/iceberg-catalog-engines.md): Step-by-step guides for connecting Snowflake, DuckDB, Spark, and Trino to the Planasonix Iceberg catalog - [Managed Lakehouse](https://docs.planasonix.com/connections/managed-lakehouse.md): Write data once as Parquet and commit to both Apache Iceberg and Delta Lake simultaneously — a fully managed, dual-format lakehouse destination. - [Microsoft OneLake destination](https://docs.planasonix.com/connections/onelake.md): Write Delta Lake tables to Microsoft Fabric Lakehouses and Warehouses via the OneLake REST API with service principal authentication. - [Connections overview](https://docs.planasonix.com/connections/overview.md): Connect Planasonix to your databases, warehouses, cloud storage, APIs, and SaaS applications. - [SaaS applications](https://docs.planasonix.com/connections/saas-applications.md): Connect to popular SaaS platforms including Salesforce, HubSpot, Shopify, Stripe, and 100+ more. - [Streaming platforms](https://docs.planasonix.com/connections/streaming-platforms.md): Connect to Kafka, Kinesis, Pulsar, and other streaming platforms for real-time data ingestion. - [Custom connectors](https://docs.planasonix.com/connectors/custom-connectors.md): Build custom connectors with the Planasonix Connector Development Kit. - [Connector gallery](https://docs.planasonix.com/connectors/gallery.md): Browse the complete catalog of 300+ pre-built connectors. - [JDBC gateway](https://docs.planasonix.com/connectors/jdbc-gateway.md): Connect to databases via JDBC drivers including Teradata, Hive, Druid, and more. - [Core concepts](https://docs.planasonix.com/getting-started/concepts.md): Understand the key building blocks of the Planasonix platform. - [Introduction](https://docs.planasonix.com/getting-started/introduction.md): Learn what Planasonix is and how it helps you build enterprise data pipelines. - [Quickstart](https://docs.planasonix.com/getting-started/quickstart.md): Get your first data pipeline running in under 5 minutes. - [Data catalog](https://docs.planasonix.com/governance/data-catalog.md): Discover, document, and organize your organization's data assets. - [Data contracts](https://docs.planasonix.com/governance/data-contracts.md): Define and enforce data quality contracts between producers and consumers. - [Data marketplace](https://docs.planasonix.com/governance/data-marketplace.md): Discover, publish, and install reusable data packages across your organization. - [Data stewardship](https://docs.planasonix.com/governance/data-stewardship.md): Assign data stewards and manage ownership of data assets. - [Documentation index](https://docs.planasonix.com/governance/documentation-index.md): Centralized documentation portal for your organization's data assets and pipelines. - [Impact analysis](https://docs.planasonix.com/governance/impact-analysis.md): Understand the downstream impact of schema or data changes. - [Data lineage](https://docs.planasonix.com/governance/lineage.md): Trace data from source to destination with column-level lineage. - [Data governance overview](https://docs.planasonix.com/governance/overview.md): Ensure data quality, compliance, and discoverability across your organization. - [Semantic layer](https://docs.planasonix.com/governance/semantic-layer.md): Define business metrics and a semantic layer for consistent analytics. - [MCP server](https://docs.planasonix.com/integrations/mcp.md): Connect Planasonix to Claude, Cursor, Windsurf, and other AI assistants using the Model Context Protocol. - [Branches & Tags](https://docs.planasonix.com/managed-lakehouse/branching.md): Create branches for safe experimentation and tags for bookmarking important snapshots. - [Multi-Catalog Sync](https://docs.planasonix.com/managed-lakehouse/catalog-sync.md): Automatically synchronize table metadata to external catalogs after every lakehouse commit. - [Column Statistics](https://docs.planasonix.com/managed-lakehouse/column-stats.md): Auto-computed min/max/null/distinct statistics for query pruning and data profiling. - [Contract Enforcement & Partition Advisor](https://docs.planasonix.com/managed-lakehouse/contract-enforcement.md): Validate data quality before lakehouse writes and get smart partition recommendations - [Managed Lakehouse](https://docs.planasonix.com/managed-lakehouse/overview.md): End-to-end managed data lakehouse: write once, query from anywhere with Iceberg + Delta dual-format, automated maintenance, and enterprise governance. - [Streaming Ingestion](https://docs.planasonix.com/managed-lakehouse/streaming.md): Micro-batch streaming mode for continuous data ingestion to your managed lakehouse. - [Table Explorer](https://docs.planasonix.com/managed-lakehouse/table-explorer.md): Navigate managed lakehouse tables with snapshots, branches, column stats, and catalog sync. - [Automated Table Maintenance](https://docs.planasonix.com/managed-lakehouse/table-maintenance.md): Keep your lakehouse tables healthy with automatic compaction, snapshot expiry, and orphan cleanup - [Time Travel](https://docs.planasonix.com/managed-lakehouse/time-travel.md): Browse snapshot history, preview data at any point in time, and compare snapshots side-by-side. - [Z-Order Sort](https://docs.planasonix.com/managed-lakehouse/z-order-sort.md): Multi-dimensional data clustering for optimal query pruning across multiple columns. - [Advanced nodes](https://docs.planasonix.com/nodes/advanced.md): Use SQL, Python, notebooks, UDFs, and AI models within your pipelines. - [Aggregation](https://docs.planasonix.com/nodes/aggregation.md): Aggregate, pivot, and unpivot data with summarization nodes. - [Anomaly Detection Transform](https://docs.planasonix.com/nodes/anomaly-detection.md): Detect statistical outliers in numeric columns using configurable methods and thresholds. - [Column transforms](https://docs.planasonix.com/nodes/column-transforms.md): Transform column values with date formatting, window functions, and more. - [Control flow](https://docs.planasonix.com/nodes/control-flow.md): Add conditional logic, error handling, and iteration to your pipelines. - [Custom SQL](https://docs.planasonix.com/nodes/custom-sql.md): Write PostgreSQL-compatible SQL queries powered by Apache DataFusion. - [Data quality](https://docs.planasonix.com/nodes/data-quality.md): Validate, profile, and protect data quality within your pipelines. - [Destination nodes](https://docs.planasonix.com/nodes/destinations.md): Write pipeline output to databases, warehouses, cloud storage, and APIs. - [Embedding Generator Transform](https://docs.planasonix.com/nodes/embedding-generator.md): Generate vector embeddings from text data for semantic search, similarity matching, and ML features. - [Explode Transform](https://docs.planasonix.com/nodes/explode.md): Expand array columns into individual rows for per-element processing. - [Flatten Transform](https://docs.planasonix.com/nodes/flatten.md): Convert nested JSON objects into flat columns for tabular processing. - [Joins and unions](https://docs.planasonix.com/nodes/joins-and-unions.md): Combine data from multiple sources using joins, fuzzy joins, and unions. - [Transform-Before-Land](https://docs.planasonix.com/nodes/managed-lakehouse-transforms.md): Recommended transforms for cleaning, validating, and optimizing data before writing to your managed lakehouse. - [Nodes overview](https://docs.planasonix.com/nodes/overview.md): Explore the complete library of pipeline nodes for sourcing, transforming, and delivering data. - [Parsers and builders](https://docs.planasonix.com/nodes/parsers-and-builders.md): Parse incoming data formats and build outgoing payloads. - [Row transforms](https://docs.planasonix.com/nodes/row-transforms.md): Filter, sort, sample, and deduplicate rows in your data pipeline. - [Source nodes](https://docs.planasonix.com/nodes/sources.md): Read data from connections, tables, webhooks, and other sources into your pipeline. - [Type Inference Transform](https://docs.planasonix.com/nodes/type-inference.md): Automatically detect and cast data types from string values for CSV, flat file, and text-based API ingestion. - [Z-Order Sort Transform](https://docs.planasonix.com/nodes/z-order-sort.md): Multi-dimensional data clustering transform for optimal query pruning on managed lakehouse tables. - [Getting started with notebooks](https://docs.planasonix.com/notebooks/getting-started.md): Create and run your first notebook in Planasonix. - [Notebooks overview](https://docs.planasonix.com/notebooks/overview.md): Run interactive notebooks within your data pipelines. - [Spark integration](https://docs.planasonix.com/notebooks/spark-integration.md): Run notebooks with Spark and Databricks compute. - [Alerts and notifications](https://docs.planasonix.com/observability/alerts.md): Set up alerts for pipeline failures, data anomalies, and volume changes. - [Cost insights](https://docs.planasonix.com/observability/cost-insights.md): Track and optimize data platform costs. - [Dashboard](https://docs.planasonix.com/observability/dashboard.md): View pipeline health, run history, and key metrics at a glance. - [Dead letter queue](https://docs.planasonix.com/observability/dead-letter-queue.md): Review, resolve, and reprocess failed records. - [Data diagnostics](https://docs.planasonix.com/observability/diagnostics.md): Diagnose data quality issues and identify root causes. - [Observability overview](https://docs.planasonix.com/observability/overview.md): Monitor pipeline health, data quality, and platform performance. - [Airflow integration](https://docs.planasonix.com/orchestration/airflow-integration.md): Orchestrate Planasonix pipelines from Apache Airflow. - [Backfill](https://docs.planasonix.com/orchestration/backfill.md): Reprocess historical data ranges in your pipelines. - [Orchestration overview](https://docs.planasonix.com/orchestration/overview.md): Schedule, trigger, and chain pipeline executions. - [Pipeline chaining](https://docs.planasonix.com/orchestration/pipeline-chaining.md): Chain pipelines together to create complex multi-step workflows. - [Schedules](https://docs.planasonix.com/orchestration/schedules.md): Run pipelines on a recurring schedule with cron-based scheduling. - [Azure Blob triggers](https://docs.planasonix.com/orchestration/trigger-azure-blob.md): Trigger pipeline runs when blobs are created in Azure Storage. - [File watcher triggers](https://docs.planasonix.com/orchestration/trigger-file-watcher.md): Trigger pipeline runs when files change in monitored locations. - [GCS event triggers](https://docs.planasonix.com/orchestration/trigger-gcs.md): Trigger pipeline runs when objects arrive in Google Cloud Storage. - [S3 event triggers](https://docs.planasonix.com/orchestration/trigger-s3.md): Trigger pipeline runs when files arrive in Amazon S3 buckets. - [Triggers](https://docs.planasonix.com/orchestration/triggers.md): Trigger pipeline runs based on events from S3, GCS, Azure, and more. - [Webhooks](https://docs.planasonix.com/orchestration/webhooks.md): Trigger pipelines via HTTP webhooks and integrate with external systems. - [Pipeline canvas](https://docs.planasonix.com/pipelines/canvas.md): Build data pipelines visually with the drag-and-drop canvas editor. - [Convert from Alteryx](https://docs.planasonix.com/pipelines/convert-alteryx.md): Import Alteryx workflows and convert them to Planasonix pipelines. - [Convert from dbt](https://docs.planasonix.com/pipelines/convert-dbt.md): Import dbt projects and convert models to Planasonix pipelines. - [Convert from Fivetran](https://docs.planasonix.com/pipelines/convert-fivetran.md): Import and convert Fivetran sync configurations to Planasonix pipelines. - [Convert from Informatica](https://docs.planasonix.com/pipelines/convert-informatica.md): Import Informatica PowerCenter or IICS mappings to Planasonix pipelines. - [Convert from Matillion](https://docs.planasonix.com/pipelines/convert-matillion.md): Import Matillion ETL jobs and convert them to Planasonix pipelines. - [Convert from SSIS](https://docs.planasonix.com/pipelines/convert-ssis.md): Import SQL Server Integration Services packages to Planasonix pipelines. - [Environments](https://docs.planasonix.com/pipelines/environments.md): Deploy pipelines across development, staging, and production environments. - [Git integration](https://docs.planasonix.com/pipelines/git-integration.md): Version control your pipelines with Git integration for collaboration and deployment. - [Import and convert](https://docs.planasonix.com/pipelines/import-and-convert.md): Import existing pipelines from Fivetran, dbt, Matillion, Informatica, Alteryx, and SSIS. - [Pipelines overview](https://docs.planasonix.com/pipelines/overview.md): Design, build, and manage data pipelines with Planasonix's visual canvas. - [Templates](https://docs.planasonix.com/pipelines/templates.md): Save and share pipeline templates to accelerate development. - [Variables](https://docs.planasonix.com/pipelines/variables.md): Use variables to parameterize your pipelines and make them reusable. - [Error history](https://docs.planasonix.com/platform/error-history.md): Review and diagnose errors across all pipeline executions. - [Pipeline agents](https://docs.planasonix.com/platform/pipeline-agents.md): Deploy agents to securely connect to on-premises or private network data sources. - [Run history](https://docs.planasonix.com/platform/run-history.md): View and analyze the execution history of all pipeline runs. - [Shared items](https://docs.planasonix.com/platform/shared-items.md): View and manage pipelines, connections, and resources shared with you or by you. - [Trash](https://docs.planasonix.com/platform/trash.md): Recover deleted pipelines, connections, and other resources. - [User management](https://docs.planasonix.com/platform/user-management.md): Invite users, manage roles, and control access to your organization. - [Destinations](https://docs.planasonix.com/reverse-etl/destinations.md): Configure reverse ETL destination targets. - [Field mapping](https://docs.planasonix.com/reverse-etl/field-mapping.md): Map warehouse columns to destination fields. - [Monitoring](https://docs.planasonix.com/reverse-etl/monitoring.md): Monitor sync runs, review errors, and manage the dead letter queue. - [Reverse ETL overview](https://docs.planasonix.com/reverse-etl/overview.md): Sync data from your warehouse back to operational tools and SaaS applications. - [Syncs](https://docs.planasonix.com/reverse-etl/syncs.md): Create and manage reverse ETL sync jobs. - [API keys](https://docs.planasonix.com/settings/api-keys.md): Create and manage API keys for programmatic access to Planasonix. - [Appearance](https://docs.planasonix.com/settings/appearance.md): Customize the look and feel of the Planasonix interface. - [Compute](https://docs.planasonix.com/settings/compute.md): Configure compute resources and execution environments. - [Integrations](https://docs.planasonix.com/settings/integrations.md): Connect Planasonix with Git, webhooks, and orchestration tools. - [IP whitelisting](https://docs.planasonix.com/settings/ip-whitelisting.md): Restrict platform access to approved IP addresses. - [Logging](https://docs.planasonix.com/settings/logging.md): Configure pipeline logging levels, retention, and log streaming. - [Multi-factor authentication](https://docs.planasonix.com/settings/mfa.md): Enable MFA for enhanced account security. - [Notifications](https://docs.planasonix.com/settings/notifications.md): Configure notification preferences for pipeline events and alerts. - [Orchestration API](https://docs.planasonix.com/settings/orchestration-api.md): Configure the orchestration API for programmatic pipeline management. - [Plans and pricing](https://docs.planasonix.com/settings/plans-and-pricing.md): Understand Planasonix subscription tiers and feature availability. - [Profile](https://docs.planasonix.com/settings/profile.md): Manage your account profile and personal settings. - [Session policy](https://docs.planasonix.com/settings/session-policy.md): Configure session timeout and security policies. - [SSH tunnels](https://docs.planasonix.com/settings/ssh-tunnels.md): Connect to databases behind firewalls using SSH tunnel configuration. - [SSO](https://docs.planasonix.com/settings/sso.md): Configure SAML-based single sign-on for your organization. - [Auth0 SSO setup](https://docs.planasonix.com/settings/sso-auth0.md): Configure Auth0 as your SAML identity provider. - [Azure AD SSO setup](https://docs.planasonix.com/settings/sso-azure-ad.md): Configure Azure AD (Entra ID) as your SAML identity provider. - [Google Workspace SSO setup](https://docs.planasonix.com/settings/sso-google.md): Configure Google Workspace as your SAML identity provider. - [Generic OIDC setup](https://docs.planasonix.com/settings/sso-oidc.md): Configure any OpenID Connect provider for Planasonix authentication. - [Okta SSO setup](https://docs.planasonix.com/settings/sso-okta.md): Configure Okta as your SAML identity provider for Planasonix. - [OneLogin SSO setup](https://docs.planasonix.com/settings/sso-onelogin.md): Configure OneLogin as your SAML identity provider. - [Teams and permissions](https://docs.planasonix.com/settings/teams-and-permissions.md): Manage teams, roles, and access permissions within your organization. - [UDF reviews](https://docs.planasonix.com/settings/udf-reviews.md): Review and approve custom user-defined functions before deployment. - [Usage and limits](https://docs.planasonix.com/settings/usage.md): Monitor your usage and understand plan limits. - [Webhook settings](https://docs.planasonix.com/settings/webhook-settings.md): Configure organization-level webhook endpoints and request signing. - [CDC sources](https://docs.planasonix.com/streaming/cdc-sources.md): Capture database changes in real-time with change data capture. - [Streaming Lake Ingestion](https://docs.planasonix.com/streaming/lake-streaming.md): Arrow-native micro-batch streaming to your managed lakehouse with configurable commit intervals, backpressure, and monitoring. - [Streaming overview](https://docs.planasonix.com/streaming/overview.md): Process real-time data streams and change data capture events. - [Stream processing](https://docs.planasonix.com/streaming/stream-processing.md): Process and transform streaming data in real-time. - [Webhook streams](https://docs.planasonix.com/streaming/webhook-streams.md): Receive real-time data from external services via webhook stream endpoints. - [Agent troubleshooting](https://docs.planasonix.com/troubleshooting/agents.md): Diagnose and resolve pipeline agent connectivity and health issues. - [Authentication troubleshooting](https://docs.planasonix.com/troubleshooting/authentication.md): Resolve login, SSO, and API authentication issues. - [Connection troubleshooting](https://docs.planasonix.com/troubleshooting/connections.md): Diagnose and resolve common connection issues. - [Pipeline troubleshooting](https://docs.planasonix.com/troubleshooting/pipelines.md): Diagnose and resolve pipeline execution failures. - [SAP troubleshooting](https://docs.planasonix.com/troubleshooting/sap.md): Resolve common issues with SAP HANA, OData, and RFC/BAPI connections. ## Optional - [Website](https://planasonix.com) - [Platform](https://app.planasonix.com) - [Status](https://status.planasonix.com)