Dataform
Dataform is a cloud service for data teams building SQL workflows that transform data in BigQuery.
What Dataform is
Dataform is a cloud service for data teams building SQL workflows that transform data in BigQuery. It supports developing, testing, versioning, and scheduling those workflows. Dataform Core extends SQL with dependency management, data quality assertions, and documentation, while the web environment provides workflow development, Git connections, continuous integration and deployment, and execution. Repositories can connect to GitHub, GitLab, Azure DevOps Services, and Bitbucket. Workflows can be scheduled through Dataform configurations, Managed Service for Apache Airflow, or Workflows with Cloud Scheduler, and automated with Cloud Build triggers. Dataform Core is open source and can be compiled and run locally with the Dataform CLI. In Google Cloud, compilation uses a sandbox without internet access and cannot call external APIs. Each repository must connect to a custom service account. The service is free; BigQuery queries, Cloud Logging, and other services used to execute pipelines may incur charges. Google Cloud's V8 runtime does not support additional Node.js capabilities or modules. A repository compilation is limited to 5,000 actions, with at most 50 dependencies per action.
Good
- Free plan; Dataform itself costs nothing.
- Supports GitHub, GitLab, Azure DevOps Services, and Bitbucket.
- Dataform Core includes dependency management and data quality assertions.
- Core can be compiled and run locally with the CLI.
Watch out
- Execution may incur BigQuery, Cloud Logging, or other service charges.
- Google Cloud runtime does not support additional Node.js capabilities or modules.
- Compilation is limited to 5,000 actions per repository.
- Each action can have at most 50 dependencies.
Who it suits
Dataform suits data analysts and data engineers building and collaborating on BigQuery transformation pipelines. It may fit teams that want SQL workflow development alongside version control, quality checks, and orchestration.
Verdict
Dataform combines BigQuery SQL workflow development with version control, quality checks, and scheduling. Account for possible execution-service charges and the documented runtime and compilation limits.
Plans and prices
From Dataform's own pricing page, checked 29 Sep 2026.
| Plan | Price | What it gives you |
|---|---|---|
| Dataform | Free | Dataform is free · BigQuery queries, Cloud Logging, and other services used to execute pipelines may incur charges |
The facts
Each one read from Dataform's own pages, with the date it was checked.
What it does
- Access control
- Each Dataform repository must be connected to a custom service account.checked 29 Sep 2026
- Compilation limits
- A repository compilation is limited to 5,000 actions, and each action can have at most 50 dependencies in the compiled graph.checked 29 Sep 2026
- Git integrations
- Dataform can connect repositories to GitHub, GitLab, Azure DevOps Services, and Bitbucket.checked 29 Sep 2026
- Intended users
- Google describes Dataform as a service for data analysts and data engineers building and collaborating on data transformation pipelines in BigQuery.checked 29 Sep 2026
- Limitations
- Dataform in Google Cloud uses a plain V8 runtime and does not support additional Node.js capabilities or modules.checked 29 Sep 2026
- Local use
- Dataform Core is open source and can be compiled and run locally with the Dataform CLI outside Google Cloud.checked 29 Sep 2026
- Orchestration
- Workflows can be scheduled with Dataform workflow configurations, Managed Service for Apache Airflow, Workflows and Cloud Scheduler, or automated with Cloud Build triggers.checked 29 Sep 2026
- Purpose
- Dataform helps data teams develop, test, version control, and schedule SQL workflows that transform data in BigQuery.checked 29 Sep 2026
- Security
- Dataform compiles code in a sandbox without internet access, and compilation cannot call external APIs.checked 29 Sep 2026
- SQL development
- Dataform Core extends SQL with dependency management, data quality assertions, and data documentation.checked 29 Sep 2026
- Support
- Google Cloud documentation links Dataform users to support resources, community forums, and troubleshooting guides.checked 29 Sep 2026
- Workflow tools
- The web environment supports workflow development, Git connections, continuous integration and deployment, and workflow execution.checked 29 Sep 2026
Alternatives to Dataform
- 1
Apache Hop
Free planOpen sourceWebAPILinuxmacOS7.7Free plan - 2
EasyMorph
Free planWebAPISelf-hostedWindows7.7From $600 a year - 3
Oracle WebCenter Content
AndroidiOSWebAPI7.7$3,450 one-time - 4
Coalesce Catalog
Free planWebAPIExtension7.5From $150 a month - 5
dbt Semantic Layer
Free planWebAPIExtension7.5From $100 a month - 6
Soda
Free planWebAPILinuxSelf-hosted7.5From $750 a month