Ease your transition to the cloud or maintain a hybrid data environment by orchestrating workflows that cross between on-premises and the public cloud. Create workflows that connect data, processing, and services across clouds to give you a unified data environment.

Cloud Composer is built upon Apache Airflow, giving users freedom from lock-in and portability. This open source project, which Google is contributing back into, provides freedom from lock-in for customers as well as integration with a broad number of platforms, which will only expand as the Airflow community grows.

Cloud Composer pipelines are configured as directed acyclic graphs (DAGs) using Python, making it easy for any user. One-click deployment yields instant access to a rich library of connectors and multiple graphical representations of your workflow in action, making troubleshooting easy. Automatic synchronization of your directed acyclic graphs ensures your jobs stay on schedule.

Key enhancements include DAG versioning for auditability and confident rollbacks, alongside scheduler-managed backfills for simpler historical data reprocessing. A new Task Execution API & SDK paves the way for future multi-language support and isolated task environments. Users benefit from a faster, modern React-based UI with improved navigation. Planned event-driven scheduling aims for more reactive, near real-time pipelines. The Edge Executor optimizes remote task execution, and a split CLI (airflow/airflowctl) offers a clearer command-line experience for development and operations.