Which GCP product is used for workflow orchestration of data pipelines, typically using Apache Airflow?

Google Cloud (GCP) Medium

Google Cloud (GCP) — Medium

Which GCP product is used for workflow orchestration of data pipelines, typically using Apache Airflow?

Key points

  • Cloud Composer integrates with Apache Airflow for workflow management
  • Dataproc is primarily for Hadoop and Spark processing
  • Dataflow focuses on stream and batch processing
  • Cloud Scheduler is used for scheduling jobs, not workflow orchestration

Ready to go further?

Related questions