Apache Airflow

Field note

What it does

Orchestrates data pipelines, ML training, and agentic workloads with workflows-as-code, extensible operators, and a web UI.

Capabilities

Available capabilities

Backfill and Reruns Web UI Monitoring Workflow Scheduling Dynamic DAG Generation Task Orchestration

Tags

Tags

Data engineering Machine Learning workflow orchestration

Ways to use it

Ways to use it

sdk

Python / https://airflow.apache.org/docs/apache-airflow/stable/task-sdk.html