Airflow 3 has been out for a year. In this keynote, we take stock of where the community stands, what we built together, and where we are headed.
We open with the data: adoption trends, community growth, and honest feedback from teams running Airflow 3 in production. What is working, what surprised us, and what the survey tells us about how the ecosystem is evolving.
The second section covers the year in Airflow. Provider discovery and distribution has been modernized. Airflow gained first-class support for AI and LLM workloads. And scheduling became more powerful, letting pipelines respond to data at a finer granularity.
We close with what is coming. Pipelines will soon persist state across retries, making long-running workloads more reliable. Resumable operators will eliminate the restart-from-scratch failure mode. And multi-language support will open Airflow beyond the Python ecosystem.
Twenty-five minutes. A lot of ground to cover
Vikram Koka
Chief Strategy Officer at Astronomer & PMC Member of Apache Airflow