The State of Airflow: Momentum, Innovation, and What's Next
Airflow 3 has been out for a year. In this keynote, we take stock of where the community stands, what we built together, and where we are headed. We open with the data: adoption trends, community growth, and honest feedback from teams running Airflow 3 in production. What is working, what surprised …
Airflow at the heart of Equifax's Data Processing
At Equifax, Apache Airflow is used across many departments, helping Data Engineers, Data Scientists, and Business Analysts in their daily work. This presentation is about how to use modern orchestration technology at the heart of data processing and business processes to support daily company …
Airflow as a Platform: Operating High-Volume, Enterprise-Scale Orchestration
What happens when your Airflow footprint grows from a single team’s scheduler to a fully managed enterprise data platform? You stop thinking about individual DAGs and start thinking about fleet operations, tenant isolation, automated upgrades, and self-service authoring at scale. In this talk, …
Orchestrating 100 ML Models using Airflow
Productionizing ML workflows is complicated; scaling them is harder. At Ramp, we grew from zero to nearly 100 production ML models powering systems like credit risk assessment and sales lead valuation. This talk covers how Airflow became the backbone of our ML platform, orchestrating ETL jobs, data …
Autonomous, Not Unsupervised: Agent-Authored Pipelines on Airflow at Together AI
At Together AI, AI agents have become the primary authors of our production data pipelines — and Airflow is what makes that safe to do. Agents do the building. Airflow gives us the surface to set the rules, see what’s happening, and step in when we need to. The interesting part is what each side has …