The State of Airflow: Momentum, Innovation, and What's Next
Airflow 3 has been out for a year, and the systems we are being asked to build are changing quickly. In this keynote, we ask a broader question: what does orchestration need to become as production workloads get more intelligent, dynamic, and distributed? Airflow has always been about coordinating …
Airflow at the heart of Equifax's Data Processing
At Equifax, Apache Airflow is used across many departments, helping Data Engineers, Data Scientists, and Business Analysts in their daily work. This presentation is about how to use modern orchestration technology at the heart of data processing and business processes to support daily company …
Airflow as a Platform: Operating High-Volume, Enterprise-Scale Orchestration
What happens when your Airflow footprint grows from a single team’s scheduler to a fully managed enterprise data platform? You stop thinking about individual DAGs and start thinking about fleet operations, tenant isolation, automated upgrades, and self-service authoring at scale. In this talk, …
Orchestrating 100 ML Models using Airflow
Productionizing ML workflows is complicated; scaling them is harder. At Ramp, we grew from zero to nearly 100 production ML models powering systems like credit risk assessment and sales lead valuation. This talk covers how Airflow became the backbone of our ML platform, orchestrating ETL jobs, data …