Airflow is wonderfully, frustratingly complex - and so is global finance! Stripe has very specific needs all over the planet, and we have customized Airflow to adapt to the variety and rigor that we need to grow the GDP of the internet.
In this talk, you’ll learn:
-
how we support independent DAG change management for over 500 different teams running over 150k tasks
-
how we’ve customized Airflow’s Kubernetes integration to comply with Stripe’s unique compliance requirements
-
how we’ve built on Airflow to support no-code data pipelines.
Nick Bilozerov
Sr. Data Engineer at Stripe
Daniel Melchor
Software Engineer at Stripe
Sabrina Liu
Software Engineer at Stripe