Event-based DAG Parsing: No more F5ing in the UI

Have you ever added a DAG file and had no clue what happened to it? You’re not alone! With default settings, Airflow can wait up to 5 minutes before processing new DAG files.

In this talk, I’ll discuss the implementation of an event-based DAG parser that immediately processes changes in the DAGs folder. As a result, changes are reflected immediately in the Airflow UI. In this talk I will cover:

• A demonstration of the event-based DAG parser and the fast Airflow UI experience
• How the current DAG parser implementation and configuration works
• How an event-based DAG parser is implemented