Extending Apache Airflow for Enterprise-Grade Scheduling at eBay

Enterprise data pipelines come with complex scheduling requirements that Apache Airflow doesn’t support out of the box. At eBay, our business teams depend on advanced workflow control primitives daily

— so we built them natively into our Airflow 2.10 platform:

• Breakpoints — pause a pipeline at a specific task for inspection without failing the run
• Skip logic — dynamically bypass tasks or task groups at runtime
• Calendar-aware scheduling — model business calendars as custom Airflow timetables
• Pipeline pause/resume — operator-triggered suspension of in-flight DAG runs with state consistency

We’ll share the engineering trade-offs, architectural constraints we hit, and patterns reusable beyond eBay’s stack.