Airflow Journey @SG

Presented at Airflow Summit 2021

This talk will cover the adoption journey (Technical Challenges & Team Organization) of Apache Airflow (1.8 to 2.0) at Societe Generale.

Time line of events:

  • POC with v1.8 to convince our management.
  • Shared infrastructure with v1.10.2.
  • Multiple Infrastructure with v1.10.12.
  • On demand service offer with v2.0 (Challenges & REX)