How do we reason about the reliability of our data pipeline in Wrike

Speaker(s): Alexander Eliseev
When: (Jul-14 16:00 UTC)

In this talk we will share some of the lessons we have learned after using Airflow for a couple of years and growing from 2 users to 8 teams.

We will cover:

  • Establishing a reliable review process on AirFlow
  • Managing multiple Airflow configurations
  • Data versioning