Are you tired of spending hours on Airflow migrations and wondering how to make them more accessible? Would you like to be able to test your code on different Airflow versions? or are you struggling to set up a reliable local development environment?
These are some of the top pain points for data engineers working with Airflow. But fear not – Wix Data Engineering has some best practices to share that will make your life easier.
What will the audience learn:
-
How does Wix Data Engineering make Airflow migrations easier and less painful.
-
How to ensure DEs code is forward-compatible with the latest Airflow version.
-
How to test code on different Airflow versions
-
How to maintain a stable local environment for DEs while speeding up their dev velocity.
-
Some more must-know framework team’s best practices.