Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda

Опубликовано: 29 Октябрь 2024
на канале: Data with Marc
7,607
111

Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda

🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-comp...

In this project, you will learn:

✅ How to set up an Airflow environment with the Astro CLI
✅ How to set up and configure Snowflake with Airflow
✅ How to load data from an HTTP endpoint into a Snowflake table
✅ How to use python virtual environments to avoid dependency conflicts
✅ How to run data quality checks with Soda and the ExternalPythonOperator

Enjoy ❤️