Lesson 38: Airflow - How to create an Airflow sensor
Course "Data Engineering from 0"
Airflow
How to create an Airflow sensor
Code from the lesson:
Sensor: https://github.com/digitalberd/airflo...
Scripts: https://github.com/digitalberd/airflo...
Dag: https://github.com/digitalberd/airflo...
Timecodes:
0:00 - What is an Airflow sensor
2:50 - Creating a sensor - checking for data in a table
19:47 - How to create Airflow tasks in a loop
24:40 - Deploying
29:30 - Seeing how it works