Getting Started with Airflow for Beginners
Getting Started with Airflow for Beginners.
At the end of this video, you will be able to:
✅ Identify the different ways of installing and running Airflow in local
✅ Create a local dev environment with Airflow following best practices
✅ Create data pipelines using Variables, XComs, and the Taskflow API
✅ Share data between tasks
✅ Trigger and monitor data pipelines
and more.
🏆 BECOME A PRO WITH AIRFLOW: https://www.udemy.com/course/the-comp...
If you're entirely new to Apache Airflow, take a look at those videos first:
1️⃣ Why Airflow? The Top 5 reasons to use it: • Why Airflow? The Top 5 Reasons To Use It!
2️⃣ What is Apache Airflow?: • What is Apache Airflow? For beginners
00:00 Introduction
00:28 Install and setup Airflow in local
00:38 Pip install
00:57 The docker-compose file
01:51 The Astro CLI
03:46 Airflowctl
04:17 Reminder of the basics
04:30 The DAG you will create
05:00 Create the DAG
07:08 Create the first task
08:55 Create the second task
09:24 Airflow variables
10:55 Create the last task
11:15 Define task dependencies
12:35 The final DAG
13:05 Run it!
13:33 Use the UI to monitor and manage your DAGs
With that, you have all the keys to getting started with Airflow!