What's new in Apache Airflow 2.10?

Опубликовано: 15 Октябрь 2024
на канале: Data with Marc
2,153
67

🚨 Join me at the Airflow Summit between Sept 10 and Sept 12, 2024, in San Francisco. Use the code 20DISC_MARC for a 20% discount
https://airflowsummit.org/tickets/ 🚨

Here are the significant updates:

✅ Dynamic Dataset definition
💻 Create datasets dynamically from tasks! No more static datasets

✅ Big update on the Datasets view
💻 Better track which dataset triggers which DAG runs and more!

✅ Hybrid Executors!
💻 Configure multiple executors to efficiently run your tasks

✅ Dark mode
💻 That's right! Save your eyes (still experimental, though)

✅ New button to re-parse DAGs
💻 Stop wasting time, hit the button to get your DAG updates right away

✅ New concat() method
💻 Combine multiple outputs from upstream tasks

And more!

🏆 BECOME A PRO: https://www.udemy.com/course/the-comp...

👍 Smash the like button to become an Airflow Super Hero!
❤️ Subscribe to my channel to become a master of Airflow