Airflow Dag Package management | Why use KubernetesPodOperator & DockerOperator ?
#apacheairflow #airflowatjagex #kubernetespodoperator #dockeroperator #airflowdagmanagement
This video is about apache airflow dags package management. learn how we @jagex manage and operate airflow by avoiding package dependency conflicts between dags. We'll have a closer look at the problem of why its pain to install all DAGs dependencies within same airflow image, and then discuss on how to resolve this issue. KuberbetesPodOperator and DockerOperator can be used to provide isolation between workflow management and workflow execution.
Learn Something New Below:
https://maxcotec.com/blog/tha-pyay-ny...
https://maxcotec.com/blog/how-to-acti...
Timeline;