Defining data pipelines workflows using Apache Airflow - Juan Riaza
Apache Airflow is a workflow automation and scheduling system that can be used to author and manage data pipelines. Workflows are defined programmatically as directed acyclic graphs (DAG) of tasks, written in Python. At Idealista we use it on a daily basis for data ingestion pipelines. We’ll do a thorough review about managing dependencies, handling retries, alerting, etc. and all the drawbacks.
-------------
Todos los vídeos de Codemotion 2018 en: • Codemotion 2018
¡Conoce Autentia!
Twitter: https://goo.gl/MU5pUQ
Instagram: https://lk.autentia.com/instagram
LinkedIn: https://goo.gl/2On7Fj/
Facebook: https://goo.gl/o8HrWX