Faster ETL Pipeline with Bodo by Ahmad Khadem
Faster ETL Pipeline with Bodo: A Compiler Based Parallel Computing for Big Data Analytics
The growing scale and complexity of data and ML workloads demands enormous compute power. Bodo is a new compute platform that aims to improve efficiency and performance of ETL pipelines through automated parallelization of native Python and SQL workloads.
Bodo’s resource efficiency and extreme performance in compute heavy workloads makes ETL orders of magnitude faster and more cost effective than popular solutions based on distributed computing such as Spark, Dask and Ray.
In this talk, we’ll discuss the high level overview of Bodo, some of the performance benchmarks, and innovations we did to save more than 50% infrastructure cost and gain more than 10x performance improvements saving for our customers.
https://skillsmatter.com/skillscasts/...