End-to-End Postgres to Data Lake Data Processing Pipeline with Apache Spark, Airflow, and Minio!
In this video, I'll show you a pipeline that collects a table from Postgres, processes it using Spark, then drops it in a local Minio object storage bucket to simulate a data lake!