05 Batch Loading Strategy
Video explains - How to design Batch Loading Strategy for Data Lakehouse Data Loading? Also, understand to how to design Landing, Staging and DW layers to achieve fault tolerance and parallelism.
We are going to use AWS Cloud services to design the Data Lakehouse and Processing power of Spark to load & process the data.
Resources:
Ease With Data Github URL - https://github.com/subhamkharwal/ease...
DW with PySpark Github URL - https://github.com/subhamkharwal/ease...
Docker Github URL - https://github.com/subhamkharwal/dock...
Chapters:
00:00 - Design for Data Lakehouse Loading Strategy
01:36 - Difference and design consideration for Landing, Staging and DW
If you are new to Data Warehousing checkout our playlist on YouTube - • 01 Introduction
New Video will be uploaded every 3 days. Stay Tuned. Make sure to Like and Subscribe.
#datalakehouse #pyspark #deltalake #datawarehousing #dw #datawarehouse