A deep dive into Databrick’s Delta Lake’s Schema Management. We look into the what, the why and how at a fundamental level. Also included is a short demo to show Schema Management in action. For Data Engineers and Data Architects alike.
#databricks #dataquality #deltalake #dataengineers #dataarchitecture
Timestamps:
00:00 Intro
00:38 Objectives
01:28 Schema Enforcement
02:53 Schema Evolution
04:23 Schema Evolution Restrictions
06:53 Use Cases
09:32 How it works
11:02 Architecture Strategy
16:05 Databricks Demo
27:44 Summary