The Evolution of Data Catalogs and Why They Matter
Dagster's integrated approach to data cataloging improves developer experience and enhances data governance and discovery, creating a win-win for technical teams and business users alike.
Alex Noonan, Developer Advocate at Dagster Labs, walks us through the history of data catalogs, the unfulfilled promise of stand-alone data catalogs, and the differentiated approach Dagster takes by integrating metadata tracking and lineage as part of the pipeline definition.
00:00 Intro
00:36 What is a Data Catalog?
01:38 A Quick History of Data Catalogs
07:22 The Unfulfilled Promise
12:59 Dagster's Integrated Approach
15:58 Catalog Demo
21:56 Q&A