SQL Day 2025 - Evolution from Traditional Warehouse to Modern Lakehouse at Databricks - Mariusz K...
Have you ever wondered how to effectively transform a traditional data warehouse into a modern lakehouse that meets the demands of modern banking and insurance projects?
I invite you to a practical session during which you will discover how the Azure Databricks platform can revolutionize data management in your organization. This presentation is aimed at data specialists, architects, and anyone building or modernizing a data infrastructure.
We will begin by discussing the foundations of Databricks and creating a landing zone in Azure, covering key aspects of architecture and security in regulated industries. We will then move on to data integration, demonstrating the construction of an ingestion framework using Delta Live Tables (DLT) or Apache Spark—showing their practical applications and benefits.
A key focus will be the Medallion architecture and data modeling, which will allow you to understand how to design effective lakehouses using proven patterns and the Unity Catalog. I will also discuss advanced features such as data masking, security management, and data lineage, which support regulatory compliance. In the practical part, I'll share my experiences with migrating a data warehouse to Azure—you'll learn how to effectively overcome common challenges, plan the migration, and leverage AI tools to automate code transformations, or tools like Informatica Power Center or SSIS. I'll also present a variety of tools available in the Databricks ecosystem, such as dbt, DatabricksSQL, and Apache Spark, which facilitate the construction of modern data models.