Building data mesh on Databricks and Azure for a large manufacturing company
It is hard to find detailed technical recommendations for implementing Data Mesh. Thoughtworks is currently supporting a large European manufacturing company on their Data Mesh journey using a concrete technology stack: Databricks on Azure.
In this talk you will learn about concrete examples of libraries and services we used to implement Data Mesh principles. We will also share lessons and obstacles we faced, as well as things we found missing. For example, did you know
how great the support is that Unity Catalog gives you when it comes to securing your data?
that the brand-new Databricks Asset Bundles are awesome in supporting CI/CD?
that you can implement computational governance on the infrastructure side with Open Policy Agent and that you can do it using TDD and trunk-based development?
http://www.thoughtworks.com/xconf