Databricks - Slowly Changing Dimension Type 2 (PySpark version)
In this video we see how to apply slowly changing dimension of type 2 in Databricks using PySpark only.
You can find the Databricks Notebooks here:
https://github.com/apostolos1927/SCD2...
Follow me on social media:
LinkedIn: www.linkedin.com/in/apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/
00:00 - Intro
01:20 - SCD2 code walk through