Introduction to monitoring your workflows and jobs in Databricks
In this video we see how to monitor your Databricks workflows and Jobs using a custom solution. We store the job run metadata into a table so later we can query this table and get all the useful information about a job run.
You can find the Databricks Notebooks here:
https://github.com/apostolos1927/Data...
Follow me on social media:
LinkedIn: www.linkedin.com/in/apostolos-athanasiou-9a0baa119
GitHub: https://github.com/apostolos1927/
00:00 - Intro
01:00 - How to monitor your Databricks Jobs (code)