Configure & run Elementary data test in dbt | Data Tests | DBT Tests | Data Observability | P2
In this video we are covering 🚀 Elementary Data Tests. Elementary is the DBT native observability tool! 📊✨
Say goodbye to guesswork and hello to insightful data pipeline observablility with Elementary. 🎉 Configure Elementary test just like a dbt test in the schema yaml file. Elementary tests are executed just dbt native test via "dbt test" command. 💡
With Elementary, you can:
🔍 Monitor DBT runs in real-time
📈 Track performance metrics effortlessly
🔒 Ensure data quality and integrity at every step
💬 Collaborate seamlessly with your team
Link to Elementary part 1: • Exciting new data observability tool for d...
Link to Elementary Docs: https://www.elementary-data.com/
#dbt #elementary #dataquality
Link to Channel's site:
https://hnawaz007.github.io/
--------------------------------------------------------------
💥Subscribe to our channel:
/ haqnawaz
📌 Links
-----------------------------------------
Follow me on social media!
🔗 GitHub: https://github.com/hnawaz007
📸 Instagram: / bi_insights_inc
📝 LinkedIn: / haq-nawaz
🔗 / hnawaz100
🚀 https://hnawaz007.github.io/
-----------------------------------------
Topics in this video (click to jump around):
==================================
00:00 Introduction to Elementary Data Tests
00:37 Type of Elementary Data Tests
00:53 Implementation of Volumn & Freshness Anomalies
01:15 Column Anomalies
01:28 Schema Change Tests
02:16 Run dbt tests
02:26 Generate Elementary Dahsboard & View Tests Results
Elementary Data Tets dbt configurtaion
----------------
data_tests:
elementary.volume_anomalies:
tags: ["elementary"]
elementary.freshness_anomalies:
timestamp_column: "modifieddate"
optional - use tags to run elementary data_tests on a dedicated run
tags: ["elementary"]
config:
optional - change severity
severity: warn
elementary.volume_anomalies:
anomaly_sensitivity: 2.5
elementary.dimension_anomalies:
dimensions:
stateprovinceid
tags: ["elementary"]
elementary.schema_changes:
tags: ["elementary"]
config:
severity: warn
elementary.schema_changes_from_baseline:
tags: ["elementary"]