DP-600: Monitor and Optimize Performance in Fabric: Dataflows Gen2, Notebooks, and SQL Queries
In this video, we dive deep into key techniques to enhance performance within Microsoft Fabric.
Google classroom community:
https://classroom.google.com/c/Njk4MD...
Covering Dataflows Gen2, Notebooks, and SQL queries, you'll learn how to identify and resolve bottlenecks in data loading and query processing.
We’ll explore real-world performance improvement strategies, including staging and partitioning, along with Delta Lake optimizations like V-Order and optimized writes to tackle file structure issues. Perfect for analysts and developers, this session equips you with actionable methods to streamline workflows in Microsoft Fabric.
00:00 Module 2 - Prepare and Serve Data - Monitoring and performance optimization - Overview and Course Roadmap
02:03 Google classroom community overview
03:11 Performance Optimization Matrix overview
09:58 Monitor tool DEMO in Fabric
13:32 Dataflow Gen2 Refresh History
15:25 Fabric capacity metrics APP Walkthrough
18:56 SQL Queries: DMV’s and Query Insights
26:46 Incremental Refresh capability in Dataflow Gen2
28:37 FAST COPY in Dataflow Gen2
31:13 Staging in Dataflow Gen2
35:40 Data partitioning of Delta table files
39:06 VORDER and OPTIMIZED WRITES in Delta table Optimization
45:43 Optimizing SQL queries: Optimize joins with required Indexes
47:42 Summary
Dataflow Gen2 Optimization techniques blog links:
Incremental refresh - https://blog.fabric.microsoft.com/en-...
Staging and other performance improvements - https://blog.fabric.microsoft.com/en-...
Notebooks Optimization techniques links:
Vorder and Optimized writes for Delta tables: https://learn.microsoft.com/en-us/fab...
Data partitioning best practices: https://techcommunity.microsoft.com/t...
SQL Queries tools links:
SQL Queries Execution DMV's: https://learn.microsoft.com/en-us/sql...
#DP600 #microsoftfabric