Keshav- Learn !T - Self

Azure Data Factory | Loop through multiple files in ADLS Container | Lookup & ForEach Activities

#3 Joins in PySpark | Semi & Anti Joins | Join Data Frames in PySpark

#1 Spark Architecture | PySpark | Azure Databricks | Spark Cluster | Cluster Nodes

Load Data From Azure SQL Database To Table Storage & Cosmos DB | SQL Storage To No-SQL Storage

Create Custom Visuals in Power BI with Python

Configure Azure Data Factory Pipeline | Drive ADF Pipeline with SQL Table| Load data dynamically

#4 Transform Data in Databricks with PySpark | Transform with PySpark | ADLS To Databricks

Decomposition Tree In Power BI

map() vs flatMap() In PySpark | PySpark

Convert DataFrame Columns Into Dictionary (Map) | create_map() | Columns to Dictionary

SQL to Azure Table Storage & Cosmos DB | SQL Storage To No-SQL Storage

Azure Data Factory | Load Data from On-Prem SQL Server to Azure SQL Server

Convert DataFrame Column values to List | PySpark

Loop through Folders & Files | Iterate through Folders | Execute one Pipeline in other pipeline

If Condition Activity in Azure Data Factory | If Condition in ADF

Map() Transformation in PySpark | PySpark | Lambda function

Define DataType for Keys and Values in Python Ditionary | MapType()

Handle SCD Type-2 Data loads with ADF | SCD Type 2 , 1, 0 Data loads with ADF

#8 Handling Bad Data In Databricks | Handling Error Rows | Error Handling in Databricks

Nested If in ADF | If Condition in ADF | Nested Condition

End to End Data Migration ETL Framework with Azure Data Factory & T SQL

Machine Learning In Power BI | Python | Power BI

Joins In Azure Data Factory | Join Transformation in ADF

Dynamic Goal To Gauge Visual | Create Calculated Table in Power BI

Content MD5 | File Ingestion Framework | Identify data changes in File

Create Dynamic Dataframes in PySpark

Re-direct Error Rows In ADF | Error Handling in ADF | Handling Error Rows | ADF

RDD #3: All About Pair RDDs in Spark | Pair RDD | flatMap() Vs map()

Data Reconciliation | Counts, Measures, Values Reconciliation | Data Recon

#9 UDFs in PySpark | Convert Functions to UDF in PySpark | Register UDFs to Spark SQL

Merge multiple part files with ADF / Merge partition files / merge multiple files into a single file

Shape Map in Power BI

Create Dynamic DataFrame | Exec Method | Dynamic DataFrame

Partition in Cosmos DB

Invoke Logic Apps in ADF | Trigger Logic App | Send Mail Notification With Logic Apps

#6 Create Mount Point To Azure Blob Storage In Databricks | Mount Blob | Blob to Azure Databricks

Collect_Set Vs Collect_List | PySpark

Pivot Transformation in ADF | Rows to Columns in ADF | Transpose data in ADF

Azure Data Factory | Data Load From Azure SQL Database to Azure Data Lake Storage Gen 2

Custom Logging in ADF | Audit log For ADF | Dynamic table load with ADF

#2 Different ways of creating Data Frame in PySpark | Data Frame in PySpark

Azure Data Factory | Loop through multiple files in ADLS Container | Lookup & ForEach Activities

#7 Mount ADLS Gen2 To Databricks | Create Mount Point to ADLS Gen2 |

Power BI Streaming Dataset

Load Fact Table with ADF | Lookup into dimension & Populate Fact with Dimension Key | Fact Data Load

ForEach & Lookup Activities in ADF | Loop through multiple inputs with ForEach Activity | ADF

Dimension Load with ADF | Genarate Hash Key as Unique Row Identifier with Sha1 & Sha2 in ADF

Dynamic YTD, QTD & MTD In Power BI

Top 5 Products Per Country Region With DAX In Power BI

Time To Live (TTL) In Cosmos DB

Set up GitHub Code Repository to ADF | GitHub as Source Controle | Save In Complete ADF Pipeline