5 тысяч подписчиков
101 видео
15 How Spark Writes data
10 Spark Streaming Read from Kafka | Real time streaming from Kafka
03 Spark Streaming Local Environment Setup - Docker, Jupyter, PySpark and Kafka
16 DW Model - Star Schema and Snowflake Schema
12 Understand Spark UI, Read CSV Files and Read Modes | Spark InferSchema Option | Drop Malformed
05 Understand Spark Session & Create your First DataFrame | Create SparkSession object | Spark UI
21 Broadcast Variable and Accumulators in Spark | How to use Spark Broadcast Variables
14 Delta Tables Deep & Shallow Clones | Temporary & Permanent Views | List Catalog, Schemas & Tables
02 How Spark Works - Driver & Executors | How Spark divide Job in Stages | What is Shuffle in Spark
12 Spark Streaming Writing data to Multiple Sinks | foreachBatch | Writing data to JDBC(Postgres)
10 Enable Unity Catalog and Setup Metastore | How to setup Unity Catalog for Databricks Workspace
PySpark Full Course | Basic to Advanced Optimization with Spark UI PySpark Training | Spark Tutorial
22 Optimize Joins in Spark & Understand Bucketing for Faster joins |Sort Merge Join |Broad Cast Join
03 Spark Transformations & Actions | Why Spark prefers Lazy Evaluation |What are Partitions in Spark
48 Databricks GIT Folders | Configure GIT repository with Databricks using Azure DevOps Repo
01 Spark Streaming Tutorial 2025 | Spark Streaming Training | Spark Streaming with PySpark
25K Views on PySpark Zero to Hero YT Series |Ease With Data
32 Databricks Secret Management & Secret Scopes | Save secrets in Databricks |Use of Azure Key Vault
24 Fix Skewness and Spillage with Salting in Spark | Salting Technique | How to identify Skewness
13 Read Complex File Formats | Parquet | ORC | Performance benefit of Parquet |Recursive File Lookup
03 Setup Docker PySpark Jupyter Lab Environment
02 How Spark Streaming Works
25 AQE aka Adaptive Query Execution in Spark | Coalesce Shuffle Partitions | Skew Partitions Fix
05 ETL vs ELT and Data Loading Strategies
26 Spark SQL, Hints, Spark Catalog and Metastore | Hints in Spark SQL Query | SQL functions & Joins
12 Slowly Changing Dimension Type 2 (SCD 2)
34 Object Level Security or Permissions in Unity Catalog | Manage Object Privileges in Unity Catalog
18 Understand DAG, Explain Plans & Spark Shuffle with Tasks |Skipped Stage |Benefit of Shuffle Write
06 Basic Structured Transformation - Part 1 | Write Spark DataFrame Schema |Ways to write DF Columns
11 Slowly Changing Dimension Type 1 (SCD 1)
11 Data Repartitioning & PySpark Joins | Coalesce vs Repartition | Spark Data Partition | Joins
04 Spark Streaming Read from Sockets | Convert Batch Code to Streaming Code
11 Spark Streaming Triggers - Once, Processing Time & Continuous | Tune Kafka Streaming Performance
06 Lambda and Kappa Architectures | Data Processing Architectures in Big Data
39 Delta Sharing in Databricks | Databricks Express Edition | Share Data outside your Organization
14 Read, Parse or Flatten JSON data | JSON file with Schema | from_json | to_json | Multiline JSON
35 Functions in Unity Catalog using Databricks SQL | SCALAR and TABLE User Defined Functions
19 Understand and Optimize Shuffle in Spark
26 DLT aka Delta Live Tables | DLT Part 1 | Streaming Tables & Materialized Views in DLT pipeline
28 DLT Append Flow(Union) & Autoloader | Pass parameter in DLT pipeline |Generate tables dynamically
49 Databricks CLI | Install and Authenticate Databricks CLI | U2M and M2M Authentication
17 Volumes - Managed & External in Databricks | Volumes in Databricks Unity Catalog |Files in Volume
01 PySpark Tutorial | PySpark Training | Learn from Basics to Advanced Performance Optimization
50 Databricks Asset Bundles | Configure Production grade DABs | CICD using DABs (IAC)
20 Data Caching in Spark | Cache vs Persist | Spark Storage Level with Persist |Partial Data Caching
42 Streaming Tables and Materialized Views in DBSQL | Background Working | Schedule data Refresh
05 Spark Streaming Output Modes, Optimization and Background
07 Spark Streaming Read from Files | Flatten JSON data
24 Auto Loader in Databricks | AutoLoader Schema Evolution Modes | File Detection Mode in AutoLoader
17 User Defined Function (UDF) | How Spark works with UDF | How to register Python UDF
08 What is Unity Catalog and Databricks Governance | What is Metastore | Unity Catalog Object Model🔥
