Apache Spark shuffle writers: SortShuffleWriter

Apache Flink and temporal table joinb

Delta Lake and the orphan files

Delta Lake and the VACUUM command

Delta Lake, commits and conflicts management

Master stream processing - Stateful stream processing module

Master stream processing - Data cleansing module

Master stream processing - Data ingestion online module

Master stream processing - Stream processing module

Module 2: Data ingestion offline - plan

Lesson 11: Data processing - distributed

Lesson 12: Data terms

Lesson 10: Data processing - standalone

Lesson 09: Data stores

Lesson 06: Stream processing

Lesson 05: Batch processing

Lesson 07: Data architectures

Lesson 08: Data organization

Lesson 04: Data pipelines

Lesson 03: Who is a data engineer?

Lesson 02: Data engineering and archeology

Lesson 01: Plan

PySpark and serializers

JIT compilation and Apache Spark SQL

Wildcard path and partition values in Apache Spark SQL