Apache Spark Structured Streaming, watermark and window processing

Apache Flink and temporal table joinb

Delta Lake and the orphan files

Delta Lake and the VACUUM command

Delta Lake, commits and conflicts management

Master stream processing - Stateful stream processing module

Master stream processing - Data cleansing module

Master stream processing - Data ingestion online module

Master stream processing - Stream processing module

Module 2: Data ingestion offline - plan

Lesson 11: Data processing - distributed

Lesson 12: Data terms

Lesson 10: Data processing - standalone

Lesson 09: Data stores

Lesson 06: Stream processing

Lesson 05: Batch processing

Lesson 07: Data architectures

Lesson 08: Data organization

Lesson 04: Data pipelines

Lesson 03: Who is a data engineer?

Lesson 02: Data engineering and archeology

Lesson 01: Plan

PySpark and serializers

JIT compilation and Apache Spark SQL

Wildcard path and partition values in Apache Spark SQL