Apache Spark Architecture with Spark Context Driver and Executor
In this video I talk about how spark works and what is happening when you execute a job.
We look into the Spark Driver program Spark Executors and Tasks. How Spark schedules tasks and how tasks are executed on the executors.
This is a short clip of episode #100.
►Learn Data Engineering with my Data Engineering Academy:
https://learndataengineering.com
Check out my free 100+ pages data engineering cookbook on GitHub:
https://github.com/andkret/Cookbook
Please SUPPORT WHAT YOU LIKE:
As an Amazon Associate I earn from qualifying purchases from Amazon. Just use this link:
https://www.amazon.com/shop/plumberso...
#ApacheSpark #DataEngineering #PlumbersofDataScience #bigdata