PySpark Tutorial 02 | Spark Architecture & Cluster Management | Data Engineering
email: [email protected]
------------------------
Module 2: Spark Architecture & Cluster Management
Spark in-depth architecture & components
Cluster Managers: Standalone, YARN, Kubernetes
Driver vs Worker in spark application
What are the jobs of driver in spark
Deployment modes of Spark applications
Internals of Spark job execution across cluster
Spark-Submit utility
Key Parts of spark-submit
Resource allocation case studies (nodes, cores, RAM)