Apache Spark Masterclass - Resource Manager

Опубликовано: 08 Октябрь 2024
на канале: Gigahex
365
8

This video, provides an overview of Spark's Standalone resource manager. The standalone resource manager has its own implementation of master and workers for managing the resources in the cluster, but at the same time it also provides abstractions to leverage other resource managers like Hadoop YARN, Mesos and Kubernetes.

Slides - https://www.slideshare.net/ShadAmez/s...

Video index
0:03 - About myself
1:38 - Takeaways
2:50 - Overview of Distributed systems
5:40 - Introduction to Apache Spark
8:53 - Spark's Standalone Infrastructure
18:22 - Anatomy of a Spark application
25:00 - Quick Demo
33:45 - What's next ?

The above video is the recorded version of the live webinar, that was hosted as part of the Apache Spark Masterclass Meetup. Do join the meetup - https://www.meetup.com/Apache-Spark-M...