Run Spark Applications As A Service In Large Scale On Kubernetes
More and more people are running Apache Spark on Kubernetes due to the popularity of Kubernetes. There are a lot of challenges since Spark was not originally designed for Kubernetes, for example, easily submitting/managing applications, accessing Spark UI, allocating resource queues based on cpu/memory, and etc.
This talk will present how to address these challenges and provide Spark As Service in a large scale.