Why Spark on Kubernetes
#apachespark #kubernetes #bigdata
Apache Spark can run on cluster managed by Kubernetes. Apache Spark 2.3+ provides native Kubernetes scheduler as well as google has open sourced Kubernetes operator for Spark
Here is a presentation from my latest talk on Cloud native data architecture
https://www.slideshare.net/srivatsan8...
In this video I talk about the need for Spark on kubernetes and how it can bring in efficiency in building an unified infrastructure as well as enable enterprise for faster experimentation and agility