Since Apache Spark 3.1 release in March 2021, Spark's integration with Kubernetes as a scheduler (instead of YARN) is now officially Generally Available!
We'll present the pros & cons of running Spark on k8s, the features of the latest release, and give concrete tips to make you successful with it.
DataLove 2021: https://emamo.com/event/data-love-con...