Running Apache Spark on Kubernetes - Shardul Srivastava
For the DoK Day North America 2021 @ Kubecon
Playlist:
• DoK Day NA 2021
https://go.dok.community/slack
https://dok.community/
Apache Spark is one of the leading frameworks for analyzing data in realtime with Spark Structured Streaming, this session is to explain how to step by step run Spark structured streaming jobs on Kubernetes and access the Spark UI to see the jobs metrics and progress.
About Data on Kubernetes Community (DoKC)
DoKC is an independent tech community where practitioners go to run data workloads on Kubernetes. It is managed by Constantia.io. We produce a range of resources for end users looking to run DoK including:
DoK Landscape
An interactive landscape of products and services for running data workloads on Kubernetes. (https://dok.community/landscape/)
Videos and Blogs
Hundreds of videos and blogs including how tos, tutorials, use cases, case studies, and more. (https://dok.community/landscape/) (https://dok.community/blog/)
DoK Reports
DoKC works with an independent research firm to annually produce the industry’s only DoK-focused report. (https://dok.community/dok-reports/)
Livestreams and Local Meetups
Weekly livestreams on DoK-related topics including demos, tutorials, visionary talks, panels, and more. (https://www.meetup.com/data-on-kubern...)
DoK Days @ KubeCon
We host hybrid events twice a year for people to get together and learn in-person or online. Details are published on our main website. (https://dok.community/)
Connect With Us:
https://dok.community/
/ @dokcommunity
/ dokcommunity
/ data-on-kubernetes-community
https://github.com/dokc