4.4 - Preemptible Secondary Workers | Apache Spark on Dataproc | Google Cloud Series
In this video we'll see how we can use Secondary workers (specially preemptible ones) in Dataproc to speed up of workload execution without proportional increase in cost.
We'll also see what are some caveats of using Preemptible Secondary Workers and cover some additional tips on how to utilize secondary workers optimally.
The video closes with a demo of how preemptible workers can be added while creating the clusters.
This video is part of the course Apache Spark on Dataproc. You can find all the videos for this course in the following playlist.
• Apache Spark on Dataproc | Google Cloud Se...
I regularly blog and post on my other social media channels as well, so do make sure to follow me there as well.
Medium : / sushil_kumar
Linkedin : / sushilkumar93
Github : https://github.com/kaysush