Dynamic Partition Pruning | Spark Performance Tuning
This video is part of the Spark learning Series. Spark 3 has added a lot of good optimizations. Dynamic partition pruning is one of them. So As part of this video, we are covering the following
What is Static Pruning in Apache Spark
What is Dynamic partition Pruning
How Spark's performance is impacted by Dynamic Partition Pruning
Here are a few Links useful for you
Git Repo: https://github.com/harjeet88/
Spark Interview Questions: • Spark Interview Questions
If you are interested to join our community. Please join the following groups
Telegram: http://t.me/bigdata_hkr
Whatsapp: https://chat.whatsapp.com/KKUmcOGNiix...
You can drop me an email for any queries at
[email protected]
#apachespark #sparktutorial #bigdata
#spark #hadoop #spark3