TPCDS PySpark demo
This is a video on how to get started with TPCDS_PySpark
https://github.com/LucaCanali/Miscell... - A workload generator for Apache Spark
Links:
👉 Blog: Building an Apache Spark Performance Lab: Tools and Techniques for Spark Optimization https://db-blog.web.cern.ch/node/195
👉 sparkMeasure ➜ https://github.com/LucaCanali/sparkMe... a tool for performance troubleshooting of Apache Spark jobs.
👉 Spark-Dashboard https://github.com/cerndb/spark-dashb... ➜ A custom monitoring pipeline and dashboard for Spark
👉 Introductory course on Apache Spark ➜ https://sparktraining.web.cern.ch/
👉 CERN DB Blog ➜ https://db-blog.web.cern.ch/
👉 Luca's Home ➜ https://cern.ch/canali
Acknowledgements: A special acknowledgment goes out to the teams behind the CERN data analytics, monitoring, and web notebook services, as well as the dedicated members of the ATLAS database group.