SparkMeasure: Getting Started Demo Tutorial
👉 sparkMeasure ➜ https://github.com/LucaCanali/sparkMe... - a tool for performance troubleshooting of Apache Spark jobs.
Links:
👉 Blog: Building an Apache Spark Performance Lab: Tools and Techniques for Spark Optimization https://db-blog.web.cern.ch/node/195
👉 Spark-Dashboard https://github.com/cerndb/spark-dashb... ➜ A custom monitoring pipeline and dashboard for Spark
👉TPCDS PySpark https://github.com/LucaCanali/Miscell... ➜ A workload generator, you can use it to run TPCDS with PySpark, instrumented with sparkMeasure
👉 Introductory course on Apache Spark ➜ https://sparktraining.web.cern.ch/
👉 CERN DB Blog ➜ https://db-blog.web.cern.ch/
👉 Luca's Home ➜ https://cern.ch/canali
Acknowledgements: A special acknowledgment goes out to the teams behind the CERN data analytics, monitoring, and web notebook services, as well as the dedicated members of the ATLAS database group.