Luca's Data Engineering

Getting started with PyLatencyMap, DTrace data

Tutorial on DataFrames with exercises

Tutorial on Spark SQL

Tutorial on Spark Machine Learning – regression task

Demo of Spark processing Physics data using CERN private Cloud resources

Session3, part3: Spark Machine Learning

Spark as a library, examples of how to use Spark in Scala and Python programs

Demo on how to run the course notebooks with CERN SWAN hosted web notebooks service

Getting started with PerfSheet.js

Getting started with PyLatencyMap, Oracle data

Session 2: Working with Spark DataFrames and SQL

Apache Spark Dashboard V1 Demo

Tutorial on Spark Streaming

SparkMeasure: Getting Started Demo Tutorial

Session 1: Apache Spark fundamentals

Demo on using SWAN with Spark on Hadoop

Session3, part2: Spark Streaming

Demo on monitoring Spark execution

PerfSheet4 v3.5, getting started

TPCDS PySpark demo

PerfSheet4 v3.7 getting started video

Session 4: Running Spark on CERN resources

Apache Spark Dashboard V2 Demo

Session3, part1: Spark as a Data Platform

Introduction and objectives