Intro to Big Data Analytics with PySpark
This workshop was held on the 30th of May and goes through the fundamentals and few advanced techniques of PySpark.
Codes with regards to the workshop can be found on Google Colab: https://colab.research.google.com/dri...
Timestamp:
1:35 Introduction to Pyspark
3:04 Starting with Pyspark
10:16 Changing data types and renaming columns
19:55 Filtering data
25:00 Groupbys
27:36 Joins
34:00 Tempviews
36:00 Advanced features
41:30 Outro