Apache Spark with Scala [Video Course]
Apache Spark with Scala [Video Course]
https://heexe.com/blog/post/249
Create a Histogram of Real Movie Ratings with Spark!
Scala Crash Course
Scala Basics, Part 1
Scala Basics, Part 2
Flow Control in Scala
Functions in Scala
Data Structures in Scala
Spark Basics and Simple Examples
Introduction to Spark
The Resilient Distributed Dataset
Ratings Histogram Walkthrough
Spark Internals
Key/Value RDDs and the Average Friends by Age example
Running the Average Friends by Age Example
Filtering RDDs and the Minimum Temperature by Location Example
Running the Minimum Temperature Example and Modifying It for Maximum Temperature
Counting Word Occurrences Using flatmap()
Improving the Word Count Script with Regular Expressions
Sorting the Word Count Results
Finding the Total Amount Spent by Customer
Check your Results, and Sort Them by Total Amount Spent
Check Your Results and Implementation against Mine
Advanced Examples of Spark Programs
Find the Most Popular Movie
Use Broadcast Variables to Display Movie Names
Find the Most Popular Superhero in a Social Graph
Superhero Degrees of Separation – Introducing Breadth-First Search
Superhero Degrees of Separation – Accumulators and Implementing BFS in Spark
Superhero Degrees of Separation – Review the Code, and Run It!
Item-Based Collaborative Filtering in Spark, cache(), and persist()
Running the Similar Movies Script using Spark's Cluster Manager
Improve the Quality of Similar Movies
Running Spark on a Cluster
Using spark-submit to Run Spark Driver Scripts
Packaging Driver Scripts with SBT
Introducing Amazon Elastic MapReduce
Creating Similar Movies from One Million Ratings on EMR
Partitioning
Best Practices for Running on a Cluster
Troubleshooting and Managing Dependencies
SparkSQL, DataFrames, and DataSets
Introduction to SparkSQL
Using SparkSQL
Using DataFrames and DataSets
Using DataSets Instead of RDDs
Machine Learning with MLLib
Introducing MLLib
Using MLLib to Produce Movie Recommendations
Linear Regression with MLLib
Using DataFrames with MLLib
Intro to Spark Streaming
Spark Streaming Overview
Set Up a Twitter Developer Account, and Stream Tweets
Structured Streaming
Intro to GraphX
GraphX, Pregel, and breadth-first search with Pregel.
Superhero Degrees of Separation using GraphX
You Made It! Where to Go from Here?
Learning More, and Career Tips
About the Author
Frank Kane
Frank Kane spent 9 years at Amazon and IMDb, developing and managing the technology that automatically delivers product and movie recommendations to hundreds of millions of customers, all the time. Frank holds 17 issued patents in the fields of distributed computing, data mining, and machine learning. In 2012, Frank left to start his own successful company, Sundog Software, which focuses on virtual reality environment technology, and teaching others about big data analysis.