Spark SQL Part 7 (using Scala)
This video shows how we can load information into an RDD and convert the RDD to a Dataframe to deal with files that have non-standard formats. Source code available at https://github.com/MarkCLewis/BigData.... Full playlist at • Big Data with Spark .