Manipulating Spark's dataframe nested schemas - DataFriday 1x07
In this episode, I will look at two labs using Apache Spark, Java, the Spark's dataframes, and schemas. I am digging into manipulation of schemas, including nested schemas coming from JSON files.
I am continuing on Spark in Action, 2nd edition (http://jgp.net/sia)'s chapter 3's examples. I am detailing lab #210 and #220. Lab #200 was covered on DataFriday Episode 5 ( • Manipulating the schemas of Spark datafram... ).
Repository: https://github.com/jgperrin/net.jgp.b...
Lab: #210
GitHub link: https://github.com/jgperrin/net.jgp.b...
Lab: #220
GitHub link: https://github.com/jgperrin/net.jgp.b...
Check out my blog at http://jgp.net. This video and others are (or will shortly) be detailed there.
This event is supported by La French Tech Raleigh-Research Triangle ( / frenchtechraleigh .
#DataFriday