66 - Spark RDD - Left Outer Joins - Code Demo 3
@backstreetbrogrammer
--------------------------------------------------------------------------------
Chapter 13 - Spark RDD - Left Outer Joins - Code Demo 3
--------------------------------------------------------------------------------
Transformation: join(otherDataset, [numPartitions])
When called on datasets of type (K, V) and (K, W), returns a dataset of (K, (V, W)) pairs with all pairs of elements for each key.
Outer joins are supported through leftOuterJoin(), rightOuterJoin(), and fullOuterJoin().
Inner join
Joins two RDDs based on a common field K, and selects records that have matching values in these fields
Left Outer join
Joins two RDDs based on a common field K, and selects records that have matching values in these fields and remaining rows from the left RDD.
Right Outer join
Joins two RDDs based on a common field K, and selects records that have matching values in these fields and remaining rows from the right RDD.
Full Outer join
Joins two RDDs based on a common field K, and selects records that have matching values in these fields and remaining rows from both of the RDDs.
Cartesian
Transformation: cartesian(otherDataset)
When called on datasets of types T and U, returns a dataset of (T, U) pairs (all pairs of elements).
Github: https://github.com/backstreetbrogramm...
Apache Spark for Java Developers Playlist: • Apache Spark for Java Developers
Top Java Coding Interview Problems Playlist: • Top Java Coding Interview Problems
Java Serialization Playlist: • Java Serialization
Dynamic Programming Playlist: • Dynamic Programming
#java #javadevelopers #javaprogramming #apachespark #spark