40 - Spark RDD Transformations - map() using reduce() - Code Demo 3
@backstreetbrogrammer
--------------------------------------------------------------------------------
Chapter 07 - Spark RDD Transformations - map() using reduce() - Code Demo 3
--------------------------------------------------------------------------------
Transformation: map(func)
Return a new distributed dataset formed by passing each element of the source through a function func.
As RDDs are immutable, after applying the map transformation, new RDD is created.
The func is applied to each element, mapping it into a new element (the word mapping is used because it has a meaning similar to transforming but with the nuance of “creating a new version of” rather than “modifying”).
Example:
final var myList = myRdd.map(String::length).collect();
final var count = myRdd.map(String::length).count();
final var count = myRdd.map(String::length).map(v -: 1L).reduce(Long::sum);
Github: https://github.com/backstreetbrogramm...
Apache Spark for Java Developers Playlist: • Apache Spark for Java Developers
Top Java Coding Interview Problems Playlist: • Top Java Coding Interview Problems
Java Serialization Playlist: • Java Serialization
Dynamic Programming Playlist: • Dynamic Programming
#java #javadevelopers #javaprogramming #apachespark #spark