12 - Apache Spark and Hadoop installation
@backstreetbrogrammer
--------------------------------------------------------------------------------
Chapter 02 - Apache Spark and Hadoop installation
--------------------------------------------------------------------------------
1) Download Apache Spark version 3.3.1 from spark official site: https://spark.apache.org/downloads.html
2) Download Spark zipped file spark-3.3.1-bin-hadoop3.tgz: https://www.apache.org/dyn/closer.lua...
3) Unzip the file to local folder: tar -zxvf spark-3.3.1-bin-hadoop3.tgz
4) Set SPARK_HOME environment variable to |downloaded folder|\spark-3.3.1-bin-hadoop3
5) Set HADOOP_HOME environment variable to |downloaded folder|\spark-3.3.1-bin-hadoop3
6) Add to the PATH environment, the %SPARK_HOME%\bin
7) Add to the PATH environment, the %HADOOP_HOME%\bin
8) Download winutils.exe and hadoop.dll (only for Windows): https://github.com/cdarlint/winutils/...
https://github.com/cdarlint/winutils/...
9) Place both the files in local %SPARK_HOME%\bin folder.
Github: https://github.com/backstreetbrogramm...
Apache Spark for Java Developers Playlist: • Apache Spark for Java Developers
Java Serialization Playlist: • Java Serialization
Dynamic Programming Playlist: • Dynamic Programming
#java #javadevelopers #javaprogramming #apachespark #spark