Working with Big Data - Part 2 | Apache Spark Installation and Config in Azure Linux VM
In this video to start working with Big Data Apache Spark, I'll show you how to download the latest version of Apache Spark in Azure Linux Virtual Machine running in Azure Cloud. We will also configure Apache Spark to the same VM.
This video is a part of the "Working with Big Data in Apache Spark" series.
=======================================================
Apache Spark Installation Script as discussed in the video tutorial.
=======================================================
sudo apt update
sudo apt upgrade
-----------------
Install Java
-----------------
sudo add-apt-repository ppa:webupd8team/java
sudo apt update
sudo apt install oracle-java8-installer
---------------------
Install Apache Spark
---------------------
wget https://www-eu.apache.org/dist/spark/...
tar -xzf spark-2.4.0-bin-hadoop2.7.tgz
sudo mv spark-2.4.0-bin-hadoop2.7.tgz /opt/spark
export SPARK_HOME=/opt/spark
export PATH=$SPARK_HOME/bin:$PATH
source ~/.bashrc
spark-shell
------ Script ------
What is Linux Ubuntu?
Ubuntu is an open-source (Linux distribution) software operating system that runs from the desktop
What is Apache Spark?:
Apache Spark is a unified analytics engine for big data processing, with built-in modules for streaming, SQL, machine learning and graph processing
What Azure VM?
Azure Virtual Machines are image service instances that provide on-demand and scalable computing resources with usage-based pricing. More broadly, a virtual machine behaves like a server: it is a computer within a computer that provides the user the same experience they would have on the host operating system itself.
💡 Want to learn more?
Watch our following video series.
🔵 Azure ML Studio: http://bit.ly/33XbWI1
🔵 Apache Spark Tutorial :http://bit.ly/2qsZT7y
🔵 Power BI for Professionals: http://bit.ly/PBIProSeries
🔵 Azure Cloud Fundamentals:http://bit.ly/AzureCloudFundamentals
Website : http://algoticsacademy.com
Facebook : / algoticsacademy
Twitter : / algotics
Instagram : / algotics
SUBSCRIBE to learn more about AI, ML, Big Data and BI. 🔔
#Algotics #AlgoticsAcademy #KnwoledgeIsLife