install hadoop single node in ubuntu 16.04
install ssh server:
$ sudo apt-get install openssh-server
$ ssh-keygen -t rsa
$ ssh-copy-id -i ~/.ssh/id_rsa.pub ubuntu@master
$ chmod 0600 ~/.ssh/authorized_keys
#########
install java:
$ sudo apt-get install default-jre
$ sudo apt-get install default-jdk
#########
ip address of master and slaves write in the /etc/hosts via:
$ sudo gedit /etc/hosts
#########
*Download hadoop From
http://www-eu.apache.org/dist/hadoop/...
-extract it:
$ sudo tar -xvf hadoop-2.8.1.tar.gz
#########
give it permission via:
$ sudo chown ubuntu:root /usr/local/hadoop-2.8.1
$ sudo chmod 777 /usr/local/hadoop-2.8.1/*
*create hadoop_tmp/hdfs :
$ sudo mkdir -p /usr/local/hadoop_tmp/hdfs
and then give it permission via:
$ sudo chown ubunt:root /usr/local/hadoop_tmp
*give privlliges:
$ sudo chmod 777 /usr/local/hadoop_tmp/*
#########
-Update bashrc file via:
$ sudo gedit .bashrc
type:
-- HADOOP ENVIRONMENT VARIABLES START -- #
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
export HADOOP_HOME=/usr/local/hadoop-2.8.1
export PATH=$PATH:$HADOOP_HOME/bin
export PATH=$PATH:$HADOOP_HOME/sbin
export HADOOP_MAPRED_HOME=$HADOOP_HOME
export HADOOP_COMMON_HOME=$HADOOP_HOME
export HADOOP_HDFS_HOME=$HADOOP_HOME
export YARN_HOME=$HADOOP_HOME
export HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME/lib/native
export HADOOP_OPTS="-Djava.library.path=$HADOOP_HOME/lib"
-- HADOOP ENVIRONMENT VARIABLES END -- #
#########
Configuration fi;es:
hadoop-env.sh
core-site.sh
hdfs-site.sh
yarn-site.sh
############################################3
that we have 2 file that will be modyfied
slaves
master
##########################################3
*Format Namenode in hadoop-2.8.1:
$ bin/hadoop namenode -format
#######################################3
Start all Hadoop daemons:
$ sbin/start-all.sh
if told u that stop it first u must stop it via:
$ sbin/stop-all.sh
and then start it again
#######################################33
*Last thing to grantee you work is done correctly fire jps:
$ jps
##########################
then open the namenode site:
localhost:50070
and the yarn site:
localhost:8088
_________________________________
please like and subscribe.
we are ready for any questions!!