How to use Hadoop Python Streaming?
Mapper python file:
-------------------------------
https://drive.google.com/file/d/1t0fv...
Reducer python file:
-------------------------------
https://drive.google.com/file/d/1spXZ...
Commands:
-------------------
su - hduser
hadoop fs -mkdir /input
sudo nano /home/sanket/input
hadoop fs -put /home/sanket/input /input
create folder wordcount
sudo chmod -R 777 /home/sanket/wordcount
cd /home/sanket/wordcount
mapred streaming \
-input /input/input \
-output /output \
-mapper /home/sanket/wordcount/mapper.py \
-reducer /home/sanket/wordcount/reducer.py