Build your own Data Cloud – QMUL
UPLOAD SLIDES
MapReduce / Hadoop on RaspberryPi
If your data is processed once, maybe not keep it in the HFDS as it is slow(?) check. HDFS (Hadoop Distributed File SYstem).
Name Nodes store the metadata
Data Nodes store data (nodes are replicated a number of times (3 usually)
In nano hadoop-2.6.0/etc/hadoop/hadoop-env.sh (configuration file)
Edit the java implementation to use.
export JAVA_HOME=${JAVA_HOME}
to
export JAVA_HOME=”/home/pi/ejdk1.8.0_33/linux_armv6_vfp_hflt/jre/” [or equiv]
edit core-site.xml
edit hdfs-site.xml
edit mapred-site.xml <--- may already be correctly edited
Yarn
– hadoop-2.6.0/etc/hadoop/yarn-site.xml