Hadoop 2.7 installation on Ubuntu 14.04 (Single Node)

Hadoop installation on Ubuntu

Installation Ubuntu on virtual machine

Here I am showing hadoop installation Ubuntu using VM player. Here is the vm setting of ubuntu

vm player settings

VM memory should be 25% – 35% of hosting machine.

Prerequisites

Before starting installation lets update all applications of software.

Installing Java

if java is not installed, then use following command for installing java

Or use ubuntu software center for installing jdk 6 or 7. Now check is it installed correctly

java-version

Adding a dedicated Hadoop system user

Installing SSH

Generate an SSH key for the hduser user

Here P “” indicates an empty password. Now needs to enable SSH access to local machine with this newly created key.

Test ssh

ssh-test

Disabling IPv6

We need to disable IPv6 because Ubuntu is using 0.0.0.0 IP for different Hadoop configurations. To do that open /etc/sysctl.conf file by gedit or nano and add following 3 lines at the end

Need to reboot system to get this effect.

Install Hadoop

The following files are needed to update single node Hadoop cluster

  1. core-site.xml
  2. mapred-site.xml
  3. hdfs-site.xml
  4. Update $HOME/.bashrc
  5. hadoop-env.sh

1.core-site.xml

The /usr/local/hadoop/etc/hadoop/core-site.xml file contains configuration properties which is used by Hadoop. Need to add following property to this file

Now lets create the directory and set the required ownership and permissions

2. mapred-site.xml

By default, the /usr/local/hadoop/etc/hadoop/ folder contains
mapred-site.xml.template and need to rename as mapred-site.xml and enter following content

3. hdfs-site.xml

Here we will specify namenode and datanode directories, to do that we need to create folders

to add properties we can use vi or nano,

4. Update $HOME/.bashrc

nano-bash

add following values at the end of file

5.hadoop-env.sh

Set JAVA_HOME by modifying /usr/local/hadoop/etc/hadoop/hadoop-env.sh file.

Formatting the HDFS filesystem

Switch to hduser

swithc-user

Format command:

Start Hadoop

start-hadoop

Hadoop Web Interfaces

http://localhost:50070/

web

Stop Hadoop

Enjoy!!! big data!!!

Leave a Reply

Your email address will not be published. Required fields are marked *