Can see only three services running up whereas Job Tracker and Tracker are not running


2 Answer(s)


I had this problem setting  up the first time. The steps to follow to ractify this is:

1. Review your JobTracker service entries in mapred-site.xml and make sure your entries are correct.

e,g      sudo vi /usr/local/hadoop/conf/mapred-site.xml
 <configuration
    <property>
    <name>mapred.job.tracker</name>
    <value>hdfs://xxx,xxx,xxx.xxx:10002</value>
    </property>
 </configuration

Note: Add the configuration to your entries.

xxx,xxx.xxx.xxx is your ipaddress which you got from  issuing ifconfig command

 

2.  Setup the DataNode and TaskTracker services

    - open the file slaves to configure slave services

    sudo vi /usr/local/hadoop/conf/slaves

    Add the ipaddress of the node where the slave services to be started

Note:

xxx,xxx.xxx.xxx

This is the only entries and should be  your ipaddress which you got from  issuing ifconfig command

 

3. This step is very important since you did the configuration once without success......

i. Delete the folder /usr/local/hadoop/hdfs (as mentioned in core-site.xml)

 ==> rm -rf /usr/local/hadoop/hdfs
ii. Recreate a folder /usr/local/hadoop/hdfs (as mentioned in core-site.xml)

    sudo mkdir /usr/local/hadoop/hdfs
4. Assign the permissions of all Hadoop folders to user "hadoop"

    sudo chown hadoop /usr/local/hadoop
    sudo chown hadoop /usr/local/hadoop/bin
    sudo chown hadoop /usr/local/hadoop/lib
    sudo chown hadoop /usr/local/hadoop/conf
    sudo chown hadoop /usr/local/hadoop/hdfs

5. Create the HDFS by formating the NameNode

    hadoop namenode -format

This will solve your problem

 

Sonnie Avenbuan


Thank you Sonnie for your response.

I figured out there is a typo in mapred-site.xml configuration file.

I used mapred.job.tacker instead of mapred.job.tracker

Now I am able to see all the five services are up and running.

Thanks & Regards,

Geetha Sangana