hadoop instllation



0

Hi Karan,

As discussed in class, after starting the deamons not getting data/name nodes in jps.

PFA, the core-site.xml, hdfs-site.xml and error logs as asked.

 



3 Answer(s)


0

Not sure about whitespaces in core-site.xml, hdfs-site.xml . So just for safeside maybe you can try removing whitespaces

For example

<name> fs.default.name</name>
<value> hdfs://localhost:9000 </value>

can be changed to:

<name>fs.default.name</name>

<value>hdfs://localhost:9000</value>

And similarly to all whitespace between tag values

 


0

Also I read that before starting hadoop services for the first time,  namenode needs to be formated using the command

hadoop namenode -format  

 


0

Hi Pranjaly,

As @Kumaran suggested, you need to format the namenode before starting the services once.

You also need to configure mapred-site.xml file with the following configuration:

<configuration>
 <property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
 </property>
</configuration>

Configure yarn-site.xml for addition functionality:

<configuration>
 <property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce_shuffle</value>
 </property>
 <property>
  <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
  <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

After above configuration, format the namenode:

hadoop namenode -format

Hope this helps.