Data Node is not running, also when I do ./start-all.sh it says datanode running as process 5832. Stop it first



0
I am setting one node cluster on my local windows 7 machin, so I have installed cygwin and setup password less SSH also have installed hadoop, I am done with setting Java home and hadoop home,
I am able to execute hadoop command and also other like hadoop -fs or copyFromLocal

Below are the problem I am facing
1. When formating namenode $ hadoop namenode -format it is running fine but ./start-all.sh it displayed
============
narendra@narendra-PC /usr/local/hadoop-0.20.2/bin
$ ./start-all.sh
starting namenode, logging to /usr/local/hadoop-0.20.2/bin/../logs/hadoop-narendra-namenode-narendra-PC.out
localhost: datanode running as process 5832. Stop it first.
localhost: secondarynamenode running as process 3536. Stop it first.
starting jobtracker, logging to /usr/local/hadoop-0.20.2/bin/../logs/hadoop-narendra-jobtracker-narendra-PC.out
localhost: starting tasktracker, logging to /usr/local/hadoop-0.20.2/bin/../logs/hadoop-narendra-tasktracker-narendra-PC.out
=======================================

narendra@narendra-PC /usr/local/hadoop-0.20.2/bin
$ jps
9788 JobTracker
9148 NameNode
11108 Jps
=================
I am not getting daemon for TastTracker datanode and secondarynamenode
=========================
narendra@narendra-PC /usr/local/hadoop-0.20.2/bin
$ ./stop-all.sh
stopping jobtracker
localhost: no tasktracker to stop
stopping namenode
localhost: stopping datanode
localhost: /usr/local/hadoop-0.20.2/bin/hadoop-daemon.sh: line 127: kill: (5832) - No such process
localhost: stopping secondarynamenode
localhost: /usr/local/hadoop-0.20.2/bin/hadoop-daemon.sh: line 127: kill: (3536) - No such process
===================================================

narendra@narendra-PC /usr/local/hadoop-0.20.2/bin
$ hadoop-daemon.sh stop datanode
stopping datanode
/usr/local/hadoop-0.20.2/bin/hadoop-daemon.sh: line 127: kill: (5832) - No such process

6 Answer(s)


0

hi Narendra,

You can try starting these daemons individually

bin/hadoop-daemon.sh start namenode
bin/hadoop-daemon.sh start jobtracker
bin/hadoop-daemon.sh start datanode
bin/hadoop-daemon.sh start tasktracker

jps

Thanks

0

remove the portion in hdfs-site.xml of data node and namenode keep only replication part and format namenode you will get datanode up

0

Step 1:- Stop-all.sh    

Step 2:- got to this path :-

cd /usr/local/hadoop/bin

 

Step 3:- Run that command
hadoop datanode

Now DataNode work 


0

Do we run the hadoop datanode command on each datanode?

 


0

I am getting this  message although I have given access priviledges to hduser:

 

/usr/local/hadoop/sbin/start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
18/05/16 14:06:20 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-swapnila-virtual-machine.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-swapnila-virtual-machine.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-swapnila-virtual-machine.out
18/05/16 14:06:42 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn-hduser-resourcemanager-swapnila-virtual-machine.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-swapnila-virtual-machine.out
hduser@swapnila-virtual-machine:/usr/local/hadoop/bin$ jps
8772 ResourceManager
9053 Jps
8901 NodeManager
hduser@swapnila-virtual-machine:/usr/local/hadoop/bin$ /usr/local/hadoop/sbin/stop-all.sh
This script is Deprecated. Instead use stop-dfs.sh and stop-yarn.sh
18/05/16 14:09:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Stopping namenodes on [localhost]
localhost: no namenode to stop
localhost: no datanode to stop
Stopping secondary namenodes [0.0.0.0]
0.0.0.0: no secondarynamenode to stop
18/05/16 14:10:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
stopping yarn daemons
stopping resourcemanager
localhost: stopping nodemanager
no proxyserver to stop
hduser@swapnila-virtual-machine:/usr/local/hadoop/bin$ 
 

Please help


0

Hello Swapnila I am also facing the same error, were you able to resolve the issue. can you help me with the steps