Queies during single node installation


5 Answer(s)


hi Saurabh, here are the answers

1) Tera* suite programs were created by Yahoo to stress test your Hadoop cluster . this suite contains TeraGen, TeraSort, TeraValidate.

TeraSort is used to generate 1000 random strings from your provided command, more info here https://hadoop.apache.org/docs/r1.0.4/api/org/apache/hadoop/examples/terasort/TeraGen.html

2) Port no 9000 is the RPC port where slave nodes talk to NameNode, port 50030 is where the webserver is running

3) Try executing "hadoop fs -ls " as you have appended everything till hadoop/bin to $PATH. also make sure to execute bashrc like below

source .bashrc

Thanks

-Support


Thanks for the info. However, 3rd point is not working even now.

Also, do I need to start services everytime I restart my VM, as I observed hadoop commands and webserver are not working when I switched on my VM today. All the configuration files are same.

It resolved once services are started. Suggest what needs to be done to make it permanent.

 


Also, I am getting following warning every time I execute bin/hadoop command -

[root@base hadoop-1.2.1]# bin/hadoop fs -ls
Warning: $HADOOP_HOME is deprecated.

 


hi Saurabh,

Looks like you are using Hadoop version 2.x. In Hadoop 2.x the older "hadoop" command is deprecated with the new "hdfs dfs" command. This is just a warning and the command will be removed in coming versions soon.

Coming to your questions on services , you have not provided whether you are using Cloudera VM or you have installed hadoop by yourself.

Thanks

-Support


I have installed haddop from scratch.