Hadoop Installation



0
I am having few issues with hadoop installation.
when I type the command "jps" it's displaying only jps no other daemons are displayed.

And also when I type hadoop fs -ls , no files are displayed. Please help me on this.

19 Answer(s)


0

hi Venkata,

Looks like there are no hadoop daemons that are turned on in your system. By default the services will be started in cloudera but if you are looking to start daemons in Ubuntu, you need to start them manually by using

cd hadoop/bin
./start-all.sh

Thanks

0

Thank you for your response.
When I am firing the command "cd hadoop/bin", I am getting the "No such file or directory exists".

0

hi Venkata,

Can you be more precise if you are using a cloudera VM or installed Hadoop on Ubuntu. This will help us give the proper answer to the issues that you are facing.

Thanks

0

Hi

I am using cloudera VM on Windows mechine.

Thanks,

0

I have tried all the version. Nothing is working in my machine. Please help me on this.

0

hi Venkata,

If you are using cloudera then issuing "jps" will not show namenode, jobtracker etc as all these services will be internally started by the cloudera-scm-daemons.

to verify if service are running, please open a terminal and execute the following

hadoop dfs -ls
hadoop dfs -mkdir dezyre

(if the above two commands work then you are all set)

Let us know in case of further issues.

0

When I use that command it's giving me the error - Deprecated Error.

0

and also command hadoop dfs -ls was deprecated ... I am trying to hdfs dfs -ls .. still not working.

0

Please provide dezyre India contact number (Technical Support) for clarifying the questions.

0

hi Venkata,

What is the error you are getting when you execute "hdfs dfs -ls". It would be difficult to answer without complete information. "hadoop dfs" is deprecated but will work without issues.

Thanks

0

Hi,

[cloudera@localhost ~]$ hdfs dfs -ls
Found 1 items
drwxr-xr-x - cloudera cloudera 0 2014-08-21 20:18 dezyre

[cloudera@localhost ~]$ hadoop dfs -ls
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Found 1 items
drwxr-xr-x - cloudera cloudera 0 2014-08-21 20:18 dezyre


[cloudera@localhost ~]$ jps
9783 Jps
[cloudera@localhost ~]$

Not seeing any daemons jobs here.

1

You need to fire 'sudo jps'
Daemons run with root mode.

0

Fire 'hadoop fs -ls' command

0

I got it now.Now I am able to see all daemons using "sudo jps".

Now I am having another problem. when I am trying to create a dezyre directory using "hadoop fs -mkdir /dezyre",It's displaying that
[cloudera@localhost ~]$ hadoop fs -mkdir /dezyre
mkdir: Permission denied: user=cloudera, access=WRITE, inode="/":hdfs:supergroup:drwxr-xr-x

If I use "hadoop fs -mkdir dezyre",
It's displaying that dezyre already exists.Can you please tell me what is the full path of dezyre directory.
[cloudera@localhost ~]$ hadoop fs -mkdir dezyre
mkdir: `dezyre': File exists

please help me.

0

Hi Venkata

As you are using CDH4.
Please prepend all commands with directory '/user/cloudera/' with every hadoop directory.

'hadoop fs -mkdir /dezyre'
Should be replaced as 'hadoop fs -mkdir /user/cloudera/dezyre' or 'hadoop fs -mkdir dezyre'

'hadoop fs -mkdir dezyre' giving you error as

[cloudera@localhost ~]$ hadoop fs -mkdir dezyre
mkdir: `dezyre': File exists

Which means directory already there

Try
'hadoop fs -mkdir dezyre1' or 'hadoop fs -mkdir /user/cloudera/dezyre1'
Which will create 'dezyre1' directory

'hadoop fs -ls /user/cloudera' or 'hadoop fs -ls '
will give you listing of the hdfs home directory i.e. '/user/cloudera'

Where you can find 'dezyre' and 'dezyre1' directory

Follow this video too - https://dezyre-1.wistia.com/medias/inipbzuhbe




0

yes I am using CDH4. I am good now. Thanks

0

I had different question, Hadoop mainly using for analysing the data , how can I build reports with that data?

Do we have any tool for reporting in Hadoop?

0

MapReduce Framework to process data in Hadoop.
Hive, Pig are high level query language framework can be used to generate reports.

0

Can I generate Graphical Representation Reports by using with those tools or do we need to use STROM OR SPARK frameworks?

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password