I m getting error when I run streaming job. Please help.



0
[cloudera@localhost hadoop]$ bin/hadoop jar  /usr/lib/hadoop-0.20-mapreduce/contrib/streaming/hadoop-streaming-2.0.0-mr1-cdh4.4.0.jar  -file /home/cloudera/class3/streaming/mapper.py    -mapper "python /home/cloudera/class3/streaming/mapper.py" -file /home/cloudera/class3/streaming/reducer.py  -reducer "python /home/cloudera/class3/streaming/reducer.py"  -input /user/cloudera/class3/wcinput  -output /user/cloudera/class3/wc-streamingoutput
packageJobJar: [/home/cloudera/class3/streaming/mapper.py, /home/cloudera/class3/streaming/reducer.py, /tmp/hadoop-cloudera/hadoop-unjar4337036276284335093/] [] /tmp/streamjob1147963605406372966.jar tmpDir=null
18/05/03 02:23:12 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
18/05/03 02:23:13 INFO mapred.FileInputFormat: Total input paths to process : 2
18/05/03 02:23:13 INFO streaming.StreamJob: getLocalDirs(): [/tmp/hadoop-cloudera/mapred/local]
18/05/03 02:23:13 INFO streaming.StreamJob: Running job: job_201804280912_0031
18/05/03 02:23:13 INFO streaming.StreamJob: To kill this job, run:
18/05/03 02:23:13 INFO streaming.StreamJob: UNDEF/bin/hadoop job  -Dmapred.job.tracker=localhost.localdomain:8021 -kill job_201804280912_0031
18/05/03 02:23:14 INFO streaming.StreamJob: Tracking URL: http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201804280912_0031
18/05/03 02:23:15 INFO streaming.StreamJob:  map 0%  reduce 0%
18/05/03 02:24:00 INFO streaming.StreamJob:  map 100%  reduce 0%
18/05/03 02:25:01 INFO streaming.StreamJob:  map 100%  reduce 100%
18/05/03 02:25:01 INFO streaming.StreamJob: To kill this job, run:
18/05/03 02:25:01 INFO streaming.StreamJob: UNDEF/bin/hadoop job  -Dmapred.job.tracker=localhost.localdomain:8021 -kill job_201804280912_0031
18/05/03 02:25:01 INFO streaming.StreamJob: Tracking URL: http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201804280912_0031
18/05/03 02:25:01 ERROR streaming.StreamJob: Job not successful. Error: NA
18/05/03 02:25:01 INFO streaming.StreamJob: killJob...
Streaming Command Failed!

 


1 Answer(s)

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password