1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com

Java Heap Space issue on running wordcount M/R program



0
While I tried to run the wordcount (hadoop 1.2.1) I am getting the Java Heap Space error. I have pasted the log below. Can you please help?

=======================================================================
hduser@ubuntu:/usr/local/hadoop$ ./bin/hadoop jar hadoop-examples-1.2.1.jar wordcount /input/wc /output1
Warning: $HADOOP_HOME is deprecated.

14/06/25 21:37:16 INFO input.FileInputFormat: Total input paths to process : 1
14/06/25 21:37:16 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/06/25 21:37:16 WARN snappy.LoadSnappy: Snappy native library not loaded
14/06/25 21:37:17 INFO mapred.JobClient: Running job: job_201406252127_0002
14/06/25 21:37:18 INFO mapred.JobClient: map 0% reduce 0%
14/06/25 21:37:30 INFO mapred.JobClient: Task Id : attempt_201406252127_0002_m_000000_0, Status : FAILED
Error: Java heap space
14/06/25 21:37:33 INFO mapred.JobClient: Task Id : attempt_201406252127_0002_m_000000_1, Status : FAILED
Error: Java heap space
14/06/25 21:37:36 INFO mapred.JobClient: Task Id : attempt_201406252127_0002_m_000000_2, Status : FAILED
Error: Java heap space
14/06/25 21:37:40 INFO mapred.JobClient: Job complete: job_201406252127_0002
14/06/25 21:37:40 INFO mapred.JobClient: Counters: 7
14/06/25 21:37:40 INFO mapred.JobClient: Job Counters
14/06/25 21:37:40 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=11722
14/06/25 21:37:40 INFO mapred.JobClient: Total time spent by all reduces waiting after reserving slots (ms)=0
14/06/25 21:37:40 INFO mapred.JobClient: Total time spent by all maps waiting after reserving slots (ms)=0
14/06/25 21:37:40 INFO mapred.JobClient: Launched map tasks=4
14/06/25 21:37:40 INFO mapred.JobClient: Data-local map tasks=4
14/06/25 21:37:40 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=0
14/06/25 21:37:40 INFO mapred.JobClient: Failed map tasks=1
hduser@ubuntu:/usr/local/hadoop$


2 Answer(s)


0

i think time to look at logs. What do the mapper log says because i see "Failed map tasks=1" you might find some more info in the logs.

0

Thanks Rohan. Let me try something after exploring the logs.

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password