When I try to run command in Hive for Twitter output?



0

When I run To find out influential celebrity or people.I get this error.

 

Kill Command = /usr/lib/hadoop/bin/hadoop job  -kill job_201612010937_0001
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2016-12-01 09:58:13,306 Stage-1 map = 0%,  reduce = 0%
2016-12-01 09:58:54,576 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201612010937_0001 with errors
Error during job, obtaining debugging information...
Job Tracking URL: http://0.0.0.0:50030/jobdetails.jsp?jobid=job_201612010937_0001
Examining task ID: task_201612010937_0001_m_000002 (and more) from job job_201612010937_0001

Task with the most failures(4): 
-----
Task ID:
  task_201612010937_0001_m_000000

URL:
  http://localhost.localdomain:50030/taskdetails.jsp?jobid=job_201612010937_0001&tipid=task_201612010937_0001_m_000000
-----
Diagnostic Messages for this Task:
java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja
 


3 Answer(s)


0

Hi Jagdeep,

There may be 2 reasons for it: -

1. HIVE-SITE.XML was not being located in class path and hive was referring to hive-default.xml. Due to which, hive-metastore service was not running

2. it kills the job Also check your hive.log to have more information about your issue if the valeue of hive.exec.max.created.files variable in HIVE is exceed.

Hope this helps.

Thanks.


0

Hi Abhijit,

How you doing? I am little confuse about documenation Dezyre has it for Twitter Project.Please help me,if you can.I would like to know what connector do I need.I meant which version.

cp /var/lib/oozie/mysql-connector-java.jar oozie-workflows/lib
 


0

Hi Jadeep,

You have posted the same question on https://www.dezyre.com/questions/5175/sql-connector-version-and-also-oozie-worklow-problem

Please check the response.

Thanks.

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password