When I try to run command in Hive for Twitter output?


When I run To find out influential celebrity or people.I get this error.


Kill Command = /usr/lib/hadoop/bin/hadoop job  -kill job_201612010937_0001
Hadoop job information for Stage-1: number of mappers: 1; number of reducers: 1
2016-12-01 09:58:13,306 Stage-1 map = 0%,  reduce = 0%
2016-12-01 09:58:54,576 Stage-1 map = 100%,  reduce = 100%
Ended Job = job_201612010937_0001 with errors
Error during job, obtaining debugging information...
Job Tracking URL:
Examining task ID: task_201612010937_0001_m_000002 (and more) from job job_201612010937_0001

Task with the most failures(4): 
Task ID:

Diagnostic Messages for this Task:
java.lang.RuntimeException: Error in configuring object
    at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:109)
    at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:75)
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
    at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:413)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
    at org.apache.hadoop.mapred.Child$4.run(Child.java:268)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
    at org.apache.hadoop.mapred.Child.main(Child.java:262)
Caused by: java.lang.reflect.InvocationTargetException
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.ja

3 Answer(s)


Hi Jagdeep,

There may be 2 reasons for it: -

1. HIVE-SITE.XML was not being located in class path and hive was referring to hive-default.xml. Due to which, hive-metastore service was not running

2. it kills the job Also check your hive.log to have more information about your issue if the valeue of hive.exec.max.created.files variable in HIVE is exceed.

Hope this helps.



Hi Abhijit,

How you doing? I am little confuse about documenation Dezyre has it for Twitter Project.Please help me,if you can.I would like to know what connector do I need.I meant which version.

cp /var/lib/oozie/mysql-connector-java.jar oozie-workflows/lib


Hi Jadeep,

You have posted the same question on https://www.dezyre.com/questions/5175/sql-connector-version-and-also-oozie-worklow-problem

Please check the response.