Error when trying to get twitter data from flume using Hortonworks sandbox HDP 2.1


3 Answer(s)


hi Ashraf,

Looking at the error, it looks like there was trouble loading the config file and then the jar file, please recheck the options "--conf-file",

flume-ng agent -n agent -c conf -f flume-conf.properties

Thanks

Yup there was a problem in loading jar file. I fixed it thanks

hi,
I am new to hadoop and flume. I was trying to install flume. When i wrote the command ./flume-ng agent -n MyTwitAgent -c conf -f /usr/local/apache-flume-1.4.0-bin/conf/flume.conf

I got th following error is as below:-

15/03/18 21:25:31 ERROR node.PollingPropertiesFileConfigurationProvider: Failed to load configuration data. Exception follows.
org.apache.flume.FlumeException: Unable to load source type: flume.mytwittersource.MyTwitterSourceForFlume flume.mytwittersource.MyTwitterSourceForFlume, class: flume.mytwittersource.MyTwitterSourceForFlume flume.mytwittersource.MyTwitterSourceForFlume
at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:67)
at org.apache.flume.source.DefaultSourceFactory.create(DefaultSourceFactory.java:40)
at org.apache.flume.node.AbstractConfigurationProvider.loadSources(AbstractConfigurationProvider.java:327)
at org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:102)
at org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:140)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: flume.mytwittersource.MyTwitterSourceForFlume flume.mytwittersource.MyTwitterSourceForFlume
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:264)
at org.apache.flume.source.DefaultSourceFactory.getClass(DefaultSourceFactory.java:65)
... 11 more

I think this is partially similar to ur error. plz tell me in detail how to remove this error.