Here i tried with the jar file from github :https://github.com/cloudera/cdh-twitter-example

I got a positive response; but no tweets got downloaded into HDFS even after running for 12 hrs.

flume-ng/conf/flume-conf.properties.template
16/03/25 23:02:43 INFO node.PollingPropertiesFileConfigurationProvider: Configuration provider starting
16/03/25 23:02:43 INFO node.PollingPropertiesFileConfigurationProvider: Reloading configuration file:/usr/lib/flume-ng/conf/flume-conf.properties.template
16/03/25 23:02:43 INFO conf.FlumeConfiguration: Processing:loggerSink
16/03/25 23:02:43 INFO conf.FlumeConfiguration: Processing:loggerSink
16/03/25 23:02:43 INFO conf.FlumeConfiguration: Added sinks: loggerSink Agent: agent
16/03/25 23:02:43 INFO conf.FlumeConfiguration: Post-validation flume configuration contains configuration for agents: [agent]
16/03/25 23:02:43 WARN node.AbstractConfigurationProvider: No configuration found for this host:TwitterAgent
16/03/25 23:02:43 INFO node.Application: Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} }

Hi Sirajuddin,
Check the error:
----------------------------------------------------------------------------
source:com.cloudera.flume.source.TwitterSource{name:Twitter,state:IDLE} } - Exception follows.
java.lang.IllegalStateException: Authentication credentials are missing. See http://twitter4j.org/configuration.html for the detail.
--------------------------------------------------------------------
It clearly mention that the authentication detail given by you is incorrect.
To resolve this issue. Please open the flume.conf (default name) and correct the authentication keys values.

Hope this helps.
Thanks.

Can you comment on the second question, where I used the GitHub jar file? And still no luck

Hi Sirajuddin,
As I mention the problem is not with the Github jar. I am using the same.
The problem is in conf file provided as input to flume that contain authentication values and other information required by flume to perform the transactions.

Please correct the file values and you will able to to fetch the details.
As you are using the default file template, it doesn't work:flume-conf.properties.template
This is just sample template file or try remove the .template from end.

Hope this helps.
Thanks

Thanks!., this works :
flume-ng agent -n TwitterAgent -c conf -f flume.conf /usr/lib/flume-ng/conf/flume-conf.properties
This issue was with the template keyword!

Hi Sirajuddin,

Thanks for your update.