Getting error on moving file


8 Answer(s)


I am also receiving the same error what you are receving...

14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.

We probably should ask Karan.

hi Mrulanini, Thomas,

Are you using the sink location of HDFS or local FS? The sink should point to hdfs path not local file system. Please correct this in the configuration and re-run flume.

Thanks

These are the contents of the flume-conf.properties. Do you see any error in this?

# Name the components on this agent
agent.sources = src-1
agent.sinks = hdfs-sink
agent.channels = memory-channel

#Source properties, its a spolling source which will take data from directory /var/log/apache/flumeSpool
agent.sources.src-1.type = spooldir
agent.sources.src-1.spoolDir = /home/cloudera/flumeSpool
agent.sources.src-1.fileHeader = true

# Use a channel which buffers events in memory
agent.channels.memory-channel.type = memory
agent.channels.memory-channel.capacity = 1000
agent.channels.memory-channel.transactionCapacity = 100

#Sink properties, hdfs source which will store data here
agent.sinks.hdfs-sink.type = hdfs
agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume
agent.sinks.hdfs-sink.hdfs.fileType = DataStream
agent.sinks.hdfs-sink.hdfs.rollCount = 20

agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume - it's HDFS location

Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:

14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.

agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume - it's HDFS location

Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:

14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.

Please note I am using CDH 4.4

After some googling, looks like guava*.jar file needs to be update. Apparently the one this flume installation is currently using does not have the CacheBuilder method or something.
Trying to see how to update that guava jar.
Any suggestions will be appreciated.

Anyone able to help to resolve this yet?