Getting error on moving file
8 Answer(s)
Thomas
I am also receiving the same error what you are receving...
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
We probably should ask Karan.
Nov 11 2014 07:05 AM
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
We probably should ask Karan.
DeZyre Support
hi Mrulanini, Thomas,
Are you using the sink location of HDFS or local FS? The sink should point to hdfs path not local file system. Please correct this in the configuration and re-run flume.
Thanks
Nov 11 2014 08:19 AM
Are you using the sink location of HDFS or local FS? The sink should point to hdfs path not local file system. Please correct this in the configuration and re-run flume.
Thanks
Mrunalini
These are the contents of the flume-conf.properties. Do you see any error in this?
# Name the components on this agent
agent.sources = src-1
agent.sinks = hdfs-sink
agent.channels = memory-channel
#Source properties, its a spolling source which will take data from directory /var/log/apache/flumeSpool
agent.sources.src-1.type = spooldir
agent.sources.src-1.spoolDir = /home/cloudera/flumeSpool
agent.sources.src-1.fileHeader = true
# Use a channel which buffers events in memory
agent.channels.memory-channel.type = memory
agent.channels.memory-channel.capacity = 1000
agent.channels.memory-channel.transactionCapacity = 100
#Sink properties, hdfs source which will store data here
agent.sinks.hdfs-sink.type = hdfs
agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume
agent.sinks.hdfs-sink.hdfs.fileType = DataStream
agent.sinks.hdfs-sink.hdfs.rollCount = 20
Nov 11 2014 08:35 AM
# Name the components on this agent
agent.sources = src-1
agent.sinks = hdfs-sink
agent.channels = memory-channel
#Source properties, its a spolling source which will take data from directory /var/log/apache/flumeSpool
agent.sources.src-1.type = spooldir
agent.sources.src-1.spoolDir = /home/cloudera/flumeSpool
agent.sources.src-1.fileHeader = true
# Use a channel which buffers events in memory
agent.channels.memory-channel.type = memory
agent.channels.memory-channel.capacity = 1000
agent.channels.memory-channel.transactionCapacity = 100
#Sink properties, hdfs source which will store data here
agent.sinks.hdfs-sink.type = hdfs
agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume
agent.sinks.hdfs-sink.hdfs.fileType = DataStream
agent.sinks.hdfs-sink.hdfs.rollCount = 20
Thomas
agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume - it's HDFS location
Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
Nov 11 2014 09:18 AM
Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
Thomas
agent.sinks.hdfs-sink.hdfs.path = /user/cloudera/flume - it's HDFS location
Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
Nov 11 2014 09:18 AM
Can you tell us why we are getting the below error? - java.lang.NoSuchMethodError:
14/11/10 17:07:32 ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError: com.google.common.cache.CacheBuilder.build()Lcom/google/common/cache/Cache;
at org.apache.hadoop.hdfs.DomainSocketFactory.
Mrunalini
After some googling, looks like guava*.jar file needs to be update. Apparently the one this flume installation is currently using does not have the CacheBuilder method or something.
Trying to see how to update that guava jar.
Any suggestions will be appreciated.
Nov 11 2014 12:59 PM
Trying to see how to update that guava jar.
Any suggestions will be appreciated.