Error while working with PIG


8 Answer(s)


Hi Harish,

You cannot use Pig in Standalone mode. Pig read and write data from/to HDFS only. You have to install Pseudo-mode and make sure all the hadoop services are running.

Hope this helps.

Thanks.


It is a Pusedo-distributed Mode


here is the screenshot



The other possible causes may be as follows:

1. Try using not null filter for the fields which you are using. If your data is containing null or bad record based on the schema definition of data you provide on Loading, this error will occur. 

 

2. If you are using latest version of Pig, make sure first line of your file does not contain schema information but the record itself. Older versions of Pig used to skip 1st line but recent ones doesn't. 

3. If you are using PIG in local mode, your data file must be on local system and not on HDFS. Similarly, if you are using Pig in pseudo mode, your data file must be on HDFS. 

 

4. If you are using older version of Pig on newer version of Hadoop, this error will occur. If this is the case, replace your Pig installation with new version. 


Hello Harish,

Is your problem resolved ? I am also facing same issue.

@Dezyre Team: I cross checked with your points, yet still not able to resolve the issue. Please Help.

-pramodh


@harish,

Got my problem resolved. Dump is working. 


@Harish and Pramod

Can you pls share the resolution steps for this issue?


hi pramodh,

could you please share the resolution steps