Pig > user > March 2008

Hello I have setup a hadoop cluster, with the master running on hadoopm. Do I need to tweak something in a config file? ... [hadoop@hadoopm.emuprd trunk]$ hadoop fs -ls / Found 4 items /export <dir ...

I really like writing pig code, but I'm experiencing pretty terrible performance using Pig for a simple data rollup taking about 90 minutes to complete. The equivalent expressed using shell scripts ...

Hello all - I'm trying to load data that is seperated by '|' characters, using the PigStorage layer (using today's SVN) something in the parser is eating my character seperators? grunt cat ...

Hi, I am trying to execute the attached pig script - and run into parse exceptions. Removing the outer BinCond does not result in parse errors ( cond == 3 ) - but is not the functionality I require : ...

I had a working install of Pig but I get the following when attempting $ bin/pig Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/commons/logging/LogFactory at ...

Hi, FOREACH supports nested expressions of form : var1 = FOREACH var { <expr 's; GENERATE <tuple } Similar functionality does not seem to be available with FILTER. That is, slightly complex filter ...

Hi folks, i like to know more about the characteristics of a StoreFunc. Does it produce always 1 file or can it produce more files (like the hadoop reduce phase does/can) ? Does it run as map or ...

In attempting to build pig I'm running into what appears to be a pretty common and hated error in ant.I've googled like crazy and tried a few modifications to build.xml but haven't gotten anywhere. ...

Hi there, just wondering if something like this is/should be possible ? : A= (a, {(a, 1), (a, 2), (a, 3)}) (a, {}) split A into B if (count($1)==3), C; Trying this gives me an exception: Caused by: ...

<http://lucene.apache.org/mahout/ need some formula 1A pre processing filters such as resampling, discretization and what not. Would you agree it sounds about right to do that with Pig? People tell ...

Pig users and developers, I am convinced that Pig Latin deserves more respect from the major text editors :-) Here's my little script that adds Pig syntax highlighting to vim: ...