Pig > user > August 2008

I've been trying to run the Pig tutorial on our six-node hadoop cluster. It does run as a map-reduce job (not just a local job), but it only uses one node as a mapper and another node as a reducer. I ...

Hello! I have meet a code problem about the charset. I use Hadoop to store the log data, and my log data is not coded in UTF-8, for example GBK in china. If I use the PigStorage() to process my data, ...

I think we discussed a similar issue sometime ago about problems with PIG's implicit comparisons and DataAtoms. Here's an example - What do we expect cogroup_AB to contain? In the current ...

Hi: I have a list of records stored in a file. Most of records have 10 fields, but some of records have less fields. I would like to filter out these records with less fields. How could I do it? Is ...

The next Hadoop User Group (Bay Area) meeting is scheduled for Wednesday, Aug 20th from 6 - 7:30 pm at Yahoo! Mission College, Santa Clara, CA, Building 1, Training Rooms 3&4. Agenda: Pig Update: ...

Hi, Is there any tentative schedule that is aimed for w.r.t types branch of pig ? Particularly since it is not backwardly compatible with current pig udf's, it would be great to know how much time is ...

Hi All, I cant run any script when using regular expressions with escape codes If I try to run the following line of code: raw_filtered = FILTER raw BY ngram matches '^[a-zA-Z0-9\s]$'; OR ...

Hi, A few things which I observed this weekend while using Pig. a) ORDER BY udf specification is inconsistent with rest of pig. alias = ORDER input BY $0 USING udfClass; unlike rest of pig where we ...

Hi, Is there any portable way to create a Slice in pig ? Or atleast, assuming I know the parameters to be passed to the loader, an api which creates the funcSpec would be great too. I would prefer ...