Pig > user > January 2009

I need to add a column, to a data file, with unique integer value for each record. In simplest case it could be a record number in a dataset. For example: (A) (B) (C) should become (1,A) (2,B) (3,C) ...

Hi Folks, I have a case where-in I need to do top-K on nested fields in my tuple. For e.g. Consider the following tuples (format is [url, query]) (abc.com, A) (abc.com, A) (abc.com, C) (abc.com, B) ...

Hi all Entity Attribute Value model<http://en.wikipedia.org/wiki/Entity-attribute-value_model (aka EAV model) is a simple relational model. in my use case I have a schema which looks like this: Table ...

Hi, As many of you know, for more than nine month now we have been doing most of our development work on the types branch. The code on the types branch is almost a complete rewrite of the system with ...

Hi, I'm trying to filter on the number of columns in a relation as suggested in the FAQ, but I get the following error. This is in the types branch. Has the syntax changed or does this look like a ...

I often meet errors with chararray bag items. It seems that a bag item can be casted to some other type rather than specified chararray type. May be it's just before becoming a true chararray value. ...

Hi, This may have already been asked, but I couldn't find anything in old mails ... I did find an old bug report PIG-66 about this but it got closed with no pointer to what the outcome was. My ...

SUM can fail on a column declared as long. It seems to occur when actual values in the column are small enough for int. They are serialized and probably passed to SUM as ints. Then the LongSum() code ...

All, I'm broadcasting this to all of the Hadoop dev and users lists, however, in the future I'll only send cross-subproject announcements to general@hadoop.apache.org. Please subscribe over there ...

The next Bay Area Hadoop User Group meeting is scheduled for Wednesday, January 21st at Yahoo! 2821 Mission College Blvd, Santa Clara, Building 1, Training Rooms 3 & 4 from 6:00-7:30 pm. Agenda: ...

Hi All, I have a custom loader that returns a set of fields after reading a log line. One of the fields returned is of type DataType.Map. My question is how can I set the data types for this map's ...

Another bags(?) related issue. The code below generally join three data files into one. targetWords = load 'targetWords' as ( word: chararray, phrases: bag{t: tuple(id: chararray)}); historyWords = ...

Hi, This is to announce that as of now Pig requires Java 1.6 to build and run the system. This allows Pig to take advantage of the new features available in 1.6 and any performance improvements. This ...

Live in San Diego/Southern California and want to get together and talk Hadoop/HBase/Mahout/Zookeeper/Thrift/Cloud/Pig/HBase/etc? If so, please join us for the first San Diego Hadoop Users Group ...

Using a small set of my data, I can process it, write it to BinStorage and load it again. When I use a larger set, I get an error "java.io.IOException: One schema is null [One schema is null]" when ...