Pig > user > July 2008

Hi, I am trying to start pig for the first time, so here is a beginner's question. How do I tell the bin/pig shell script where the cluster can be found? I used the conf/pic.properties as follows: # ...

Hi All, (Thanks for the help with the tutorial!) I'm looking at using pig to chew through some apache server log files. Has anyone on the list done this? Any best practices or UDF's floating around ...

Folks, Is there a way to do something akin to map (of map/reduce) over a tuple? The input file is lines like this: category word1 word2 ... So simplest is to read it as a tuple (PigStorage ' '), but ...

Hi Can you use Pig with XML data files? If so, does anyone have any examples? I want to do something that would equate to an XPath query against the XML. Thanks.

Hi: Just start learning hadoop and pig latin. How can I get the number of elements in a data bag? For example, a data bag like follow has four elements. B= {1, 2, 3, 5} I tried C = COUNT(B), it did ...

Hello, I'm attempting to run a Pig job on a Hadoop cluster with a 5GB/35 million row input. When run on sample data of 100k rows, I get the correct results, but when I run it on the whole dataset, ...

Hi, I'm trying to build piggybank, but is failing... Any ideas anyone? Thank you in advance, Andre -- andre-philippis-macbook:java andrephilippi$ pwd /Users/andrephilippi/pig/piggybank/java ...

Hi, I started learning and working with Pig 3 days ago and I have been able to make it work with my EC2/HDFS environment and parse some files. Yay! :) Now, after reading all of the docs on the wiki, ...

Hi, I wrote a small pig script with a couple of functions and it works fine in the local mode. However, when I run it on a hadoop cluster on a 4Gig file (apache access log). The job is submitted ...

A reminder that the next user group meeting is scheduled for July 22nd from 6 - 7:30 pm at Yahoo! Mission College, Building 1, Training Rooms 3 and 4. Agenda: Cascading - Chris Wensel Performance ...

Charles, The right forum for Pig is pig-user@incubator.apache.org, I'm redirecting you there... good luck! Arun

The next Hadoop User Group meeting is scheduled for July 22nd from 6 - 7:30 pm at Yahoo! Mission College, Building 1, Training Rooms 3 and 4. Agenda: Cascading - Chris Wenzel Performance Benchmarking ...