Pig > dev > June 2008

Merge changes from trunk to "types" branch ------------------------------------------ Key: PIG-269 URL: https://issues.apache.org/jira/browse/PIG-269 Project: Pig Issue Type: Sub-task Reporter: ...

Currently in Pig Latin, anytime a (CO)GROUP statement is used, the field (or set of fields) that are grouped on are given the alias 'group'. This has a couple of issues: 1) It's confusing. 'group' is ...

Pig needs an optimizer ---------------------- Key: PIG-262 URL: https://issues.apache.org/jira/browse/PIG-262 Project: Pig Issue Type: New Feature Components: impl Reporter: Alan Gates Assignee: Alan ...

Allow UDFs to have different implementations based on input types ----------------------------------------------------------------- Key: PIG-276 URL: https://issues.apache.org/jira/browse/PIG-276 ...

Integrating Pig with Hadoop 0.18 -------------------------------- Key: PIG-253 URL: https://issues.apache.org/jira/browse/PIG-253 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich Hadoop ...

UDF for computing correlation and covariance between data sets -------------------------------------------------------------- Key: PIG-277 URL: https://issues.apache.org/jira/browse/PIG-277 Project: ...

Add tutorial files and builds to Pig SVN ---------------------------------------- Key: PIG-271 URL: https://issues.apache.org/jira/browse/PIG-271 Project: Pig Issue Type: New Feature Reporter: Olga ...

Failure running complex script with streaming --------------------------------------------- Key: PIG-272 URL: https://issues.apache.org/jira/browse/PIG-272 Project: Pig Issue Type: Bug Reporter: Olga ...

Hi, Currently in org.apache.pig.impl.util.SpillableMemoryManger: 1) We use MemoryManagement interface to get notified when the "collection threshold" exceeds a limit (we set this to ...

Show Line Number in Pig Error Messages -------------------------------------- Key: PIG-270 URL: https://issues.apache.org/jira/browse/PIG-270 Project: Pig Issue Type: Improvement Reporter: Amir ...

support non default constructor with variable number of arguments ----------------------------------------------------------------- Key: PIG-256 URL: https://issues.apache.org/jira/browse/PIG-256 ...

Calling non default constructor of Final class from Main class in UDF --------------------------------------------------------------------- Key: PIG-255 URL: ...

Don't substitute parameters inside comments ------------------------------------------- Key: PIG-267 URL: https://issues.apache.org/jira/browse/PIG-267 Project: Pig Issue Type: Improvement Reporter: ...

Allow no alias in Dot schema definition in Dot LogicalPlanLoader ---------------------------------------------------------------- Key: PIG-278 URL: https://issues.apache.org/jira/browse/PIG-278 ...

Hi, According to http://wiki.apache.org/incubator/June2008 the Pig board report is due today. Could someone prepare it and add it to that wiki page? I'm not following closely enough to do that. See ...

Allow multiple paths in the load statement ------------------------------------------ Key: PIG-252 URL: https://issues.apache.org/jira/browse/PIG-252 Project: Pig Issue Type: Improvement Reporter: ...

changing combiner behavior past hadoop 18 ----------------------------------------- Key: PIG-274 URL: https://issues.apache.org/jira/browse/PIG-274 Project: Pig Issue Type: Bug Reporter: Olga ...

Pig should cleanup output directory of a failed query ----------------------------------------------------- Key: PIG-258 URL: https://issues.apache.org/jira/browse/PIG-258 Project: Pig Issue Type: ...

Grunt fails when it encounter comment inside comment ---------------------------------------------------- Key: PIG-275 URL: https://issues.apache.org/jira/browse/PIG-275 Project: Pig Issue Type: Bug ...

Warnings with hadoop 17 ----------------------- Key: PIG-266 URL: https://issues.apache.org/jira/browse/PIG-266 Project: Pig Issue Type: Bug Reporter: Olga Natkovich We now seeing the following ...

Has anyone ever looked at OLAP Cube processing on Pig or MapReduce? This feature should be beneficial for normal businesses (probably not web scale). I find it pretty simple provided that we can work ...

Allow usage of custom Hadoop InputFormat in Pig ----------------------------------------------- Key: PIG-257 URL: https://issues.apache.org/jira/browse/PIG-257 Project: Pig Issue Type: New Feature ...

Make all functions in pig case insesitive. ------------------------------------------ Key: PIG-265 URL: https://issues.apache.org/jira/browse/PIG-265 Project: Pig Issue Type: Improvement Reporter: ...

If I have a query like this:- A = load 'a' as (field1: int, field2: long); B = group a by field1 ; The output schema of B would be:- group:int, a: bag{tuple1:tuple(field1: int,field2: long)} We ...

This mail applies only to changes in the types branch. The central question is whether the declaration of fields in LOAD ... AS constitutes a projection or not. With the changes in the type branch, ...

Analysis below. Shravan M Narayanamurthy wrote: In this case, the foreach should have the following plans: 0 - proj(0) 1 - proj( * ) - udf1 2 - proj (1) - filter - distinct - proj( * ) - udf2 3 - ...

Local Pig does not parse globs ------------------------------ Key: PIG-279 URL: https://issues.apache.org/jira/browse/PIG-279 Project: Pig Issue Type: Bug Components: impl Affects Versions: 0.1.0 ...

Comments inlined. pi song wrote: As specified, there isn't support for giving a field's type without giving it an alias. I don't know that we need to allow this. Santhosh, can you comment on this? My ...

allow store to overwrite existing directroy ------------------------------------------- Key: PIG-259 URL: https://issues.apache.org/jira/browse/PIG-259 Project: Pig Issue Type: Bug Reporter: Olga ...

explain exception ----------------- Key: PIG-261 URL: https://issues.apache.org/jira/browse/PIG-261 Project: Pig Issue Type: Bug Components: grunt Environment: ubuntu 7.10 jdk1.6.0_06 ant 1.7.0 ...

inconsistent return from Main ----------------------------- Key: PIG-264 URL: https://issues.apache.org/jira/browse/PIG-264 Project: Pig Issue Type: Bug Reporter: Olga Natkovich Main uses value of 0 ...

See http://hudson.zones.apache.org/hudson/job/Pig-trunk/224/changes ------------------------------------------ [...truncated 804 lines...] [junit] at ...

See http://hudson.zones.apache.org/hudson/job/Pig-trunk/222/changes Changes: [olga] PIG-235: memory management improvement ------------------------------------------ [...truncated 803 lines...] ...

Need to optimize the ways splits are handled, both in the top level plan and in nested plans. --------------------------------------------------------------------------------------------- Key: ...

I am getting worried on the huge number of bytes written to local fs. I have a 2 machine cluster, one has 100% io util, one has 10-20% io util during map phase, the input data is replicated on both ...

Regarding slow unit testing issue before, somebody has sent me an email claiming he also has the same problem. He has identified the problem which seems to be a bug in Jetty. One possible way to fix ...

Incorrect message trying to store non-existent alias ---------------------------------------------------- Key: PIG-251 URL: https://issues.apache.org/jira/browse/PIG-251 Project: Pig Issue Type: Bug ...

Support # for comment besides -- -------------------------------- Key: PIG-281 URL: https://issues.apache.org/jira/browse/PIG-281 Project: Pig Issue Type: Improvement Reporter: Amir Youssefi ...

Making it easier to run on an existing hod cluster -------------------------------------------------- Key: PIG-280 URL: https://issues.apache.org/jira/browse/PIG-280 Project: Pig Issue Type: ...

Hi, I have added an entry for Pig at http://www.ohloh.net/projects/pig, with minimal information. Feel free to complete as desired. -Bertrand

Describe Bug ------------ Key: PIG-268 URL: https://issues.apache.org/jira/browse/PIG-268 Project: Pig Issue Type: Bug Reporter: Amir Youssefi Priority: Trivial Priority: Trivial grunt a = load ...

move grunt to FsShell class --------------------------- Key: PIG-263 URL: https://issues.apache.org/jira/browse/PIG-263 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich Currently grunt ...

All error output goes to the stderr ----------------------------------- Key: PIG-260 URL: https://issues.apache.org/jira/browse/PIG-260 Project: Pig Issue Type: Bug Reporter: Olga Natkovich Currently ...

Allowing user defined counters for streaming -------------------------------------------- Key: PIG-254 URL: https://issues.apache.org/jira/browse/PIG-254 Project: Pig Issue Type: New Feature ...

Hi all, I am working for developing UDFs for correlation and covariance . In these UDF user use DEFINE to call non default constructor of Main class and give it schema names . Now from this Main ...