Pig > dev > June 2010

Allow casting relations to scalars ---------------------------------- Key: PIG-1434 URL: https://issues.apache.org/jira/browse/PIG-1434 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich ...

to remove hadoop20.jar from lib and use hadoop from the apache maven repo. -------------------------------------------------------------------------- Key: PIG-1452 URL: ...

support union operation that merges based on column names --------------------------------------------------------- Key: PIG-1461 URL: https://issues.apache.org/jira/browse/PIG-1461 Project: Pig ...

make sure dependent jobs fail when a jon in multiquery fails ------------------------------------------------------------ Key: PIG-1435 URL: https://issues.apache.org/jira/browse/PIG-1435 Project: ...

[zebra] Intermittent failure for TestOrderPreserveUnionHDFS ----------------------------------------------------------- Key: PIG-1453 URL: https://issues.apache.org/jira/browse/PIG-1453 Project: Pig ...

Optimize serialization/deserialization between Map and Reduce and between MR jobs --------------------------------------------------------------------------------- Key: PIG-1472 URL: ...

aggregate files for replicated join ----------------------------------- Key: PIG-1458 URL: https://issues.apache.org/jira/browse/PIG-1458 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich ...

Improve log messages for memory usage ------------------------------------- Key: PIG-1466 URL: https://issues.apache.org/jira/browse/PIG-1466 Project: Pig Issue Type: Improvement Components: impl ...

DataByteArray.compareTo() does not compare in lexicographic order ----------------------------------------------------------------- Key: PIG-1468 URL: https://issues.apache.org/jira/browse/PIG-1468 ...

It looks like right now, the combiner optimization does not kick in for a script like this: data = load 'foo' using PigStorage() as (a, b, c); grouped = group data by a; filtered = filter grouped by ...

UDF manual and javadocs should make clear how to use RequiredFieldList ---------------------------------------------------------------------- Key: PIG-1460 URL: ...

RegExLoader hangs on lines that don't match the regular expression ------------------------------------------------------------------ Key: PIG-1449 URL: https://issues.apache.org/jira/browse/PIG-1449 ...

Tune memory usage of InternalCachedBag -------------------------------------- Key: PIG-1447 URL: https://issues.apache.org/jira/browse/PIG-1447 Project: Pig Issue Type: Improvement Components: impl ...

order by fail when set "fs.file.impl.disable.cache" to true ----------------------------------------------------------- Key: PIG-1467 URL: https://issues.apache.org/jira/browse/PIG-1467 Project: Pig ...

DefaultTuple underestimate the memory footprint for string ---------------------------------------------------------- Key: PIG-1443 URL: https://issues.apache.org/jira/browse/PIG-1443 Project: Pig ...

Detach tuple from inner plans of physical operator --------------------------------------------------- Key: PIG-1448 URL: https://issues.apache.org/jira/browse/PIG-1448 Project: Pig Issue Type: Bug ...

[Performance] MultiQueryOptimizer should also merge DISTINCT jobs ----------------------------------------------------------------- Key: PIG-1438 URL: https://issues.apache.org/jira/browse/PIG-1438 ...

pig should create success file if mapreduce.fileoutputcommitter.marksuccessfuljobs is true ------------------------------------------------------------------------------------------ Key: PIG-1433 ...

Folks, Posting on the dev since this is regarding the new logical plan optimization framework which is not enabled yet. I was interested in playing around with the new optimization framework and try ...

TestAlgebraicEvalLocal failures due to OOM ------------------------------------------ Key: PIG-1450 URL: https://issues.apache.org/jira/browse/PIG-1450 Project: Pig Issue Type: Test Affects Versions: ...

Should clean the Graph when register another Pig Script ------------------------------------------------------- Key: PIG-1464 URL: https://issues.apache.org/jira/browse/PIG-1464 Project: Pig Issue ...

DefaultDataBag assumes ArrayList as default List type ----------------------------------------------------- Key: PIG-1469 URL: https://issues.apache.org/jira/browse/PIG-1469 Project: Pig Issue Type: ...

[zebra] There are some debuging info output to STDOUT in PIG's TableStorer call path ------------------------------------------------------------------------------------ Key: PIG-1432 URL: ...

Filter inside foreach is broken ------------------------------- Key: PIG-1465 URL: https://issues.apache.org/jira/browse/PIG-1465 Project: Pig Issue Type: Bug Affects Versions: 0.7.0 Reporter: hc ...

Consider clean up backend code ------------------------------ Key: PIG-1454 URL: https://issues.apache.org/jira/browse/PIG-1454 Project: Pig Issue Type: Improvement Components: impl Affects Versions: ...

New test targets: unit and smoke -------------------------------- Key: PIG-1441 URL: https://issues.apache.org/jira/browse/PIG-1441 Project: Pig Issue Type: Improvement Reporter: Olga Natkovich ...

[ https://issues.apache.org/jira/browse/PIG-282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aniket Mokashi updated PIG-282: ------------------------------- Attachment: ...

No informative error message on parse problem --------------------------------------------- Key: PIG-1462 URL: https://issues.apache.org/jira/browse/PIG-1462 Project: Pig Issue Type: Bug Affects ...

java.lang.OutOfMemoryError: Java heap space (Reopen of PIG-766) --------------------------------------------------------------- Key: PIG-1442 URL: https://issues.apache.org/jira/browse/PIG-1442 ...

Pig error: ERROR 2013: Moving LOLimit in front of LOStream is not implemented ------------------------------------------------------------------------------ Key: PIG-1445 URL: ...

Avoid serialization/deserialization costs for PigStorage data - Use custom Map and Bag implementation ...

Replace "bz" with ".bz" in setStoreLocation in PigStorage ---------------------------------------------------------- Key: PIG-1463 URL: https://issues.apache.org/jira/browse/PIG-1463 Project: Pig ...

I have created a wiki which puts together some ideas that can help in improving performance by avoiding/delaying serialization/de-serialization . http://wiki.apache.org/pig/AvoidingSedes These are ...

[zebra] change the build.test property in build to test.build.dir to be in consistent with PIG ---------------------------------------------------------------------------------------------- Key: ...

TestMultiQuery takes a long time to run --------------------------------------- Key: PIG-1456 URL: https://issues.apache.org/jira/browse/PIG-1456 Project: Pig Issue Type: Test Components: impl ...

[zebra] "test-unit" is needed as an ant target to unit test Zebra ------------------------------------------------------------------ Key: PIG-1455 URL: https://issues.apache.org/jira/browse/PIG-1455 ...

OOME in a query having a bincond in the inner plan of a Foreach. ---------------------------------------------------------------- Key: PIG-1446 URL: https://issues.apache.org/jira/browse/PIG-1446 ...

[Optimization] Rewrite GroupBy-Foreach-flatten(group) to Distinct ----------------------------------------------------------------- Key: PIG-1437 URL: https://issues.apache.org/jira/browse/PIG-1437 ...

inline UDFs in scripting languages ---------------------------------- Key: PIG-1471 URL: https://issues.apache.org/jira/browse/PIG-1471 Project: Pig Issue Type: New Feature Reporter: Aniket Mokashi ...

Print number of records outputted at each step of a Pig script -------------------------------------------------------------- Key: PIG-1436 URL: https://issues.apache.org/jira/browse/PIG-1436 ...

Add trailing flag to commands to prevent retention of relation name in field names: STRIP ? ------------------------------------------------------------------------------------------- Key: PIG-1476 ...

Would it be possible, and not a ton of work to make the builtin SIZE() work on a relation? Reason being, I frequently do this: B = GROUP A ALL; C = FOREACH B GENERATE SIZE(A) AS total; DUMP C; And I ...

[Zebra] Zebra build should have a test-smoke target --------------------------------------------------- Key: PIG-1444 URL: https://issues.apache.org/jira/browse/PIG-1444 Project: Pig Issue Type: Task ...

map/red jobs fail using G1 GC (Couldn't find heap) -------------------------------------------------- Key: PIG-1470 URL: https://issues.apache.org/jira/browse/PIG-1470 Project: Pig Issue Type: Bug ...

Pig will run complete zebra test even we give -Dtestcase=xxx ------------------------------------------------------------ Key: PIG-1457 URL: https://issues.apache.org/jira/browse/PIG-1457 Project: ...

Refactor org.apache.pig.data.DataType to use Enums instead of integer constants ------------------------------------------------------------------------------- Key: PIG-1440 URL: ...

Need a standard way to communicate the requested fields between front and back end for loaders ---------------------------------------------------------------------------------------------- Key: ...

HI all, I notice that whether pig use distributed cache depends on the context (local or mapreduce). When running in mapreduce mode, the distributed cache is always enable (e.g. replicated join). ...

Avoid serialization/deserialization costs for PigStorage data - Use custom Tuple -------------------------------------------------------------------------------- Key: PIG-1474 URL: ...

Large number of FILTER matching clauses causes internal error 2998 ------------------------------------------------------------------ Key: PIG-1475 URL: https://issues.apache.org/jira/browse/PIG-1475 ...