FAQ
split with types causing failure during dump
--------------------------------------------

Key: PIG-416
URL: https://issues.apache.org/jira/browse/PIG-416
Project: Pig
Issue Type: Bug
Affects Versions: types_branch
Reporter: Olga Natkovich
Assignee: Alan Gates
Priority: Critical
Fix For: types_branch


grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
grunt> dump A1;

The following script causes runtime exception:

08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Alan Gates (JIRA) at Sep 9, 2008 at 7:02 pm
    [ https://issues.apache.org/jira/browse/PIG-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-416:
    ---------------------------

    Status: Patch Available (was: Open)
    split with types causing failure during dump
    --------------------------------------------

    Key: PIG-416
    URL: https://issues.apache.org/jira/browse/PIG-416
    Project: Pig
    Issue Type: Bug
    Affects Versions: types_branch
    Reporter: Olga Natkovich
    Assignee: Alan Gates
    Priority: Critical
    Fix For: types_branch

    Attachments: PIG-416.patch


    grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
    grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
    grunt> dump A1;
    The following script causes runtime exception:
    08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
    08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
    08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
    08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Alan Gates (JIRA) at Sep 9, 2008 at 7:02 pm
    [ https://issues.apache.org/jira/browse/PIG-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-416:
    ---------------------------

    Attachment: PIG-416.patch

    Fixes LogicalOptimizer to properly select the SplitOutputs to patch up projections for when inserting types. Also fixes explain to work with splits.
    split with types causing failure during dump
    --------------------------------------------

    Key: PIG-416
    URL: https://issues.apache.org/jira/browse/PIG-416
    Project: Pig
    Issue Type: Bug
    Affects Versions: types_branch
    Reporter: Olga Natkovich
    Assignee: Alan Gates
    Priority: Critical
    Fix For: types_branch

    Attachments: PIG-416.patch


    grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
    grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
    grunt> dump A1;
    The following script causes runtime exception:
    08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
    08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
    08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
    08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Alan Gates (JIRA) at Sep 9, 2008 at 7:34 pm
    [ https://issues.apache.org/jira/browse/PIG-416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated PIG-416:
    ---------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    Checked in patch.
    split with types causing failure during dump
    --------------------------------------------

    Key: PIG-416
    URL: https://issues.apache.org/jira/browse/PIG-416
    Project: Pig
    Issue Type: Bug
    Affects Versions: types_branch
    Reporter: Olga Natkovich
    Assignee: Alan Gates
    Priority: Critical
    Fix For: types_branch

    Attachments: PIG-416.patch


    grunt> A = load 'data' as (name: chararray, age: int, gpa: float);
    grunt> split A into A1 if name == 'foo', A2 if name != 'foo';
    grunt> dump A1;
    The following script causes runtime exception:
    08/09/04 16:24:33 INFO mapReduceLayer.MapReduceLauncher: 0% complete
    08/09/04 16:24:36 INFO mapReduceLayer.MapReduceLauncher: 50% complete
    08/09/04 16:25:01 INFO mapReduceLayer.MapReduceLauncher: 100% complete
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Map reduce job failed
    08/09/04 16:25:04 ERROR mapReduceLayer.MapReduceLauncher: Job failed!
    08/09/04 16:25:04 ERROR mapReduceLayer.Launcher: Error message from task (map) tip_200808261638_3037_m_000000java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.DataByteArray
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.ConstantExpression.getNext(ConstantExpression.java:111)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.EqualToExpr.getNext(EqualToExpr.java:68)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POFilter.getNext(POFilter.java:147)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:127)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapOnly$Map.map(PigMapOnly.java:64)
    at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:47)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:219)
    at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2124)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedSep 4, '08 at 11:36p
activeSep 9, '08 at 7:34p
posts4
users1
websitepig.apache.org

1 user in discussion

Alan Gates (JIRA): 4 posts

People

Translate

site design / logo © 2022 Grokbase