Grokbase Groups Pig dev March 2010
FAQ
Column pruning throws Null pointer exception
--------------------------------------------

Key: PIG-1274
URL: https://issues.apache.org/jira/browse/PIG-1274
Project: Pig
Issue Type: Bug
Reporter: Ankur


In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Ankur (JIRA) at Mar 3, 2010 at 7:46 am
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840514#action_12840514 ]

    Ankur commented on PIG-1274:
    ----------------------------

    Here is a script to reproduce the error

    ====== pig script =========

    R1 = load 'data1' as (a:chararray, b:chararray, c:chararray, d:chararray);
    R2 = load 'data2' as (x:chararray, y:chararray, z:chararray);
    joined = join R1 by c, R2 by z;
    projected = FOREACH joined generate c, d;
    dump projected;

    ===== data 1==========
    a b
    ====== data 2 ==========
    a b c
    a t d
    a x e

    The exception log is


    ERROR 1002: Unable to store alias projected

    org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias projected
    at org.apache.pig.PigServer.openIterator(PigServer.java:482)
    at org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:552)
    at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:241)
    at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
    ...
    ...
    Caused by: java.lang.NullPointerException
    at org.apache.pig.data.DefaultTuple.get(DefaultTuple.java:143)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:149)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POProject.getNext(POProject.java:234)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators.POCast.getNext(POCast.java:615)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.processPlan(POForEach.java:364)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POForEach.getNext(POForEach.java:288)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.PhysicalOperator.processInput(PhysicalOperator.java:260)
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POLocalRearrange.getNext(POLocalRearrange.java:256)
    at org.apache.pig.backend.local.executionengine.physicalLayer.relationalOperators.POCogroup.accumulateData(POCogroup.java:177)
    at org.apache.pig.backend.local.executionengine.physicalLayer.relationalOperators.POCogroup.getNext(POCogroup.java:96)
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur

    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Olga Natkovich (JIRA) at Mar 3, 2010 at 6:20 pm
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Olga Natkovich reassigned PIG-1274:
    -----------------------------------

    Assignee: Daniel Dai
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Olga Natkovich (JIRA) at Mar 3, 2010 at 6:20 pm
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Olga Natkovich updated PIG-1274:
    --------------------------------

    Fix Version/s: 0.7.0
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at Mar 3, 2010 at 6:34 pm
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840786#action_12840786 ]

    Daniel Dai commented on PIG-1274:
    ---------------------------------

    This issue is also discussed in [PIG-1188|https://issues.apache.org/jira/browse/PIG-1188], which is about how to deal with missing columns.
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at Mar 3, 2010 at 7:20 pm
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12840816#action_12840816 ]

    Daniel Dai commented on PIG-1274:
    ---------------------------------

    In this particular case, R1.c, which is referred in join statement, does not exist in the data file. So this script should fail. In general, we shall find a way to deal with missing columns. We are discussing it on PIG-1188.
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at Mar 5, 2010 at 7:50 am
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Daniel Dai resolved PIG-1274.
    -----------------------------

    Resolution: Duplicate
    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at May 14, 2010 at 6:56 am
    [ https://issues.apache.org/jira/browse/PIG-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Daniel Dai closed PIG-1274.
    ---------------------------

    Column pruning throws Null pointer exception
    --------------------------------------------

    Key: PIG-1274
    URL: https://issues.apache.org/jira/browse/PIG-1274
    Project: Pig
    Issue Type: Bug
    Reporter: Ankur
    Assignee: Daniel Dai
    Fix For: 0.7.0


    In case data has missing values for certain columns in a relation participating in a join, column pruning throws null pointer exception.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedMar 3, '10 at 7:44a
activeMay 14, '10 at 6:56a
posts8
users1
websitepig.apache.org

1 user in discussion

Daniel Dai (JIRA): 8 posts

People

Translate

site design / logo © 2022 Grokbase