Grokbase Groups Pig dev April 2011
FAQ
Pig gives incorrect error message dealing with scalar projection
----------------------------------------------------------------

Key: PIG-2000
URL: https://issues.apache.org/jira/browse/PIG-2000
Project: Pig
Issue Type: Bug
Affects Versions: 0.8.0, 0.9.0
Reporter: Xuefu Zhang
Assignee: Xuefu Zhang
Fix For: site


For the following query:

A = load 'x' as (u:tuple(x,y),v);
B = load 'y';
C = foreach B generate $0, A.u.x;

error msg in 0.8:
ERROR 1000: Error during parsing. Invalid alias: x in {u: (x: bytearray,y: bytearray),v: bytearray}

error msg in 0.9:
ERROR 1200: Pig script failed to parse: <line 4, column 27> Invalid scalar projection: A

Both messages are not clear enough. For scalar support, we only support one level, which gives a syntax of R.f format.


--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Search Discussions

  • Xuefu Zhang (JIRA) at Apr 20, 2011 at 9:56 pm
    [ https://issues.apache.org/jira/browse/PIG-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-2000:
    -----------------------------

    Fix Version/s: (was: site)
    0.9.0
    Pig gives incorrect error message dealing with scalar projection
    ----------------------------------------------------------------

    Key: PIG-2000
    URL: https://issues.apache.org/jira/browse/PIG-2000
    Project: Pig
    Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.9.0


    For the following query:
    A = load 'x' as (u:tuple(x,y),v);
    B = load 'y';
    C = foreach B generate $0, A.u.x;
    error msg in 0.8:
    ERROR 1000: Error during parsing. Invalid alias: x in {u: (x: bytearray,y: bytearray),v: bytearray}
    error msg in 0.9:
    ERROR 1200: Pig script failed to parse: <line 4, column 27> Invalid scalar projection: A
    Both messages are not clear enough. For scalar support, we only support one level, which gives a syntax of R.f format.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Xuefu Zhang (JIRA) at Apr 21, 2011 at 12:17 am
    [ https://issues.apache.org/jira/browse/PIG-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-2000:
    -----------------------------

    Attachment: PIG-2000.patch

    Test-patch run:

    [exec] +1 overall.
    [exec]
    [exec] +1 @author. The patch does not contain any @author tags.
    [exec]
    [exec] +1 tests included. The patch appears to include 3 new or modified tests.
    [exec]
    [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
    [exec]
    [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
    [exec]
    [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
    [exec]
    [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

    Pig gives incorrect error message dealing with scalar projection
    ----------------------------------------------------------------

    Key: PIG-2000
    URL: https://issues.apache.org/jira/browse/PIG-2000
    Project: Pig
    Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.9.0

    Attachments: PIG-2000.patch


    For the following query:
    A = load 'x' as (u:tuple(x,y),v);
    B = load 'y';
    C = foreach B generate $0, A.u.x;
    error msg in 0.8:
    ERROR 1000: Error during parsing. Invalid alias: x in {u: (x: bytearray,y: bytearray),v: bytearray}
    error msg in 0.9:
    ERROR 1200: Pig script failed to parse: <line 4, column 27> Invalid scalar projection: A
    Both messages are not clear enough. For scalar support, we only support one level, which gives a syntax of R.f format.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Xuefu Zhang (JIRA) at Apr 21, 2011 at 12:20 am
    [ https://issues.apache.org/jira/browse/PIG-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13022566#comment-13022566 ]

    Xuefu Zhang commented on PIG-2000:
    ----------------------------------

    The expected behavior specified above is not accurate. After discussing with Thejas, it's found that this is valid use case. Unfortunately, we had issues in both 0.8 and 0.9. The patch provided above fixes the issue in 0.9. With it, scalar project in form of "A.x.y" is supported.

    Fix for 0.8 would require a different patch.
    Pig gives incorrect error message dealing with scalar projection
    ----------------------------------------------------------------

    Key: PIG-2000
    URL: https://issues.apache.org/jira/browse/PIG-2000
    Project: Pig
    Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.9.0

    Attachments: PIG-2000.patch


    For the following query:
    A = load 'x' as (u:tuple(x,y),v);
    B = load 'y';
    C = foreach B generate $0, A.u.x;
    error msg in 0.8:
    ERROR 1000: Error during parsing. Invalid alias: x in {u: (x: bytearray,y: bytearray),v: bytearray}
    error msg in 0.9:
    ERROR 1200: Pig script failed to parse: <line 4, column 27> Invalid scalar projection: A
    Both messages are not clear enough. For scalar support, we only support one level, which gives a syntax of R.f format.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Xuefu Zhang (JIRA) at Apr 21, 2011 at 4:30 pm
    [ https://issues.apache.org/jira/browse/PIG-2000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang resolved PIG-2000.
    ------------------------------

    Resolution: Fixed

    Unit test passed. Patch is committed to trunk. Issue is closed.
    Pig gives incorrect error message dealing with scalar projection
    ----------------------------------------------------------------

    Key: PIG-2000
    URL: https://issues.apache.org/jira/browse/PIG-2000
    Project: Pig
    Issue Type: Bug
    Affects Versions: 0.8.0, 0.9.0
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.9.0

    Attachments: PIG-2000.patch


    For the following query:
    A = load 'x' as (u:tuple(x,y),v);
    B = load 'y';
    C = foreach B generate $0, A.u.x;
    error msg in 0.8:
    ERROR 1000: Error during parsing. Invalid alias: x in {u: (x: bytearray,y: bytearray),v: bytearray}
    error msg in 0.9:
    ERROR 1200: Pig script failed to parse: <line 4, column 27> Invalid scalar projection: A
    Both messages are not clear enough. For scalar support, we only support one level, which gives a syntax of R.f format.
    --
    This message is automatically generated by JIRA.
    For more information on JIRA, see: http://www.atlassian.com/software/jira

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedApr 19, '11 at 2:08p
activeApr 21, '11 at 4:30p
posts5
users1
websitepig.apache.org

1 user in discussion

Xuefu Zhang (JIRA): 5 posts

People

Translate

site design / logo © 2022 Grokbase