Grokbase Groups Pig dev August 2010
FAQ
Complete the migration of optimization rule PushUpFilter including missing test cases
-------------------------------------------------------------------------------------

Key: PIG-1575
URL: https://issues.apache.org/jira/browse/PIG-1575
Project: Pig
Issue Type: Bug
Reporter: Xuefu Zhang
Assignee: Xuefu Zhang
Fix For: 0.8.0


The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.

Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 12:39 am
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Status: Patch Available (was: Open)
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 12:39 am
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Attachment: jira-1575-1.patch
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 6:29 pm
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Status: Open (was: Patch Available)
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 6:29 pm
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Attachment: jira-1575-2.patch
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 6:32 pm
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Status: Patch Available (was: Open)

    Updated after fixing unit test failure.
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 11:23 pm
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Attachment: jira-1575-3.patch
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch, jira-1575-3.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 3, 2010 at 11:26 pm
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12906169#action_12906169 ]

    Xuefu Zhang commented on PIG-1575:
    ----------------------------------

    regenerate the patch to include fixes for UDF and Dereference deep copy.
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch, jira-1575-3.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Xuefu Zhang (JIRA) at Sep 4, 2010 at 6:08 am
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Xuefu Zhang updated PIG-1575:
    -----------------------------

    Attachment: jira-1575-4.patch

    Add Fix for a failed test case. Only the test case itself gets changed.
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch, jira-1575-3.patch, jira-1575-4.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at Sep 6, 2010 at 5:40 am
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Daniel Dai updated PIG-1575:
    ----------------------------

    Status: Resolved (was: Patch Available)
    Hadoop Flags: [Reviewed]
    Resolution: Fixed
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch, jira-1575-3.patch, jira-1575-4.patch, jira-1575-5.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Daniel Dai (JIRA) at Sep 6, 2010 at 5:40 am
    [ https://issues.apache.org/jira/browse/PIG-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Daniel Dai updated PIG-1575:
    ----------------------------

    Attachment: jira-1575-5.patch

    Patch looks good. Attach the final patch.

    test patch result:
    [exec] +1 overall.
    [exec]
    [exec] +1 @author. The patch does not contain any @author tags.
    [exec]
    [exec] +1 tests included. The patch appears to include 6 new or modified tests.
    [exec]
    [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
    [exec]
    [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
    [exec]
    [exec] +1 findbugs. The patch does not introduce any new Findbugs warnings.
    [exec]
    [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.

    All tests pass.

    Patch committed to both trunk and 0.8 branch.
    Complete the migration of optimization rule PushUpFilter including missing test cases
    -------------------------------------------------------------------------------------

    Key: PIG-1575
    URL: https://issues.apache.org/jira/browse/PIG-1575
    Project: Pig
    Issue Type: Bug
    Reporter: Xuefu Zhang
    Assignee: Xuefu Zhang
    Fix For: 0.8.0

    Attachments: jira-1575-1.patch, jira-1575-2.patch, jira-1575-3.patch, jira-1575-4.patch, jira-1575-5.patch


    The Optimization rule under the new logical plan, PushUpFilter, only does a subset of optimization scenarios compared to the same rule under the old logical plan. For instance, it only considers filter after join, but the old optimization also considers other operators such as CoGroup, Union, Cross, etc. The migration of the rule should be complete.
    Also, the test cases created for testing the old PushUpFilter wasn't migrated to the new logical plan code base. It should be also migrated. (A few has been migrated in JIRA-1574.)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedAug 27, '10 at 7:18p
activeSep 6, '10 at 5:40a
posts11
users1
websitepig.apache.org

1 user in discussion

Daniel Dai (JIRA): 11 posts

People

Translate

site design / logo © 2022 Grokbase