Grokbase Groups Pig dev January 2009
FAQ
memory sized passed on pig command line does not get propagated to JobConf
--------------------------------------------------------------------------

Key: PIG-647
URL: https://issues.apache.org/jira/browse/PIG-647
Project: Pig
Issue Type: Bug
Reporter: Olga Natkovich




--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Olga Natkovich (JIRA) at Jan 29, 2009 at 2:21 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668291#action_12668291 ]

    Olga Natkovich commented on PIG-647:
    ------------------------------------

    if we pass this on command line, we still see -Dmapred.child.java.opts="-Xmx1024m"' , we don't see this reflected in JobConf passed to hadoop.

    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Olga Natkovich (JIRA) at Jan 29, 2009 at 2:25 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Olga Natkovich reassigned PIG-647:
    ----------------------------------

    Assignee: Santhosh Srinivasan
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Arun C Murthy (JIRA) at Jan 29, 2009 at 8:30 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668374#action_12668374 ]

    Arun C Murthy commented on PIG-647:
    -----------------------------------

    Can we consider using org.apache.hadoop.uti.Tool (http://hadoop.apache.org/core/docs/r0.18.2/mapred_tutorial.html#Tool) ? You'd get all this for free...
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Santhosh Srinivasan (JIRA) at Jan 30, 2009 at 4:21 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Santhosh Srinivasan updated PIG-647:
    ------------------------------------

    Attachment: PIG-647.patch

    Attached patch fixes the issue with not passing the command line parameters to job configuration. The root cause of the issue was not overriding HOD's parameters with the command line parameters. There are no unit test cases as HOD testing is not covered in unit tests. Manual tests were performed to verify the fix.
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan
    Attachments: PIG-647.patch

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Alan Gates (JIRA) at Jan 30, 2009 at 4:27 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668743#action_12668743 ]

    Alan Gates commented on PIG-647:
    --------------------------------

    +1
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan
    Attachments: PIG-647.patch

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Santhosh Srinivasan (JIRA) at Jan 30, 2009 at 5:04 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12668748#action_12668748 ]

    Santhosh Srinivasan commented on PIG-647:
    -----------------------------------------

    All unit tests passed.
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan
    Attachments: PIG-647.patch

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Santhosh Srinivasan (JIRA) at Jan 30, 2009 at 5:08 am
    [ https://issues.apache.org/jira/browse/PIG-647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Santhosh Srinivasan resolved PIG-647.
    -------------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed]

    Patch has been committed.
    memory sized passed on pig command line does not get propagated to JobConf
    --------------------------------------------------------------------------

    Key: PIG-647
    URL: https://issues.apache.org/jira/browse/PIG-647
    Project: Pig
    Issue Type: Bug
    Reporter: Olga Natkovich
    Assignee: Santhosh Srinivasan
    Attachments: PIG-647.patch

    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedJan 29, '09 at 2:19a
activeJan 30, '09 at 5:08a
posts8
users1
websitepig.apache.org

1 user in discussion

Santhosh Srinivasan (JIRA): 8 posts

People

Translate

site design / logo © 2022 Grokbase