Grokbase Groups Pig dev July 2010
FAQ
Add -q command line option to set queue name for Pig jobs from command line
---------------------------------------------------------------------------

Key: PIG-1495
URL: https://issues.apache.org/jira/browse/PIG-1495
Project: Pig
Issue Type: New Feature
Components: impl
Affects Versions: 0.7.0
Reporter: Russell Jurney
Fix For: 0.8.0


rjurney$ pig -q default

This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.

Patch attached.

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Russell Jurney (JIRA) at Jul 12, 2010 at 9:48 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Russell Jurney updated PIG-1495:
    --------------------------------

    Attachment: set_queue.patch
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Russell Jurney (JIRA) at Jul 12, 2010 at 10:35 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Russell Jurney updated PIG-1495:
    --------------------------------

    Status: Patch Available (was: Open)
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Russell Jurney (JIRA) at Jul 12, 2010 at 10:52 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Russell Jurney updated PIG-1495:
    --------------------------------

    Status: Open (was: Patch Available)
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Russell Jurney (JIRA) at Jul 12, 2010 at 11:23 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887585#action_12887585 ]

    Russell Jurney commented on PIG-1495:
    -------------------------------------

    This doesn't work yet. Doh!
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Richard Ding (JIRA) at Jul 13, 2010 at 5:18 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12887851#action_12887851 ]

    Richard Ding commented on PIG-1495:
    -----------------------------------


    Pig trunk now utilizes Hadoop GenericOptionsParser which supports generic options:

    {code}
    -conf <configuration file> specify a configuration file
    -D <property=value> use value for given property
    -fs <local|namenode:port> specify a namenode
    -jt <local|jobtracker:port> specify a job tracker
    -files <comma separated list of files> specify comma separated
    files to be copied to the map reduce cluster
    -libjars <comma separated list of jars> specify comma separated
    jar files to include in the classpath.
    -archives <comma separated list of archives> specify comma
    separated archives to be unarchived on the compute machines.
    {code}

    So you can use option -Dmapred.job.queue.name=<queue name>.
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Jul 14, 2010 at 10:35 am
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888279#action_12888279 ]

    Hadoop QA commented on PIG-1495:
    --------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12449293/set_queue.patch
    against trunk revision 963830.

    +1 @author. The patch does not contain any @author tags.

    -1 tests included. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    +1 javadoc. The javadoc tool did not generate any warning messages.

    +1 javac. The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs. The patch does not introduce any new Findbugs warnings.

    +1 release audit. The applied patch does not increase the total number of release audit warnings.

    +1 core tests. The patch passed core unit tests.

    -1 contrib tests. The patch failed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Console output: http://hudson.zones.apache.org/hudson/job/Pig-Patch-h7.grid.sp2.yahoo.net/368/console

    This message is automatically generated.
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Olga Natkovich (JIRA) at Jul 14, 2010 at 5:51 pm
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12888452#action_12888452 ]

    Olga Natkovich commented on PIG-1495:
    -------------------------------------

    Russel, are you ok with proposal from Richard? Can we close this?
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Olga Natkovich (JIRA) at Jul 27, 2010 at 12:42 am
    [ https://issues.apache.org/jira/browse/PIG-1495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Olga Natkovich resolved PIG-1495.
    ---------------------------------

    Resolution: Fixed

    closing since we did not see any objections to the approach. Please, reopen if further discussion is needed
    Add -q command line option to set queue name for Pig jobs from command line
    ---------------------------------------------------------------------------

    Key: PIG-1495
    URL: https://issues.apache.org/jira/browse/PIG-1495
    Project: Pig
    Issue Type: New Feature
    Components: impl
    Affects Versions: 0.7.0
    Reporter: Russell Jurney
    Fix For: 0.8.0

    Attachments: set_queue.patch


    rjurney$ pig -q default
    This sets the mapred.job.queue.name property in the execution engine from the pig properties for MAPRED type jobs.
    Patch attached.
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categoriespig, hadoop
postedJul 12, '10 at 9:45p
activeJul 27, '10 at 12:42a
posts9
users1
websitepig.apache.org

1 user in discussion

Olga Natkovich (JIRA): 9 posts

People

Translate

site design / logo © 2022 Grokbase