FAQ
Is there an index or job ID available at the Pig level for each of the child
MR jobs that a single script can spawn? It'd be great, for example, if I
could write:

SET job.name rolluptask-pig.job.index

Where pig.job.index is either an index value (1st child job, 2nd child job,
etc.) or the actual job ID.

Norbert

Search Discussions

  • Dmitriy Ryaboy at Sep 28, 2011 at 9:05 pm
    Not at the pig script level (among other things, all setting of vars happens before plan compilation so the order is wrong here). We might consider doing this for all pig jobs in pig internals though.
    On Sep 28, 2011, at 8:54 AM, Norbert Burger wrote:

    Is there an index or job ID available at the Pig level for each of the child
    MR jobs that a single script can spawn? It'd be great, for example, if I
    could write:

    SET job.name rolluptask-pig.job.index

    Where pig.job.index is either an index value (1st child job, 2nd child job,
    etc.) or the actual job ID.

    Norbert

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedSep 28, '11 at 3:54p
activeSep 28, '11 at 9:05p
posts2
users2
websitepig.apache.org

2 users in discussion

Norbert Burger: 1 post Dmitriy Ryaboy: 1 post

People

Translate

site design / logo © 2021 Grokbase