Grokbase Groups Pig user January 2010
FAQ
Hello,

Is there a (standard) way to output traces from within a custom PIG
UDF function (in order to see these traces inside the set of regular
traces ?)

Thanks

Search Discussions

  • Jeff Zhang at Jan 5, 2010 at 2:50 pm
    You can use log4j to print the exception message and you can see the message
    on the job tracker web ui.


    On Tue, Jan 5, 2010 at 5:16 AM, Vincent Barat wrote:

    Hello,

    Is there a (standard) way to output traces from within a custom PIG UDF
    function (in order to see these traces inside the set of regular traces ?)

    Thanks

    --
    Best Regards

    Jeff Zhang
  • Vincent Barat at Jan 5, 2010 at 3:03 pm
    I've tested this, it works in local mode but it doesn't works when
    your UDF code is executed in a separate process (in cluster mode).

    Le 05/01/10 15:49, Jeff Zhang a écrit :
    You can use log4j to print the exception message and you can see the message
    on the job tracker web ui.



    On Tue, Jan 5, 2010 at 5:16 AM, Vincent Baratwrote:
    Hello,

    Is there a (standard) way to output traces from within a custom PIG UDF
    function (in order to see these traces inside the set of regular traces ?)

    Thanks
  • Alan Gates at Jan 5, 2010 at 6:32 pm
    In MR mode, the output of your UDFs will turn up in the logs of the
    map and reduce tasks, not in the pig log. There is currently no
    channel for pig to send log messages back from the cluster to your
    machine to put the messages in the pig log.

    Alan.
    On Jan 5, 2010, at 7:02 AM, Vincent Barat wrote:

    I've tested this, it works in local mode but it doesn't works when
    your UDF code is executed in a separate process (in cluster mode).

    Le 05/01/10 15:49, Jeff Zhang a écrit :
    You can use log4j to print the exception message and you can see
    the message
    on the job tracker web ui.



    On Tue, Jan 5, 2010 at 5:16 AM, Vincent Barat<vincent.barat@ubikod.com
    wrote:
    Hello,

    Is there a (standard) way to output traces from within a custom
    PIG UDF
    function (in order to see these traces inside the set of regular
    traces ?)

    Thanks
  • Vincent Barat at Jan 5, 2010 at 8:34 pm
    Thanks Alan for the explanation: fair enough !

    Le 05/01/10 19:32, Alan Gates a écrit :
    In MR mode, the output of your UDFs will turn up in the logs of the map
    and reduce tasks, not in the pig log. There is currently no channel for
    pig to send log messages back from the cluster to your machine to put
    the messages in the pig log.

    Alan.
    On Jan 5, 2010, at 7:02 AM, Vincent Barat wrote:

    I've tested this, it works in local mode but it doesn't works when
    your UDF code is executed in a separate process (in cluster mode).

    Le 05/01/10 15:49, Jeff Zhang a écrit :
    You can use log4j to print the exception message and you can see the
    message
    on the job tracker web ui.



    On Tue, Jan 5, 2010 at 5:16 AM, Vincent
    Baratwrote:
    Hello,

    Is there a (standard) way to output traces from within a custom PIG UDF
    function (in order to see these traces inside the set of regular
    traces ?)

    Thanks

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedJan 5, '10 at 1:17p
activeJan 5, '10 at 8:34p
posts5
users3
websitepig.apache.org

People

Translate

site design / logo © 2022 Grokbase