FAQ
How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?

Thanks.
Steven

Search Discussions

  • Ning Zhang at Sep 26, 2010 at 6:42 am
    hive -hiveconf hive.root.logger=DEBUG,DRFA

    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:

    How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?

    Thanks.
    Steven
  • Steven Wong at Sep 26, 2010 at 7:07 am
    Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?


    From: Ning Zhang
    Sent: Saturday, September 25, 2010 11:45 PM
    To: <hive-user@hadoop.apache.org>
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level

    hive -hiveconf hive.root.logger=DEBUG,DRFA

    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:


    How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?

    Thanks.
    Steven
  • Shrijeet Paliwal at Sep 26, 2010 at 8:51 am
    You need to set hadoop looging level to debug if you are looking at
    map task logs. I guess hadoop.root.logger is your friend.
    On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong wrote:

    Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?





    From: Ning Zhang
    Sent: Saturday, September 25, 2010 11:45 PM
    To: <hive-user@hadoop.apache.org>
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level



    hive -hiveconf hive.root.logger=DEBUG,DRFA



    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:

    How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?



    Thanks.

    Steven


  • Narendra at Sep 27, 2010 at 11:01 am
    Hi,

    I have a similar problem -

    I need to control the logging level and log file path for Hive (and Pig) at
    runtime from my shell script. Is there a way I could do that?

    Cheers!

    On Sun, Sep 26, 2010 at 2:20 PM, Shrijeet Paliwal
    wrote:
    You need to set hadoop looging level to debug if you are looking at
    map task logs. I guess hadoop.root.logger is your friend.
    On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong wrote:

    Tried your suggestion, but it still logs at INFO level in
    /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am
    I looking in the wrong file?




    From: Ning Zhang
    Sent: Saturday, September 25, 2010 11:45 PM
    To: <hive-user@hadoop.apache.org>
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level



    hive -hiveconf hive.root.logger=DEBUG,DRFA



    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:

    How can I control the logging level of Hive code that runs in the
    mappers/reducers? For example, how to set it to DEBUG?


    Thanks.

    Steven


  • Steven Wong at Sep 27, 2010 at 5:31 pm
    Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?


    -----Original Message-----
    From: Shrijeet Paliwal
    Sent: Sunday, September 26, 2010 1:51 AM
    To: hive-user@hadoop.apache.org
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level

    You need to set hadoop looging level to debug if you are looking at
    map task logs. I guess hadoop.root.logger is your friend.
    On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong wrote:

    Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?





    From: Ning Zhang
    Sent: Saturday, September 25, 2010 11:45 PM
    To: <hive-user@hadoop.apache.org>
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level



    hive -hiveconf hive.root.logger=DEBUG,DRFA



    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:

    How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?



    Thanks.

    Steven


  • Steven Wong at Sep 27, 2010 at 6:04 pm
    Hmm, it doesn't seem possible before MAPREDUCE-336 is fixed.


    -----Original Message-----
    From: Steven Wong
    Sent: Monday, September 27, 2010 10:31 AM
    To: hive-user@hadoop.apache.org
    Cc: <hive-dev@hadoop.apache.org>
    Subject: RE: Logging level

    Yes, I need a way to change the logging level of map/reduce tasks for the jobs of my Hive query, without affecting the logging level of other jobs or Hadoop daemons. How do I set hadoop.root.logger to do that?


    -----Original Message-----
    From: Shrijeet Paliwal
    Sent: Sunday, September 26, 2010 1:51 AM
    To: hive-user@hadoop.apache.org
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level

    You need to set hadoop looging level to debug if you are looking at
    map task logs. I guess hadoop.root.logger is your friend.
    On Sun, Sep 26, 2010 at 12:06 AM, Steven Wong wrote:

    Tried your suggestion, but it still logs at INFO level in /mnt/var/log/hadoop/userlogs/attempt_201008140123_5752_m_000018_0/syslog. Am I looking in the wrong file?





    From: Ning Zhang
    Sent: Saturday, September 25, 2010 11:45 PM
    To: <hive-user@hadoop.apache.org>
    Cc: <hive-dev@hadoop.apache.org>
    Subject: Re: Logging level



    hive -hiveconf hive.root.logger=DEBUG,DRFA



    On Sep 25, 2010, at 11:27 PM, Steven Wong wrote:

    How can I control the logging level of Hive code that runs in the mappers/reducers? For example, how to set it to DEBUG?



    Thanks.

    Steven


Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedSep 26, '10 at 6:27a
activeSep 27, '10 at 6:04p
posts7
users4
websitehive.apache.org

People

Translate

site design / logo © 2022 Grokbase