Grokbase Groups Hive user June 2011
FAQ
By default, all Hive clients log to the same file called hive.log via DRFA. What I'm seeing is that many log lines are "lost" after hive.log is rolled over to hive.log.YYYY-MM-DD. Is this an issue with DRFA? What do folks do to avoid this problem when using concurrent Hive clients?

Thanks.
Steven

Search Discussions

  • Steven Wong at Jun 2, 2011 at 9:00 pm
    After researching on the web, the lost log lines is apparently an issue with DailyRollingFileAppender that may have been fixed in 1.2.16 (see https://issues.apache.org/bugzilla/show_bug.cgi?id=43374).

    On the other hand, DailyRollingFileAppender's documentation recommends using RollingFileAppender to avoid "synchronization issues and data loss."

    On the third hand, I really should look into using separate log files for separate Hive clients. Interleaved log lines from concurrent Hive clients make debugging difficult.


    From: Steven Wong
    Sent: Wednesday, June 01, 2011 6:32 PM
    To: user@hive.apache.org
    Subject: Hive logging concurrency

    By default, all Hive clients log to the same file called hive.log via DRFA. What I'm seeing is that many log lines are "lost" after hive.log is rolled over to hive.log.YYYY-MM-DD. Is this an issue with DRFA? What do folks do to avoid this problem when using concurrent Hive clients?

    Thanks.
    Steven

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedJun 2, '11 at 1:32a
activeJun 2, '11 at 9:00p
posts2
users1
websitehive.apache.org

1 user in discussion

Steven Wong: 2 posts

People

Translate

site design / logo © 2021 Grokbase