FAQ
Hi,

I am using a small cluster of 1 master node and 2 salves. The tasktracker
log in slaves are increasing in size approximately 1mb per second. This
results in disk space getting low over time. This happens even if no job is
running. Please suggest ways to slow down the size of the log file. Also I
would like to know why the log files are written even if there is no jobs
running.

--
With Regards,
Karthik

Search Discussions

  • Joey Echeverria at May 23, 2011 at 12:46 pm
    Hi Karthik,

    FYI, I'm moving this thread to mapreduce-user@hadoop.apache.org (You
    and common-user are BCCed).

    My guess is that your task trackers are throwing a lot of exceptions
    which are getting logged. Can you send a snippet of the logs to help
    diagnose why it's logging so much? Can you also let us know what
    logging level you currently have enabled?

    -Joey
    On Mon, May 23, 2011 at 8:30 AM, Karthik Kumar wrote:
    Hi,

    I am using a small cluster of 1 master node and 2 salves. The tasktracker
    log in slaves are increasing in size approximately 1mb per second. This
    results in disk space getting low over time. This happens even if no job is
    running. Please suggest ways to slow down the size of the log file. Also I
    would like to know why the log files are written even if there is no jobs
    running.

    --
    With Regards,
    Karthik


    --
    Joseph Echeverria
    Cloudera, Inc.
    443.305.9434

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedMay 23, '11 at 12:30p
activeMay 23, '11 at 12:46p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Karthik Kumar: 1 post Joey Echeverria: 1 post

People

Translate

site design / logo © 2022 Grokbase