FAQ
Hi,

I am using hadoop 0.16.3 in a production environment.
We have been using our system for a few weeks already
and are constantly running out of inodes.

We added cron job to clean the logs generated by tasktraskers/
jobtrackers,
but i am now doubting we are catching them all.

Anybody has an idea of what to clean periodically?

Are there any temp files generated by the jobs/tasks that need to be
cleaned as well?

Thanks a lot of any input.

Steph.





______________________________________________________________________
This email has been scanned by the MessageLabs Email Security System.
For more information please visit http://www.messagelabs.com/email
______________________________________________________________________

Search Discussions

  • Arun C Murthy at Aug 12, 2008 at 11:58 pm

    On Aug 12, 2008, at 11:01 AM, stephanebrossier wrote:

    Hi,

    I am using hadoop 0.16.3 in a production environment.
    We have been using our system for a few weeks already
    and are constantly running out of inodes.
    We've fixed related bugs in 0.17.2 - it should be released in the next
    couple of days.
    You might want to track http://issues.apache.org/jira/browse/
    HADOOP-3386 too.

    Arun
    We added cron job to clean the logs generated by tasktraskers/
    jobtrackers,
    but i am now doubting we are catching them all.

    Anybody has an idea of what to clean periodically?

    Are there any temp files generated by the jobs/tasks that need to be
    cleaned as well?

    Thanks a lot of any input.

    Steph.





    ______________________________________________________________________
    This email has been scanned by the MessageLabs Email Security System.
    For more information please visit http://www.messagelabs.com/email______________________________________________________________________

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedAug 12, '08 at 6:06p
activeAug 12, '08 at 11:58p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Arun C Murthy: 1 post Stephanebrossier: 1 post

People

Translate

site design / logo © 2022 Grokbase