[Hadoop-common-user] Cleaning jobcache manually

On Wed, Feb 10, 2010 at 1:45 PM, Marcus Herou wrote:

Hi.

We run hadoop-0.18.3 and it seems that the jobcache does not get cleaned
out
properly.

Would this cron script be to any harm to hadoop ?

# Clean all files which are two or more days old
/usr/bin/find ${JOB_CACHE_PATH} -type f -mtime +2 -exec rm {} \;

Need to start cleaning today so hoping for quick response.

Cheers

//Marcus Herou


--
Marcus Herou CTO and co-founder Tailsweep AB
+46702561312
[email protected]
http://www.tailsweep.com/

On 2/10/10 12:15 AM, "Marcus Herou" wrote:
We run hadoop-0.18.3 and it seems that the jobcache does not get cleaned out
properly.

Would this cron script be to any harm to hadoop ?

# Clean all files which are two or more days old
/usr/bin/find ${JOB_CACHE_PATH} -type f -mtime +2 -exec rm {} \;

Need to start cleaning today so hoping for quick response.

We do it something similar, but wait for it to be 7 days long in case we
have a particularly long running job.