[Hadoop-common-dev] Re: Is there a good way to see how full hdfs is

[Hadoop-common-dev] Re: Is there a good way to see how full hdfs is

	Uma Maheswara Rao G 72686
	Oct 15, 2011 at 11:52 am

/** Return the disk usage of the filesystem, including total capacity,
* used space, and remaining space */
public DiskStatus getDiskStatus() throws IOException {
return dfs.getDiskStatus();
}

DistributedFileSystem has the above API from java API side.

Regards,
Uma

----- Original Message -----
From: wd <[email protected]>
Date: Saturday, October 15, 2011 4:16 pm
Subject: Re: Is there a good way to see how full hdfs is
To: [email protected]

hadoop dfsadmin -report

On Sat, Oct 15, 2011 at 8:16 AM, Steve Lewis
wrote:

We have a small cluster with HDFS running on only 8 nodes - I
believe that
the partition assigned to hdfs might be getting full and
wonder if the web tools or java api havew a way to look at free space on
hdfs

--
Steven M. Lewis PhD
4221 105th Ave NE
Kirkland, WA 98033
206-384-1340 (cell)
Skype lordjoe_com

Search Discussions

1 response
Oldest
Nested

Uma Maheswara Rao G 72686

at Oct 17, 2011 at 3:55 pm

⇧

We can write the simple program and you can call this API.

Make sure Hadoop jars presents in your class path.
Just for more clarification, DN will send their stats as parts of hertbeats, So, NN will maintain all the statistics about the diskspace usage for the complete filesystem and etc... This api will give you that stats.

Regards,
Uma

----- Original Message -----
From: [email protected]
Date: Monday, October 17, 2011 9:07 pm
Subject: Re: Is there a good way to see how full hdfs is
To: [email protected], [email protected]
Cc: [email protected]

So is there a client program to call this?

Can one write their own simple client to call this method from all
diskson the cluster?

How about a map reduce job to collect from all disks on the cluster?

On 10/15/11 4:51 AM, "Uma Maheswara Rao G 72686"
wrote:

/** Return the disk usage of the filesystem, including total
capacity,> * used space, and remaining space */
public DiskStatus getDiskStatus() throws IOException {
return dfs.getDiskStatus();
}

DistributedFileSystem has the above API from java API side.

Regards,
Uma

----- Original Message -----
From: wd <[email protected]>
Date: Saturday, October 15, 2011 4:16 pm
Subject: Re: Is there a good way to see how full hdfs is
To: [email protected]

hadoop dfsadmin -report

On Sat, Oct 15, 2011 at 8:16 AM, Steve Lewis
wrote:

reply | permalink

Related Discussions

Discussion Navigation

view	thread \| post

Discussion Overview

group	common-dev @
categories	hadoop
posted	Oct 15, '11 at 11:52a
active	Oct 17, '11 at 3:55p
posts	2
users	1
website	hadoop.apache.org...
irc	#hadoop

responses	expanded	Hotkey: s
font	variable	Hotkey: f
user style	avatars	Hotkey: a

[Hadoop-common-dev] Re: Is there a good way to see how full hdfs is

Search Discussions

Related Discussions

1 user in discussion