[Hadoop-common-user] "sleep 60" between "start-dfs.sh" and putting files. Is it normal?

[Hadoop-common-user] "sleep 60" between "start-dfs.sh" and putting files. Is it normal?

	Todd Lipcon
	Jun 19, 2009 at 1:22 pm

Hi Pavel,

You should use "hadoop dfsadmin -safemode wait" after starting your cluster.
This will wait for the namenode to exit "safe mode" so you can begin making
modifications.

-Todd

On Fri, Jun 19, 2009 at 9:03 AM, pavel kolodin wrote:

Hello.
How i can ensure that cluster is up?
Now i using "sleep 60" between "start-dfs.sh" and putting files to input...
Thanks.

Search Discussions

Discussion Posts

Pavel kolodin: Hello. How i can ensure that cluster is up? Now i using "sleep 60" between "start-dfs.sh" and putting files to input... Thanks.

Follow ups

Alex Loddengaard: Hey Pavel, It's also worth checking the number of data nodes that have registered with the name node, depending on what you're trying to do when HDFS is ready. Try this: hadoop dfsadmin -report | grep "Datanodes available" | awk '{ print $3 }' > - or - MIN_NODES=5 If you try to write HDFS data immediately after the name node is out of safe mode, you might get replication errors if data nodes haven't registered yet. Alex

Related Discussions

Discussion Navigation

view	thread \| post
posts	‹ prev \| 2 of 3 \| next ›

Discussion Overview

group	common-user @
categories	hadoop
posted	Jun 19, '09 at 12:03p
active	Jun 19, '09 at 6:06p
posts	3
users	3
website	hadoop.apache.org...
irc	#hadoop

font	variable	Hotkey: f
user style	avatars	Hotkey: a

[Hadoop-common-user] "sleep 60" between "start-dfs.sh" and putting files. Is it normal?

Search Discussions

Discussion Posts

Related Discussions

3 users in discussion