[Hadoop-common-user] hadoop ec2 tutorial, cluster has no datanodes

On 10/17/07 12:54 PM, "Tiger Uppercut" wrote:

Hi,

I'm using the Hadoop 0.14.1 AMI as my master node [ami-64f6130d], and
I've followed up to "test your cluster" bit of the tutorial listed
here:

http://wiki.apache.org/lucene-hadoop/AmazonEC2

However, when I try to run the following command,

$ bin/hadoop jar hadoop-*-examples.jar pi 10 10000000

I get an error "Failed to create file /user/root/test-mini-mr/in/part0
on client 127.0.0.1 because this cluster has no datanodes."

Specifically:

org.apache.hadoop.ipc.RemoteException: java.io.IOException: Failed to
create file /user/root/test-mini-mr/in/part0 on client 127.0.0.1
because this cluster has no datanodes.
at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:739)

According to the following thread [
http://mail-archives.apache.org/mod_mbox/lucene-hadoop-user/200706.mbox/%3C466
DA5DB.9070808@yahoo-inc.com%3E
], I need to check my ip-addresses.

My dynDNS settings are as follows.

hostname: something.webhop.org
wildcard: true
service type: host with IP address
ip address: xx.yy.zz.aa
webhop: http://ec2-xx-yy-zz-aa.z-1.compute-1.amazonaws.com/



For reference, my hadoop-site.xml file is:

<configuration>

<property>
<name>hadoop.tmp.dir</name>
<value>/mnt/hadoop</value>
</property>

<property>
<name>fs.default.name</name>
<value>localhost:50001</value>
</property>

<property>
<name>mapred.job.tracker</name>
<value>localhost:50002</value>
</property>

</configuration>



Any tips would be very welcome...!

Thanks!

[I've also posted this to Amazon's EC2 forum.]

On 17/10/2007, Tiger Uppercut wrote:
Hi,

I'm using the Hadoop 0.14.1 AMI as my master node [ami-64f6130d], and
I've followed up to "test your cluster" bit of the tutorial listed
here:

http://wiki.apache.org/lucene-hadoop/AmazonEC2

However, when I try to run the following command,

$ bin/hadoop jar hadoop-*-examples.jar pi 10 10000000

I get an error "Failed to create file /user/root/test-mini-mr/in/part0
on client 127.0.0.1 because this cluster has no datanodes."

Specifically:

org.apache.hadoop.ipc.RemoteException: java.io.IOException: Failed to
create file /user/root/test-mini-mr/in/part0 on client 127.0.0.1
because this cluster has no datanodes.
at org.apache.hadoop.dfs.FSNamesystem.startFile(FSNamesystem.java:739)

According to the following thread [
http://mail-archives.apache.org/mod_mbox/lucene-hadoop-user/200706.mbox/%3C466DA5DB.9070808@yahoo-inc.com%3E
], I need to check my ip-addresses.

My dynDNS settings are as follows.

hostname: something.webhop.org
wildcard: true
service type: host with IP address
ip address: xx.yy.zz.aa
webhop: http://ec2-xx-yy-zz-aa.z-1.compute-1.amazonaws.com/



For reference, my hadoop-site.xml file is:

<configuration>

<property>
<name>hadoop.tmp.dir</name>
<value>/mnt/hadoop</value>
</property>

<property>
<name>fs.default.name</name>
<value>localhost:50001</value>
</property>

<property>
<name>mapred.job.tracker</name>
<value>localhost:50002</value>
</property>

</configuration>



Any tips would be very welcome...!

Thanks!

[I've also posted this to Amazon's EC2 forum.]

On 10/17/07, Tom White wrote:

How many instances are you running (what did you set NO_INSTANCES to)?
Can you connect to the other instances (look in the slaves file for
their addresses) and verify that datanodes are indeed running?

Tom