FAQ
Hello all,

I am new to Hadoop, and have been trying to use the latest stable
release(0.20.1). When I tried the grep example in the pseudo-distributed
mode the hadoop's fs -put command results in SocketException. Socket's
getSendBufferSize method is throwing this error.

Here is the relevant log.

09/12/24 08:41:53 DEBUG hdfs.DFSClient: /user/root/ivy.xml: masked=rwxr-xr-x
09/12/24 08:41:53 DEBUG hdfs.DFSClient: computePacketChunkSize:
src=/user/root/ivy.xml, chunkSize=516, chunksPerPacket=127, packetSize=65557
09/12/24 08:41:53 DEBUG hdfs.DFSClient: DFSClient writeChunk allocating new
packet seqno=0, src=/user/root/ivy.xml, packetSize=65557,
chunksPerPacket=127, bytesCurBlock=0
09/12/24 08:41:53 DEBUG hdfs.DFSClient: Allocating new block
09/12/24 08:41:53 DEBUG hdfs.DFSClient: pipeline = 127.0.0.1:50010
09/12/24 08:41:53 DEBUG hdfs.DFSClient: Connecting to 127.0.0.1:50010
09/12/24 08:41:53 DEBUG hdfs.DFSClient: after setSendBufferSize, before
getSendBufferSize
09/12/24 08:41:53 INFO hdfs.DFSClient: Exception in getSendBufferSize
java.net.SocketException: Protocol not available

One weird thing I observed on the server is that the JobTracker is making a
connection to namenode(on port 50010) every couple of seconds and doesn't
stop! There is no activity on the connection, just the SYN, SYN-ACK and ACK
sequence. Not sure if this is the root cause of the problem or a symptom of
some other root cause. Any help in getting past this hurdle is appreciated.

Config files on the server that have been modified are:

ssheng:/home/hadoop/hadoop-0.20.1/conf # cat core-site.xml hdfs-site.xml
mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
</configuration>
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>mapred.job.tracker</name>
<value>localhost:9001</value>
</property>
</configuration>

Cheers,
Konda

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedDec 24, '09 at 5:04p
activeDec 24, '09 at 5:04p
posts1
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Konda Ankireddyapalli: 1 post

People

Translate

site design / logo © 2022 Grokbase