FAQ
Hi All ,
I have multinode cluster with 1 master (namenode,+ jobtracker) and
2 slavers (datanode + tasktracker).
I can start namenode and datanodes,but CANT start jobtracker.The
log shows java.lang.NumberFormatException.



I will be greatfull if anybody can tell me what is the problem and
why is this java execption being thrown?
here is the complete log , all the files value are
attached.(master,slaves,core-site.xml...etc)



************************************************************/
2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = centosxcat1/192.168.15.140
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
java.lang.NumberFormatException: For input string: "54311
"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:481)
at java.lang.Integer.parseInt(Integer.java:514)
at
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
at
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
at
org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
at org.apache.hadoop.mapred.JobTracker.(JobTracker.java:183)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)

2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
************************************************************/

cat conf/master
centosxcat1

cat conf/salves
aadityaxcat3
linux-466z

cat conf/core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. --><?xml
version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>
dfs.name.dir
</name>
<value>
/fsname
</value>
</property>
<property>
<name>
dfs.data.dir
</name>
<value>
/fsdata
</value>
</property>
<property>
<name>
dfs.replication
</name>
<value>
2
</value>
</property>
</configuration>


cat conf/mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

<!-- Put site-specific property overrides in this file. -->

<configuration>
<property>
<name>
mapred.job.tracker
</name>
<value>
centosxcat1:54311
</value>
</property>
</configuration>



<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://centosxcat1</value>
</property>
</configuration>



cat conf/hdfs-site.xml

Search Discussions

  • Todd Lipcon at Jun 15, 2010 at 4:59 pm
    Hi Ankit,

    You need to trim your configuration variables so there is no extra
    whitespace. eg <value>foo</value>, not:
    <value>
    foo
    </value>

    There's a patch up for this in many of the configs, but not sure if we got
    mapred.job.tracker.

    -Todd
    On Tue, Jun 15, 2010 at 5:55 AM, ankit sharma wrote:

    Hi All ,
    I have multinode cluster with 1 master (namenode,+ jobtracker) and
    2 slavers (datanode + tasktracker).
    I can start namenode and datanodes,but CANT start jobtracker.The
    log shows java.lang.NumberFormatException.



    I will be greatfull if anybody can tell me what is the problem and
    why is this java execption being thrown?
    here is the complete log , all the files value are
    attached.(master,slaves,core-site.xml...etc)



    ************************************************************/
    2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
    STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting JobTracker
    STARTUP_MSG: host = centosxcat1/192.168.15.140
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 0.20.2
    STARTUP_MSG: build =
    https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
    911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
    ************************************************************/
    2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
    configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
    limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
    2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
    java.lang.NumberFormatException: For input string: "54311
    "
    at

    java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
    at java.lang.Integer.parseInt(Integer.java:481)
    at java.lang.Integer.parseInt(Integer.java:514)
    at
    org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
    at
    org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
    at
    org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
    at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579)
    at
    org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
    at
    org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
    at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)

    2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
    SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
    ************************************************************/

    cat conf/master
    centosxcat1

    cat conf/salves
    aadityaxcat3
    linux-466z

    cat conf/core-site.xml
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. --><?xml
    version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. -->

    <configuration>
    <property>
    <name>
    dfs.name.dir
    </name>
    <value>
    /fsname
    </value>
    </property>
    <property>
    <name>
    dfs.data.dir
    </name>
    <value>
    /fsdata
    </value>
    </property>
    <property>
    <name>
    dfs.replication
    </name>
    <value>
    2
    </value>
    </property>
    </configuration>


    cat conf/mapred-site.xml
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. -->

    <configuration>
    <property>
    <name>
    mapred.job.tracker
    </name>
    <value>
    centosxcat1:54311
    </value>
    </property>
    </configuration>



    <configuration>
    <property>
    <name>fs.default.name</name>
    <value>hdfs://centosxcat1</value>
    </property>
    </configuration>



    cat conf/hdfs-site.xml


    --
    Todd Lipcon
    Software Engineer, Cloudera
  • Ankit sharma at Jun 15, 2010 at 8:04 pm
    Hi ,
    I got the mistake, It was unwanted newline in mapred-site.xml in
    mapred.job.tracker.

    On Tue, Jun 15, 2010 at 6:25 PM, ankit sharma wrote:

    Hi All ,
    I have multinode cluster with 1 master (namenode,+ jobtracker) and
    2 slavers (datanode + tasktracker).
    I can start namenode and datanodes,but CANT start jobtracker.The
    log shows java.lang.NumberFormatException.



    I will be greatfull if anybody can tell me what is the problem and
    why is this java execption being thrown?
    here is the complete log , all the files value are
    attached.(master,slaves,core-site.xml...etc)



    ************************************************************/
    2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
    STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting JobTracker
    STARTUP_MSG: host = centosxcat1/192.168.15.140
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 0.20.2
    STARTUP_MSG: build =
    https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
    911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
    ************************************************************/
    2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
    configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
    limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
    2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
    java.lang.NumberFormatException: For input string: "54311
    "
    at
    java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
    at java.lang.Integer.parseInt(Integer.java:481)
    at java.lang.Integer.parseInt(Integer.java:514)
    at
    org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
    at
    org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
    at
    org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
    at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579)
    at
    org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
    at
    org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
    at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)

    2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
    SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
    ************************************************************/

    cat conf/master
    centosxcat1

    cat conf/salves
    aadityaxcat3
    linux-466z

    cat conf/core-site.xml
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. --><?xml
    version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. -->

    <configuration>
    <property>
    <name>
    dfs.name.dir
    </name>
    <value>
    /fsname
    </value>
    </property>
    <property>
    <name>
    dfs.data.dir
    </name>
    <value>
    /fsdata
    </value>
    </property>
    <property>
    <name>
    dfs.replication
    </name>
    <value>
    2
    </value>
    </property>
    </configuration>


    cat conf/mapred-site.xml
    <?xml version="1.0"?>
    <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>

    <!-- Put site-specific property overrides in this file. -->

    <configuration>
    <property>
    <name>
    mapred.job.tracker
    </name>
    <value>
    centosxcat1:54311
    </value>
    </property>
    </configuration>



    <configuration>
    <property>
    <name>fs.default.name</name>
    <value>hdfs://centosxcat1</value>
    </property>
    </configuration>



    cat conf/hdfs-site.xml




Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedJun 15, '10 at 4:13p
activeJun 15, '10 at 8:04p
posts3
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Ankit sharma: 2 posts Todd Lipcon: 1 post

People

Translate

site design / logo © 2022 Grokbase