FAQ
Hi ,
I setup a 4 node cluster using cloudera manager and trying to add the
services to it.

I added a HDFS service and when i am trying to add YARN service, i am
facing problem as the nodemanager is giving error.

the logs hadoop-cmf-yarn1-NODEMANAGER-smvm1.log.out says the following
error.

2013-05-28 19:24:45,353 INFO
org.apache.hadoop.yarn.service.AbstractService:
Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is
stopped.
2013-05-28 19:24:45,353 FATAL
org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting
NodeManager
org.apache.hadoop.yarn.YarnException: Failed to Start
org.apache.hadoop.yarn.server.nodemanager.NodeManager
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:176)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:274)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:291)
Caused by: org.apache.hadoop.yarn.YarnException: Failed to Start
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.start(ContainerManagerImpl.java:246)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
... 3 more
Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to:
0.0.0.0/0.0.0.0:8080
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:303)
at org.apache.hadoop.mapred.ShuffleHandler.start(ShuffleHandler.java:298)
at
org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.start(AuxServices.java:123)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
... 5 more
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
at
org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.bind(NioServerSocketPipelineSink.java:148)
at
org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleServerSocket(NioServerSocketPipelineSink.java:100)
at
org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:74)
at org.jboss.netty.channel.Channels.bind(Channels.java:468)
at org.jboss.netty.channel.AbstractChannel.bind(AbstractChannel.java:200)
at
org.jboss.netty.bootstrap.ServerBootstrap$Binder.channelOpen(ServerBootstrap.java:348)
at org.jboss.netty.channel.Channels.fireChannelOpen(Channels.java:176)
at
org.jboss.netty.channel.socket.nio.NioServerSocketChannel.(NioServerSocketChannelFactory.java:142)
at
org.jboss.netty.channel.socket.nio.NioServerSocketChannelFactory.newChannel(NioServerSocketChannelFactory.java:90)
at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:282)
... 8 more
2013-05-28 19:24:45,358 INFO org.apache.hadoop.ipc.Server: Stopping server
on 8041
2013-05-28 19:24:45,358 INFO org.apache.hadoop.ipc.Server: Stopping server
on 8040
2013-05-28 19:24:45,353 INFO org.apache.hadoop.ipc.Server: Stopping IPC
Server listener on 8041
2013-05-28 19:24:45,358 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager
metrics system...
2013-05-28 19:24:45,359 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics
system stopped.
2013-05-28 19:24:45,359 INFO
org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics
system shutdown complete.
2013-05-28 19:24:45,359 INFO
org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:
/************************************************************


port 8080 is not used in any of the configuration and still i didnt
understand why i am getting this error.
Please help

Search Discussions

  • Harsh J at May 28, 2013 at 7:03 am
    Port 8080 is a rather common port with developers unfortunately, and
    the error of it being in use (EADDRINUSE) wouldn't be a lie from
    Linux.

    Can you run, as root, "netstat -anp | grep 8080" to find any other
    process that may be using it in your environment (on the Nodemanager
    box specifically)? You can either kill it away/reconfigure NM to use
    another port.

    On Tue, May 28, 2013 at 11:12 AM, srikanth ayalasomayajulu
    wrote:
    Hi ,
    I setup a 4 node cluster using cloudera manager and trying to add the
    services to it.

    I added a HDFS service and when i am trying to add YARN service, i am facing
    problem as the nodemanager is giving error.

    the logs hadoop-cmf-yarn1-NODEMANAGER-smvm1.log.out says the following
    error.

    2013-05-28 19:24:45,353 INFO org.apache.hadoop.yarn.service.AbstractService:
    Service:org.apache.hadoop.yarn.server.nodemanager.DeletionService is
    stopped.
    2013-05-28 19:24:45,353 FATAL
    org.apache.hadoop.yarn.server.nodemanager.NodeManager: Error starting
    NodeManager
    org.apache.hadoop.yarn.YarnException: Failed to Start
    org.apache.hadoop.yarn.server.nodemanager.NodeManager
    at
    org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
    at
    org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:176)
    at
    org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:274)
    at
    org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:291)
    Caused by: org.apache.hadoop.yarn.YarnException: Failed to Start
    org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl
    at
    org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
    at
    org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.start(ContainerManagerImpl.java:246)
    at
    org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
    ... 3 more
    Caused by: org.jboss.netty.channel.ChannelException: Failed to bind to:
    0.0.0.0/0.0.0.0:8080
    at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:303)
    at org.apache.hadoop.mapred.ShuffleHandler.start(ShuffleHandler.java:298)
    at
    org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.start(AuxServices.java:123)
    at
    org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
    ... 5 more
    Caused by: java.net.BindException: Address already in use
    at sun.nio.ch.Net.bind(Native Method)
    at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.bind(NioServerSocketPipelineSink.java:148)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.handleServerSocket(NioServerSocketPipelineSink.java:100)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketPipelineSink.eventSunk(NioServerSocketPipelineSink.java:74)
    at org.jboss.netty.channel.Channels.bind(Channels.java:468)
    at org.jboss.netty.channel.AbstractChannel.bind(AbstractChannel.java:200)
    at
    org.jboss.netty.bootstrap.ServerBootstrap$Binder.channelOpen(ServerBootstrap.java:348)
    at org.jboss.netty.channel.Channels.fireChannelOpen(Channels.java:176)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketChannel.<init>(NioServerSocketChannel.java:85)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketChannelFactory.newChannel(NioServerSocketChannelFactory.java:142)
    at
    org.jboss.netty.channel.socket.nio.NioServerSocketChannelFactory.newChannel(NioServerSocketChannelFactory.java:90)
    at org.jboss.netty.bootstrap.ServerBootstrap.bind(ServerBootstrap.java:282)
    ... 8 more
    2013-05-28 19:24:45,358 INFO org.apache.hadoop.ipc.Server: Stopping server
    on 8041
    2013-05-28 19:24:45,358 INFO org.apache.hadoop.ipc.Server: Stopping server
    on 8040
    2013-05-28 19:24:45,353 INFO org.apache.hadoop.ipc.Server: Stopping IPC
    Server listener on 8041
    2013-05-28 19:24:45,358 INFO
    org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping NodeManager
    metrics system...
    2013-05-28 19:24:45,359 INFO
    org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics
    system stopped.
    2013-05-28 19:24:45,359 INFO
    org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NodeManager metrics
    system shutdown complete.
    2013-05-28 19:24:45,359 INFO
    org.apache.hadoop.yarn.server.nodemanager.NodeManager: SHUTDOWN_MSG:
    /************************************************************


    port 8080 is not used in any of the configuration and still i didnt
    understand why i am getting this error.
    Please help


    --
    Harsh J

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedMay 28, '13 at 5:42a
activeMay 28, '13 at 7:03a
posts2
users2
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase