FAQ
I have a cluster with a master and 7 nodes when i try to start hadoop it
starts the mapreduce processes and the hdfs processes on all the nodes.
formated the hdfs but it says it is aborted and it does not complete When I
try to access the HDFS by making a new directory for example it throws some
errors and it dies.I have atached below the error messages that I get please
advise any ideas? Thanks in advance

ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop namenode
-format
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

11/02/04 16:36:59 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting NameNode
STARTUP_MSG: host = cannonau.isti.cnr.it/146.48.82.190
STARTUP_MSG: args = [-format]
STARTUP_MSG: version = 0.21.0

alot of directories

r:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../lib/*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/conf:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/hadoop-mapred-*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/lib/*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../hadoop-hdfs-*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../lib/*.jar
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.21 -r
985326; compiled by 'tomwhite' on Tue Aug 17 01:02:28 EDT 2010
************************************************************/
11/02/04 16:37:00 WARN common.Util: Path /tmp/mylocal/ should be specified
as a URI in configuration files. Please update hdfs configuration.
11/02/04 16:37:00 WARN common.Util: Path /tmp/mylocal/ should be specified
as a URI in configuration files. Please update hdfs configuration.
Re-format filesystem in /tmp/mylocal ? (Y or N) y
Format aborted in /tmp/mylocal
11/02/04 16:38:00 INFO namenode.NameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down NameNode at cannonau.isti.cnr.it/146.48.82.190
************************************************************/
ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$


log file message

ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/logs$
hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log
-bash: hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log: command not found
ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/logs$ tail
hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
at
org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:373)
at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:417)
at
org.apache.hadoop.ipc.Client$Connection.access$1900(Client.java:207)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1025)
at org.apache.hadoop.ipc.Client.call(Client.java:885)
... 5 more

message on the terminal i get

2011-02-04 16:26:54,999 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: localhost/127.0.0.1:9000. Already tried

ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop dfs -mkdir
in
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

11/02/04 16:28:22 INFO security.Groups: Group mapping
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout=300000
11/02/04 16:28:22 WARN conf.Configuration: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
11/02/04 16:28:24 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 0 time(s).
11/02/04 16:28:25 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 1 time(s).
11/02/04 16:28:26 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 2 time(s).
11/02/04 16:28:27 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 3 time(s).
11/02/04 16:28:28 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 4 time(s).
11/02/04 16:28:29 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 5 time(s).
11/02/04 16:28:30 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 6 time(s).
11/02/04 16:28:31 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 7 time(s).
11/02/04 16:28:32 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 8 time(s).
11/02/04 16:28:33 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 9 time(s).
Bad connection to FS. command aborted.
ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$




ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop dfs -mkdir
input
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

11/02/04 16:23:34 INFO security.Groups: Group mapping
impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
cacheTimeout=300000
11/02/04 16:23:34 WARN conf.Configuration: mapred.task.id is deprecated.
Instead, use mapreduce.task.attempt.id
11/02/04 16:23:35 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 0 time(s).
11/02/04 16:23:36 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 1 time(s).
11/02/04 16:23:37 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 2 time(s).
11/02/04 16:23:38 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 3 time(s).
11/02/04 16:23:39 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 4 time(s).
11/02/04 16:23:40 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 5 time(s).
11/02/04 16:23:41 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 6 time(s).
11/02/04 16:23:42 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 7 time(s).
11/02/04 16:23:43 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 8 time(s).
11/02/04 16:23:44 INFO ipc.Client: Retrying connect to server:
cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 9 time(s).
Bad connection to FS. command aborted.
ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$



--
View this message in context: http://old.nabble.com/Unable-to-accesss-the-HDFS-hadoop-.21-please-help-tp30845399p30845399.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.

Search Discussions

  • Aaron Eng at Feb 4, 2011 at 4:24 pm
    I think it wants you to type a capital Y, as silly as that may sound...

    On Feb 4, 2011, at 7:38 AM, ahmednagy wrote:


    I have a cluster with a master and 7 nodes when i try to start hadoop it
    starts the mapreduce processes and the hdfs processes on all the nodes.
    formated the hdfs but it says it is aborted and it does not complete When I
    try to access the HDFS by making a new directory for example it throws some
    errors and it dies.I have atached below the error messages that I get please
    advise any ideas? Thanks in advance

    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop namenode
    -format
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    11/02/04 16:36:59 INFO namenode.NameNode: STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting NameNode
    STARTUP_MSG: host = cannonau.isti.cnr.it/146.48.82.190
    STARTUP_MSG: args = [-format]
    STARTUP_MSG: version = 0.21.0

    alot of directories

    r:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../lib/*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/conf:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/hadoop-mapred-*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/bin/../mapred/lib/*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../hadoop-hdfs-*.jar:/home/ahmednagy/HadoopStandalone/hadoop-0.21.0/hdfs/bin/../lib/*.jar
    STARTUP_MSG: build =
    https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.21 -r
    985326; compiled by 'tomwhite' on Tue Aug 17 01:02:28 EDT 2010
    ************************************************************/
    11/02/04 16:37:00 WARN common.Util: Path /tmp/mylocal/ should be specified
    as a URI in configuration files. Please update hdfs configuration.
    11/02/04 16:37:00 WARN common.Util: Path /tmp/mylocal/ should be specified
    as a URI in configuration files. Please update hdfs configuration.
    Re-format filesystem in /tmp/mylocal ? (Y or N) y
    Format aborted in /tmp/mylocal
    11/02/04 16:38:00 INFO namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at cannonau.isti.cnr.it/146.48.82.190
    ************************************************************/
    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$


    log file message

    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/logs$
    hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log
    -bash: hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log: command not found
    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/logs$ tail
    hadoop-ahmednagy-datanode-cannonau.isti.cnr.it.log
    at
    sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:574)
    at
    org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
    at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:373)
    at
    org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:417)
    at
    org.apache.hadoop.ipc.Client$Connection.access$1900(Client.java:207)
    at org.apache.hadoop.ipc.Client.getConnection(Client.java:1025)
    at org.apache.hadoop.ipc.Client.call(Client.java:885)
    ... 5 more

    message on the terminal i get

    2011-02-04 16:26:54,999 INFO org.apache.hadoop.ipc.Client: Retrying connect
    to server: localhost/127.0.0.1:9000. Already tried

    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop dfs -mkdir
    in
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    11/02/04 16:28:22 INFO security.Groups: Group mapping
    impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
    cacheTimeout=300000
    11/02/04 16:28:22 WARN conf.Configuration: mapred.task.id is deprecated.
    Instead, use mapreduce.task.attempt.id
    11/02/04 16:28:24 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 0 time(s).
    11/02/04 16:28:25 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 1 time(s).
    11/02/04 16:28:26 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 2 time(s).
    11/02/04 16:28:27 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 3 time(s).
    11/02/04 16:28:28 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 4 time(s).
    11/02/04 16:28:29 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 5 time(s).
    11/02/04 16:28:30 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 6 time(s).
    11/02/04 16:28:31 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 7 time(s).
    11/02/04 16:28:32 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 8 time(s).
    11/02/04 16:28:33 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 9 time(s).
    Bad connection to FS. command aborted.
    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$




    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$ ./hadoop dfs -mkdir
    input
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    11/02/04 16:23:34 INFO security.Groups: Group mapping
    impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping;
    cacheTimeout=300000
    11/02/04 16:23:34 WARN conf.Configuration: mapred.task.id is deprecated.
    Instead, use mapreduce.task.attempt.id
    11/02/04 16:23:35 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 0 time(s).
    11/02/04 16:23:36 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 1 time(s).
    11/02/04 16:23:37 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 2 time(s).
    11/02/04 16:23:38 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 3 time(s).
    11/02/04 16:23:39 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 4 time(s).
    11/02/04 16:23:40 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 5 time(s).
    11/02/04 16:23:41 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 6 time(s).
    11/02/04 16:23:42 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 7 time(s).
    11/02/04 16:23:43 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 8 time(s).
    11/02/04 16:23:44 INFO ipc.Client: Retrying connect to server:
    cannonau.isti.cnr.it/146.48.82.190:8020. Already tried 9 time(s).
    Bad connection to FS. command aborted.
    ahmednagy@cannonau:~/HadoopStandalone/hadoop-0.21.0/bin$



    --
    View this message in context: http://old.nabble.com/Unable-to-accesss-the-HDFS-hadoop-.21-please-help-tp30845399p30845399.html
    Sent from the Hadoop core-user mailing list archive at Nabble.com.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-user @
categorieshadoop
postedFeb 4, '11 at 3:39p
activeFeb 4, '11 at 4:24p
posts2
users2
websitehadoop.apache.org...
irc#hadoop

2 users in discussion

Ahmednagy: 1 post Aaron Eng: 1 post

People

Translate

site design / logo © 2022 Grokbase