FAQ
Cannot obtain block errors
--------------------------

Key: HADOOP-258
URL: http://issues.apache.org/jira/browse/HADOOP-258
Project: Hadoop
Type: Bug

Components: dfs
Versions: 0.3
Reporter: Owen O'Malley
Assigned to: Sameer Paranjpye


I've been seeing a lot of errors from dfs for the last couple days. The exception that I see is:

java.io.IOException: Could not obtain block: blk_2867431916903738534 file=/user/oom/big-rand/part000271 offset=0 at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:532) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:641) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:83) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:158) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:264) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:248) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:238) at org.apache.hadoop.mapred.SequenceFileRecordReader.(SequenceFileRecordReader.java:36) at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:105) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:866)

I haven't had my fingers in that code recently, does it ring any bells for anyone?

--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see:
http://www.atlassian.com/software/jira

Search Discussions

  • Sameer Paranjpye (JIRA) at May 31, 2006 at 12:32 am
    [ http://issues.apache.org/jira/browse/HADOOP-258?page=all ]

    Sameer Paranjpye updated HADOOP-258:
    ------------------------------------

    Fix Version: 0.4
    Cannot obtain block errors
    --------------------------

    Key: HADOOP-258
    URL: http://issues.apache.org/jira/browse/HADOOP-258
    Project: Hadoop
    Type: Bug
    Components: dfs
    Versions: 0.3
    Reporter: Owen O'Malley
    Assignee: Sameer Paranjpye
    Fix For: 0.4
    I've been seeing a lot of errors from dfs for the last couple days. The exception that I see is:
    java.io.IOException: Could not obtain block: blk_2867431916903738534 file=/user/oom/big-rand/part000271 offset=0 at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:532) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:641) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:83) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:158) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:264) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:248) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:238) at org.apache.hadoop.mapred.SequenceFileRecordReader.(SequenceFileRecordReader.java:36) at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:105) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:866)
    I haven't had my fingers in that code recently, does it ring any bells for anyone?
    --
    This message is automatically generated by JIRA.
    -
    If you think it was sent incorrectly contact one of the administrators:
    http://issues.apache.org/jira/secure/Administrators.jspa
    -
    For more information on JIRA, see:
    http://www.atlassian.com/software/jira
  • Doug Cutting (JIRA) at Jun 28, 2006 at 9:14 pm
    [ http://issues.apache.org/jira/browse/HADOOP-258?page=all ]

    Doug Cutting updated HADOOP-258:
    --------------------------------

    Fix Version: 0.5.0
    (was: 0.4.0)
    Cannot obtain block errors
    --------------------------

    Key: HADOOP-258
    URL: http://issues.apache.org/jira/browse/HADOOP-258
    Project: Hadoop
    Type: Bug
    Components: dfs
    Versions: 0.3.0
    Reporter: Owen O'Malley
    Assignee: Sameer Paranjpye
    Fix For: 0.5.0
    I've been seeing a lot of errors from dfs for the last couple days. The exception that I see is:
    java.io.IOException: Could not obtain block: blk_2867431916903738534 file=/user/oom/big-rand/part000271 offset=0 at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:532) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:641) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:83) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:158) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:264) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:248) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:238) at org.apache.hadoop.mapred.SequenceFileRecordReader.(SequenceFileRecordReader.java:36) at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:105) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:866)
    I haven't had my fingers in that code recently, does it ring any bells for anyone?
    --
    This message is automatically generated by JIRA.
    -
    If you think it was sent incorrectly contact one of the administrators:
    http://issues.apache.org/jira/secure/Administrators.jspa
    -
    For more information on JIRA, see:
    http://www.atlassian.com/software/jira
  • Sameer Paranjpye (JIRA) at Aug 15, 2006 at 9:38 pm
    [ http://issues.apache.org/jira/browse/HADOOP-258?page=all ]

    Sameer Paranjpye resolved HADOOP-258.
    -------------------------------------

    Resolution: Cannot Reproduce
    Cannot obtain block errors
    --------------------------

    Key: HADOOP-258
    URL: http://issues.apache.org/jira/browse/HADOOP-258
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.3.0
    Reporter: Owen O'Malley
    Assigned To: Sameer Paranjpye
    Fix For: 0.6.0


    I've been seeing a lot of errors from dfs for the last couple days. The exception that I see is:
    java.io.IOException: Could not obtain block: blk_2867431916903738534 file=/user/oom/big-rand/part000271 offset=0 at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:532) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:641) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:83) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:158) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:264) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:248) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:238) at org.apache.hadoop.mapred.SequenceFileRecordReader.(SequenceFileRecordReader.java:36) at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:105) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:866)
    I haven't had my fingers in that code recently, does it ring any bells for anyone?
    --
    This message is automatically generated by JIRA.
    -
    If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
    -
    For more information on JIRA, see: http://www.atlassian.com/software/jira
  • Chris Schneider (JIRA) at Oct 4, 2006 at 2:38 pm
    [ http://issues.apache.org/jira/browse/HADOOP-258?page=comments#action_12439844 ]

    Chris Schneider commented on HADOOP-258:
    ----------------------------------------

    Just FYI, I recently integrated hadoop 0.5 into my copy of the source, rebuit and installed. I ran into similar "Could not obtain block" errors until I realized that I hadn't deployed the (new in hadoop 0.5) .../webapps/datanode/ servlet on my cluster.
    Cannot obtain block errors
    --------------------------

    Key: HADOOP-258
    URL: http://issues.apache.org/jira/browse/HADOOP-258
    Project: Hadoop
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.3.0
    Reporter: Owen O'Malley
    Assigned To: Sameer Paranjpye
    Fix For: 0.6.0


    I've been seeing a lot of errors from dfs for the last couple days. The exception that I see is:
    java.io.IOException: Could not obtain block: blk_2867431916903738534 file=/user/oom/big-rand/part000271 offset=0 at org.apache.hadoop.dfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:532) at org.apache.hadoop.dfs.DFSClient$DFSInputStream.read(DFSClient.java:641) at org.apache.hadoop.fs.FSDataInputStream$Checker.read(FSDataInputStream.java:83) at org.apache.hadoop.fs.FSDataInputStream$PositionCache.read(FSDataInputStream.java:158) at java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at java.io.BufferedInputStream.read1(BufferedInputStream.java:256) at java.io.BufferedInputStream.read(BufferedInputStream.java:313) at java.io.DataInputStream.readFully(DataInputStream.java:176) at java.io.DataInputStream.readFully(DataInputStream.java:152) at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:264) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:248) at org.apache.hadoop.io.SequenceFile$Reader.(SequenceFile.java:238) at org.apache.hadoop.mapred.SequenceFileRecordReader.(SequenceFileRecordReader.java:36) at org.apache.hadoop.mapred.SequenceFileInputFormat.getRecordReader(SequenceFileInputFormat.java:53) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:105) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:866)
    I haven't had my fingers in that code recently, does it ring any bells for anyone?
    --
    This message is automatically generated by JIRA.
    -
    If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
    -
    For more information on JIRA, see: http://www.atlassian.com/software/jira

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMay 27, '06 at 7:18a
activeOct 4, '06 at 2:38p
posts5
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Chris Schneider (JIRA): 5 posts

People

Translate

site design / logo © 2022 Grokbase