FAQ
Namenode NPE while loading fsimage after a cluster upgrade from older disk format
---------------------------------------------------------------------------------

Key: HADOOP-3118
URL: https://issues.apache.org/jira/browse/HADOOP-3118
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Reporter: dhruba borthakur
Assignee: dhruba borthakur


FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
java.lang.NullPointerException
at
org.apache.hadoop.dfs.StringBytesWritable.(INode.java:795)
at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
at
org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
at
org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
at
org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
at org.apache.hadoop.dfs.FSNamesystem.(NameNode.java:133)
at org.apache.hadoop.dfs.NameNode.(NameNode.java:164)
at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)



--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • dhruba borthakur (JIRA) at Mar 28, 2008 at 5:58 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Attachment: loadImageNPE.patch
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 6:02 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583112#action_12583112 ]

    Raghu Angadi commented on HADOOP-3118:
    --------------------------------------

    Could briefly describe the fix, though the patch looks simple? Should this be fixed for 0.17?
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Mar 28, 2008 at 6:14 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Fix Version/s: 0.17.0

    The new disk format stores open lease for files that were being written to. When a old disk format is upgraded to the new format, the values inside the lease were not initialised. For example, the name of the client that holds the lease was erroneously set to null.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Robert Chansler (JIRA) at Mar 28, 2008 at 10:42 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Chansler updated HADOOP-3118:
    ------------------------------------

    Priority: Blocker (was: Major)

    0.17? Yes!
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 11:32 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583236#action_12583236 ]

    rangadi edited comment on HADOOP-3118 at 3/28/08 4:29 PM:
    ---------------------------------------------------------------

    I applied this patch to the same set up that had the previous NPE and got another one :

    {noformat}
    2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
    gadi/10Mb-1 because it does not exist
    2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
    fault/dfs/name.
    old LV = -11; old CTime = 0.
    new LV = -13; new CTime = 1206746911021
    2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
    at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
    at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
    at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    {noformat}
    not sure if these are related.


    was (Author: rangadi):
    I applied this patch to the same set up that had the previous NPE and got another one :

    {noformat}
    2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
    gadi/10Mb-1 because it does not exist
    2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
    fault/dfs/name.
    old LV = -11; old CTime = 0.
    new LV = -13; new CTime = 1206746911021
    2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
    at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
    at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
    at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    {noformat}
    not if these are related.

    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 11:32 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583236#action_12583236 ]

    Raghu Angadi commented on HADOOP-3118:
    --------------------------------------

    I applied this patch to the same set up that had the previous NPE and got another one :

    {noformat}
    2008-03-28 23:28:31,020 WARN org.apache.hadoop.dfs.StateChange: DIR* FSDirectory.unprotectedDelete: failed to remove /user/ran
    gadi/10Mb-1 because it does not exist
    2008-03-28 23:28:31,021 INFO org.apache.hadoop.dfs.Storage: Upgrading image directory /export/crawlspace/rangadi/hadoop-dir/de
    fault/dfs/name.
    old LV = -11; old CTime = 0.
    new LV = -13; new CTime = 1206746911021
    2008-03-28 23:28:31,034 ERROR org.apache.hadoop.dfs.NameNode: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSImage.writeINodeUnderConstruction(FSImage.java:999)
    at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4372)
    at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:791)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:276)
    at org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    {noformat}
    not if these are related.

    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Nigel Daley (JIRA) at Mar 29, 2008 at 12:02 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583243#action_12583243 ]

    Nigel Daley commented on HADOOP-3118:
    -------------------------------------

    Dhruba, can you set the Affects Version field?
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Mar 29, 2008 at 6:22 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583277#action_12583277 ]

    dhruba borthakur commented on HADOOP-3118:
    ------------------------------------------

    This affects version 0.17. However, the drop-down list for "Affects version" does not yet have a 0.17 value.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Mar 30, 2008 at 7:17 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Attachment: loadImageNPE.patch

    Hi Raghu, The earlier patch had a bug that caused locations of the last block of the file (that is stored in the lease) to be stored as null. Sorry. I have tested this patch and it should work.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Apr 2, 2008 at 6:13 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Status: Patch Available (was: Open)
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Apr 2, 2008 at 7:50 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584446#action_12584446 ]

    Hadoop QA commented on HADOOP-3118:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12378879/loadImageNPE.patch
    against trunk revision 643282.

    @author +1. The patch does not contain any @author tags.

    tests included -1. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit +1. The applied patch does not generate any new release audit warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2120/console

    This message is automatically generated.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Apr 3, 2008 at 12:20 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Status: Open (was: Patch Available)
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Apr 3, 2008 at 12:21 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Status: Patch Available (was: Open)
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Apr 3, 2008 at 12:21 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Attachment: loadImageNPE.patch

    Avoid initialization of lastLocations with an empty array object.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hadoop QA (JIRA) at Apr 3, 2008 at 6:20 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12584991#action_12584991 ]

    Hadoop QA commented on HADOOP-3118:
    -----------------------------------

    -1 overall. Here are the results of testing the latest attachment
    http://issues.apache.org/jira/secure/attachment/12379210/loadImageNPE.patch
    against trunk revision 643282.

    @author +1. The patch does not contain any @author tags.

    tests included -1. The patch doesn't appear to include any new or modified tests.
    Please justify why no tests are needed for this patch.

    javadoc +1. The javadoc tool did not generate any warning messages.

    javac +1. The applied patch does not generate any new javac compiler warnings.

    release audit +1. The applied patch does not generate any new release audit warnings.

    findbugs +1. The patch does not introduce any new Findbugs warnings.

    core tests +1. The patch passed core unit tests.

    contrib tests +1. The patch passed contrib unit tests.

    Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/testReport/
    Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
    Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/artifact/trunk/build/test/checkstyle-errors.html
    Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2133/console

    This message is automatically generated.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • dhruba borthakur (JIRA) at Apr 3, 2008 at 7:06 am
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    dhruba borthakur updated HADOOP-3118:
    -------------------------------------

    Resolution: Fixed
    Hadoop Flags: [Reviewed]
    Status: Resolved (was: Patch Available)

    I just committed this.
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Apr 3, 2008 at 12:57 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12585092#action_12585092 ]

    Hudson commented on HADOOP-3118:
    --------------------------------

    Integrated in Hadoop-trunk #450 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/450/])
    Namenode NPE while loading fsimage after a cluster upgrade from older disk format
    ---------------------------------------------------------------------------------

    Key: HADOOP-3118
    URL: https://issues.apache.org/jira/browse/HADOOP-3118
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Reporter: dhruba borthakur
    Assignee: dhruba borthakur
    Priority: Blocker
    Fix For: 0.17.0

    Attachments: loadImageNPE.patch, loadImageNPE.patch, loadImageNPE.patch


    FSDirectory.unprotectedDelete: failed to remove /user/ran gadi/10Mb because it does not exist
    2008-03-27 22:00:10,904 ERROR org.apache.hadoop.dfs.NameNode:
    java.lang.NullPointerException
    at
    org.apache.hadoop.dfs.StringBytesWritable.<init>(StringBytesWritable.java:39)
    at
    org.apache.hadoop.dfs.INodeFileUnderConstruction.<init>(INode.java:795)
    at org.apache.hadoop.dfs.FSEditLog.loadFSEdits(FSEditLog.java:528)
    at org.apache.hadoop.dfs.FSImage.loadFSEdits(FSImage.java:766)
    at org.apache.hadoop.dfs.FSImage.loadFSImage(FSImage.java:640)
    at org.apache.hadoop.dfs.FSImage.doUpgrade(FSImage.java:250)
    at
    org.apache.hadoop.dfs.FSImage.recoverTransitionRead(FSImage.java:217)
    at
    org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:80)
    at
    org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:274)
    at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:255)
    at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:133)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:178)
    at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:164)
    at org.apache.hadoop.dfs.NameNode.createNameNode(NameNode.java:846)
    at org.apache.hadoop.dfs.NameNode.main(NameNode.java:855)
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 28, '08 at 5:54p
activeApr 3, '08 at 12:57p
posts18
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 18 posts

People

Translate

site design / logo © 2022 Grokbase