FAQ
NPE in FSDirectory.unprotectedSetPermission
-------------------------------------------

Key: HADOOP-3108
URL: https://issues.apache.org/jira/browse/HADOOP-3108
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Affects Versions: 0.16.1
Reporter: Koji Noguchi


Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
Permission is disabled on this cluster.
{noformat}
2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 76.13.26.233:49707:
error: java.io.IOException: java.lang.NullPointerException
java.io.IOException: java.lang.NullPointerException
at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
{noformat}

--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Search Discussions

  • Koji Noguchi (JIRA) at Mar 27, 2008 at 6:31 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Koji Noguchi updated HADOOP-3108:
    ---------------------------------

    Description:
    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}

    was:
    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 76.13.26.233:49707:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}

    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi

    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Mar 27, 2008 at 6:57 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE reassigned HADOOP-3108:
    ----------------------------------------------

    Assignee: Tsz Wo (Nicholas), SZE

    Oops, it throws NPE when the path does not exist. I will fix it.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Tsz Wo (Nicholas), SZE

    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Robert Chansler (JIRA) at Mar 27, 2008 at 8:09 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Chansler updated HADOOP-3108:
    ------------------------------------

    Fix Version/s: 0.16.2
    Priority: Blocker (was: Major)
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Tsz Wo (Nicholas), SZE
    Priority: Blocker
    Fix For: 0.16.2


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Robert Chansler (JIRA) at Mar 28, 2008 at 12:04 am
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Chansler reassigned HADOOP-3108:
    ---------------------------------------

    Assignee: Konstantin Shvachko (was: Tsz Wo (Nicholas), SZE)
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Mar 28, 2008 at 12:06 am
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Tsz Wo (Nicholas), SZE updated HADOOP-3108:
    -------------------------------------------

    Attachment: 3108_20080327.patch

    Here is the codes I got. Konstantin will continue work on it.

    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 12:46 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Attachment: getNodeNPE.patch

    I extended Nicholas's patch.
    Found one more potential NPE related to getNode() method in FSDirectory.
    TestPermissions failed in its original version because it was catching
    FileNotFoundException but was receiving a RemoteException instead.

    I wrote a unwrapRemoteException() method, which throws the cause of the
    RemoteException if it is of the right type. I recommend using it instead
    of analyzing the exception message.
    I should say in general that handling of RemoteExceptions e.g. in connection
    with FileNotFoundException is terrible. I will file a separate jira.
    The test was not closing file system correctly, I fixed that.
    And also a couple of findBugs warnings related to ignoring return values of called methods.
    I used the same unwrapping for canMkdirs(), canCreate() and canOpen() methods:
    this test is based on FileSystem API, which should not know anything about
    RemoteException, because e.g. LocalFileSystem does not throw this, ever.
    These changes affected TestDFSPermission, which in turn led to changes in
    DFSClient methods responsible, which report permission violations.
    With all the changes TestPermissions now correctly tests the case of changing
    permissions and owner of missing files Nicholas introduced.

    All tests pass on my machine except for TestDFSShell. Something is wrong with getFileInfo().
    Hudson is stuck again so I cannot verify on a different machine either.
    Please somebody take a look.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 12:46 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Status: Patch Available (was: Open)
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 5:32 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583102#action_12583102 ]

    Raghu Angadi commented on HADOOP-3108:
    --------------------------------------
    I should say in general that handling of RemoteExceptions e.g. in connection
    with FileNotFoundException is terrible. I will file a separate jira.
    This has been a long standing issue. Doug commented many times on this. If I remember correctly, his latest suggestion was something like to unwrap the exception as long as the inner exception class exists on the client. New jira will be good.

    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 5:34 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583104#action_12583104 ]

    Raghu Angadi commented on HADOOP-3108:
    --------------------------------------

    For this patch, I would say it is safer to use unwrapRemoteException only the test and leave DFSClient.java unchanged. The new jira might unwrap the exception in RPC client it self.

    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 5:58 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583109#action_12583109 ]

    Raghu Angadi commented on HADOOP-3108:
    --------------------------------------

    I think this patch is meant for 16, its better if only fixes the NPE. Changing a few IOExceptions to FileNotFound might be ok. But any other semantic changes. For example with the patch, deleting a file can throw IOException, where i think it should return false.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 6:00 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583109#action_12583109 ]

    rangadi edited comment on HADOOP-3108 at 3/28/08 10:56 AM:
    ----------------------------------------------------------------

    Since this patch is meant for 16, I think its better if it only fixes the NPEs. Changing some of the IOExceptions to FileNotFound might be ok. But any other semantic changes probably belong in 17 or trunk. For example with the patch, deleting a file can throw IOException, where i think it should return false.

    was (Author: rangadi):
    I think this patch is meant for 16, its better if only fixes the NPE. Changing a few IOExceptions to FileNotFound might be ok. But any other semantic changes. For example with the patch, deleting a file can throw IOException, where i think it should return false.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Tsz Wo (Nicholas), SZE (JIRA) at Mar 28, 2008 at 6:06 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583113#action_12583113 ]

    Tsz Wo (Nicholas), SZE commented on HADOOP-3108:
    ------------------------------------------------
    Since this patch is meant for 16, I think its better if it only fixes the NPEs.
    +1 we should minimize the last minute changes.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 6:50 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Attachment: 3108-0.16.2.patch

    This is a patch for 0.16.2
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 7:04 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Attachment: 3108-0.16.2.patch

    This is a version with the testPermission changed to catch the case.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Raghu Angadi (JIRA) at Mar 28, 2008 at 7:16 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583151#action_12583151 ]

    Raghu Angadi commented on HADOOP-3108:
    --------------------------------------

    +1.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 8:38 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Attachment: 3108-0.16.2.patch

    This patch applies both to trunk and 0.16.
    I corrected test failure in my previous patch.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108-0.16.2.patch, 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Konstantin Shvachko (JIRA) at Mar 28, 2008 at 8:58 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Konstantin Shvachko updated HADOOP-3108:
    ----------------------------------------

    Resolution: Fixed
    Status: Resolved (was: Patch Available)

    I just committed this.
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108-0.16.2.patch, 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.
  • Hudson (JIRA) at Mar 29, 2008 at 12:11 pm
    [ https://issues.apache.org/jira/browse/HADOOP-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12583310#action_12583310 ]

    Hudson commented on HADOOP-3108:
    --------------------------------

    Integrated in Hadoop-trunk #445 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/445/])
    NPE in FSDirectory.unprotectedSetPermission
    -------------------------------------------

    Key: HADOOP-3108
    URL: https://issues.apache.org/jira/browse/HADOOP-3108
    Project: Hadoop Core
    Issue Type: Bug
    Components: dfs
    Affects Versions: 0.16.1
    Reporter: Koji Noguchi
    Assignee: Konstantin Shvachko
    Priority: Blocker
    Fix For: 0.16.2

    Attachments: 3108-0.16.2.patch, 3108-0.16.2.patch, 3108-0.16.2.patch, 3108_20080327.patch, getNodeNPE.patch


    Not sure if this is fixed in later release, but I'm seeing many NPE in the namenode log.
    Permission is disabled on this cluster.
    {noformat}
    2008-03-27 03:22:39,984 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020,
    call setPermission(/user/knoguchi/file0, rwxr-xr-x) from 99.9.99.9:55555:
    error: java.io.IOException: java.lang.NullPointerException
    java.io.IOException: java.lang.NullPointerException
    at org.apache.hadoop.dfs.FSDirectory.unprotectedSetPermission(FSDirectory.java:411)
    at org.apache.hadoop.dfs.FSDirectory.setPermission(FSDirectory.java:405)
    at org.apache.hadoop.dfs.FSNamesystem.setPermission(FSNamesystem.java:716)
    at org.apache.hadoop.dfs.NameNode.setPermission(NameNode.java:297)
    at sun.reflect.GeneratedMethodAccessor21.invoke(Unknown Source)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:409)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:899)
    {noformat}
    --
    This message is automatically generated by JIRA.
    -
    You can reply to this email to add a comment to the issue online.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcommon-dev @
categorieshadoop
postedMar 27, '08 at 6:29p
activeMar 29, '08 at 12:11p
posts19
users1
websitehadoop.apache.org...
irc#hadoop

1 user in discussion

Hudson (JIRA): 19 posts

People

Translate

site design / logo © 2022 Grokbase