FAQ
Hi,

1) I configured similary for Oozie as the filebrowser app, on my entire
cluster I added :

* core-site.xml :

<property>
         <name>hadoop.proxyuser.oozie.hosts</name>
         <value>*</value>
</property>
<property>
         <name>hadoop.proxyuser.ozzie.groups</name>
         <value>*</value>
</property>


* hdfs-site.xml :

   <property>
     <name>dfs.webhdfs.enabled</name>
     <value>true</value>
   </property>


2) When I launch a job,

* Hue UI said :

*Erreur lors de l'envoi du workflow test - hdfs*

E0501: Could not perform authorization operation, User: oozie is not
allowed to impersonate hdfs

* hdfs log

2013-09-18 11:59:47,000 INFO org.apache.hadoop.hdfs.StateChange: DIR*
completeFile:
/user/hue/oozie/workspaces/_hdfs_-oozie-2-1379428896.87/workflow.xml is
closed by DFSClient_NONMAPREDUCE_1410577787_18
2013-09-18 11:59:47,206 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 8020: readAndProcess threw exception
org.apache.hadoop.security.AccessControlException: Connection from
172.20.42.1:48726 for protocol
org.apache.hadoop.hdfs.protocol.ClientProtocol is unauthorized for user
hdfs (auth:PROXY) via oozie (auth:SIMPLE) from client 172.20.42.1. Count of
bytes read: 0
org.apache.hadoop.security.AccessControlException: Connection from
172.20.42.1:48726 for protocol
org.apache.hadoop.hdfs.protocol.ClientProtocol is unauthorized for user
hdfs (auth:PROXY) via oozie (auth:SIMPLE)
         at
org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1555)
         at
org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1407)
         at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:719)
         at
org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:518)
         at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:493)
2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
InvalidateBlocks: ask 172.20.42.11:50010 to delete
[blk_-3035861513344464131_355436]
2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
InvalidateBlocks: ask 172.20.42.7:50010 to delete
[blk_-3035861513344464131_355436]
2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
InvalidateBlocks: ask 172.20.42.4:50010 to delete
[blk_-3035861513344464131_355436]

What I need to do ? add oozie unix user ?

Thanks

Franck

To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].

Search Discussions

  • Abraham Elmahrek at Sep 18, 2013 at 6:48 pm
    Hey Frank,

    It seems you have a spelling error in your config. Can you change
    hadoop.proxyuser.ozzie.groups to hadoop.proxyuser.oozie.groups?

    -Abe

    On Wed, Sep 18, 2013 at 3:13 AM, Franck Gallos wrote:

    Hi,

    1) I configured similary for Oozie as the filebrowser app, on my entire
    cluster I added :

    * core-site.xml :

    <property>
    <name>hadoop.proxyuser.oozie.hosts</name>
    <value>*</value>
    </property>
    <property>
    <name>hadoop.proxyuser.ozzie.groups</name>
    <value>*</value>
    </property>


    * hdfs-site.xml :

    <property>
    <name>dfs.webhdfs.enabled</name>
    <value>true</value>
    </property>


    2) When I launch a job,

    * Hue UI said :

    *Erreur lors de l'envoi du workflow test - hdfs*

    E0501: Could not perform authorization operation, User: oozie is not
    allowed to impersonate hdfs

    * hdfs log

    2013-09-18 11:59:47,000 INFO org.apache.hadoop.hdfs.StateChange: DIR*
    completeFile:
    /user/hue/oozie/workspaces/_hdfs_-oozie-2-1379428896.87/workflow.xml is
    closed by DFSClient_NONMAPREDUCE_1410577787_18
    2013-09-18 11:59:47,206 INFO org.apache.hadoop.ipc.Server: IPC Server
    listener on 8020: readAndProcess threw exception
    org.apache.hadoop.security.AccessControlException: Connection from
    172.20.42.1:48726 for protocol
    org.apache.hadoop.hdfs.protocol.ClientProtocol is unauthorized for user
    hdfs (auth:PROXY) via oozie (auth:SIMPLE) from client 172.20.42.1. Count of
    bytes read: 0
    org.apache.hadoop.security.AccessControlException: Connection from
    172.20.42.1:48726 for protocol
    org.apache.hadoop.hdfs.protocol.ClientProtocol is unauthorized for user
    hdfs (auth:PROXY) via oozie (auth:SIMPLE)
    at
    org.apache.hadoop.ipc.Server$Connection.processOneRpc(Server.java:1555)
    at
    org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1407)
    at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:719)
    at
    org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:518)
    at
    org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:493)
    2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
    InvalidateBlocks: ask 172.20.42.11:50010 to delete
    [blk_-3035861513344464131_355436]
    2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
    InvalidateBlocks: ask 172.20.42.7:50010 to delete
    [blk_-3035861513344464131_355436]
    2013-09-18 11:59:47,436 INFO org.apache.hadoop.hdfs.StateChange: BLOCK*
    InvalidateBlocks: ask 172.20.42.4:50010 to delete
    [blk_-3035861513344464131_355436]

    What I need to do ? add oozie unix user ?

    Thanks

    Franck

    To unsubscribe from this group and stop receiving emails from it, send an
    email to [email protected].
    To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
grouphue-user @
categorieshadoop
postedSep 18, '13 at 10:13a
activeSep 18, '13 at 6:48p
posts2
users2
websitecloudera.com
irc#hadoop

2 users in discussion

Abraham Elmahrek: 1 post Franck Gallos: 1 post

People

Translate

site design / logo © 2023 Grokbase