FAQ
Hi,

when i run the MapReduce jon remotely, I got following messages:
[root@master1 javaSamples]# hadoop jar wordcount.jar org.myorg.WordCount
/user/lili/wordcount/input /user/lili/wordcount/output
13/12/09 13:47:33 WARN conf.Configuration: fs.default.name is deprecated.
Instead, use fs.defaultFS

13/12/09 13:47:34 WARN mapred.JobClient: Use GenericOptionsParser for
parsing the arguments. Applications should implement Tool for the same.
13/12/09 13:47:34 INFO hdfs.DFSClient: Created HDFS_DELEGATION_TOKEN token
57 for lili on 163.220.3.200:8020
13/12/09 13:47:34 INFO security.TokenCache: Got dt for hdfs://
itri-w-00.hpcc.jp:8020; Kind: HDFS_DELEGATION_TOKEN, Service:
163.220.3.200:8020, Ident: (HDFS_DELEGATION_TOKEN token 57 for lili)
13/12/09 13:47:34 INFO mapred.FileInputFormat: Total input paths to process
: 2
13/12/09 13:47:35 INFO mapred.JobClient: Cleaning up the staging area
hdfs://itri-w-00.hpcc.jp:8020/user/lili/.staging/job_201312051620_0016
13/12/09 13:47:35 ERROR security.UserGroupInformation:
PriviledgedActionException as:lili@hpcc.jp (auth:KERBEROS)
cause:org.apache.hadoop.ipc.RemoteException(java.io.IOException):
java.io.IOException: Failed on local exception: java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]; Host Details : local host is: "
itri-w-05.hpcc.jp/192.168.3.205"; destination host is:
"itri-w-00.hpcc.jp":8020;

     at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3519)
     at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3485)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)
Caused by: java.io.IOException: Failed on local exception:
java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]; Host Details : local host is: "
itri-w-05.hpcc.jp/192.168.3.205"; destination host is:
"itri-w-00.hpcc.jp":8020;

     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:763)
     at org.apache.hadoop.ipc.Client.call(Client.java:1242)
     at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
     at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
     at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:629)
     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1545)
     at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:820)
     at org.apache.hadoop.mapred.JobInProgress.(JobTracker.java:3517)
     ... 13 more
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
     at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:582)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:546)
     at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:630)
     at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:252)
     at org.apache.hadoop.ipc.Client.getConnection(Client.java:1291)
     at org.apache.hadoop.ipc.Client.call(Client.java:1209)
     ... 26 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
     at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:212)
     at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:137)
     at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:457)
     at org.apache.hadoop.ipc.Client$Connection.access$1400(Client.java:252)
     at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:623)
     at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:620)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:619)
     ... 29 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
     at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147)
     at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:121)
     at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187)
     at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:223)
     at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212)
     at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179)
     at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:193)
     ... 38 more

Exception in thread "main"
org.apache.hadoop.ipc.RemoteException(java.io.IOException):
java.io.IOException: Failed on local exception: java.io.IOException:
javax.security.sasl.SaslException: GSS initiate failed [Caused by
GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]; Host Details : local host is: "
itri-w-05.hpcc.jp/192.168.3.205"; destination host is:
"itri-w-00.hpcc.jp":8020;

     at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3519)
     at org.apache.hadoop.mapred.JobTracker.submitJob(JobTracker.java:3485)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at
org.apache.hadoop.ipc.WritableRpcEngine$Server$WritableRpcInvoker.call(WritableRpcEngine.java:474)
     at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)
     at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)
Caused by: java.io.IOException: Failed on local exception:
java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed
[Caused by GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)]; Host Details : local host is: "
itri-w-05.hpcc.jp/192.168.3.205"; destination host is:
"itri-w-00.hpcc.jp":8020;

     at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:763)
     at org.apache.hadoop.ipc.Client.call(Client.java:1242)
     at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:202)
     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
     at sun.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
     at com.sun.proxy.$Proxy12.getFileInfo(Unknown Source)
     at
org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:629)
     at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:1545)
     at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:820)
     at org.apache.hadoop.mapred.JobInProgress.(JobTracker.java:3517)
     ... 13 more
Caused by: java.io.IOException: javax.security.sasl.SaslException: GSS
initiate failed [Caused by GSSException: No valid credentials provided
(Mechanism level: Failed to find any Kerberos tgt)]
     at org.apache.hadoop.ipc.Client$Connection$1.run(Client.java:582)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at
org.apache.hadoop.ipc.Client$Connection.handleSaslConnectionFailure(Client.java:546)
     at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:630)
     at org.apache.hadoop.ipc.Client$Connection.access$2100(Client.java:252)
     at org.apache.hadoop.ipc.Client.getConnection(Client.java:1291)
     at org.apache.hadoop.ipc.Client.call(Client.java:1209)
     ... 26 more
Caused by: javax.security.sasl.SaslException: GSS initiate failed [Caused
by GSSException: No valid credentials provided (Mechanism level: Failed to
find any Kerberos tgt)]
     at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:212)
     at
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:137)
     at
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:457)
     at org.apache.hadoop.ipc.Client$Connection.access$1400(Client.java:252)
     at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:623)
     at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:620)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:619)
     ... 29 more
Caused by: GSSException: No valid credentials provided (Mechanism level:
Failed to find any Kerberos tgt)
     at
sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:147)
     at
sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:121)
     at
sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:187)
     at
sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:223)
     at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:212)
     at
sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:179)
     at
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:193)
     ... 38 more

     at org.apache.hadoop.ipc.Client.call(Client.java:1237)
     at
org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:225)
     at org.apache.hadoop.mapred.$Proxy10.submitJob(Unknown Source)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:164)
     at
org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:83)
     at org.apache.hadoop.mapred.$Proxy10.submitJob(Unknown Source)
     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:1022)
     at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:945)
     at java.security.AccessController.doPrivileged(Native Method)
     at javax.security.auth.Subject.doAs(Subject.java:415)
     at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)
     at
org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:945)
     at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:919)
     at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1368)
     at org.myorg.WordCount.main(WordCount.java:84)
     at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
     at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
     at java.lang.reflect.Method.invoke(Method.java:606)
     at org.apache.hadoop.util.RunJar.main(RunJar.java:208)
[root@master1 javaSamples]#

I also got following messages in kerberos log file:
Dec 9 13:50:49 itri-h-00 krb5kdc[2089]: AS_REQ (1 etypes {16})
163.220.3.200: CLIENT_NOT_FOUND: cloudera-scm@hpcc.jp for krbtgt/
hpcc.jp@hpcc.jp, Client not found in Kerberos database
Dec 9 13:50:52 itri-h-00 krb5kdc[2089]: AS_REQ (1 etypes {16})
192.168.3.198: NEEDED_PREAUTH: lili@hpcc.jp for krbtgt/HPCC.JP@HPCC.JP,
Additional pre-authentication required

I have a question why cloudera-scm@KDC, but not cloudera-scm/admin@KDC is
uesd?

Please help me.

Thanks.

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedDec 9, '13 at 5:17a
activeDec 9, '13 at 5:17a
posts1
users1
websitecloudera.com
irc#hadoop

1 user in discussion

李黎: 1 post

People

Translate

site design / logo © 2022 Grokbase