Grokbase › Groups › Hadoop › scm-users › November 2013
FAQ
After implementing this :
http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/4.5.4/Configuring-Hadoop-Security-with-Cloudera-Manager/cmeechs_topic_4.html

i am unable to run a pig script from hue.

i get the following log's

=

2013-11-20 14:31:08,575 INFO
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@:start:] Start action
[0000001-131119152417198-oozie-oozi-W@:start:] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]

2013-11-20 14:31:08,575 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
[***0000001-131119152417198-oozie-oozi-W@:start:***]Action status=DONE

2013-11-20 14:31:08,575 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
[***0000001-131119152417198-oozie-oozi-W@:start:***]Action updated in DB!

2013-11-20 14:31:08,689 INFO
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] Start action
[0000001-131119152417198-oozie-oozi-W@pig] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]

2013-11-20 14:31:09,120 WARN
org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] credentials is null for
the action

2013-11-20 14:31:10,104 INFO
org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] checking action, external
ID [job_201311191523_0002] status [RUNNING]

2013-11-20 14:31:10,208 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig]
[***0000001-131119152417198-oozie-oozi-W@pig***]Action status=RUNNING

2013-11-20 14:31:10,208 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig]
[***0000001-131119152417198-oozie-oozi-W@pig***]Action updated in DB!

2013-11-20 14:31:14,489 INFO org.apache.oozie.servlet.CallbackServlet:
USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] callback for action
[0000001-131119152417198-oozie-oozi-W@pig]

2013-11-20 14:31:14,631 INFO
org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] action completed, external
ID [job_201311191523_0002]

2013-11-20 14:31:14,659 WARN
org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] LauncherMapper died, check
Hadoop log for job [tele8001.prd.bigd.telenet.be:8021:job_201311191523_0002]

2013-11-20 14:31:14,867 INFO org.apache.oozie.command.wf.ActionEndXCommand:
USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@pig] ERROR is considered as
FAILED for SLA

2013-11-20 14:31:14,919 INFO
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@kill] Start action
[0000001-131119152417198-oozie-oozi-W@kill] with user-retry state :
userRetryCount [0], userRetryMax [0], userRetryInterval [10]

2013-11-20 14:31:14,920 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@kill]
[***0000001-131119152417198-oozie-oozi-W@kill***]Action status=DONE

2013-11-20 14:31:14,920 WARN
org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
ACTION[0000001-131119152417198-oozie-oozi-W@kill]
[***0000001-131119152417198-oozie-oozi-W@kill***]Action updated in DB!

2013-11-20 14:31:15,011 WARN
org.apache.oozie.command.coord.CoordActionUpdateXCommand: USER[hdfs]
GROUP[-] TOKEN[] APP[pig-app-hue-script]
JOB[0000001-131119152417198-oozie-oozi-W] ACTION[-] E1100: Command
precondition does not hold before execution, [, coord action is null],
Error Code: E1100



can anyone help ?

To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Search Discussions

  • Romain Rigaux at Nov 22, 2013 at 2:31 am ⇧
    These are just warning. Could you click on the little 'log' icon or look in
    File Browser for more logs in the failed mapreduce? (as it died: LauncherMapper
    died, check Hadoop log for job [tele8001.prd.bigd.telenet.be:8021
    :job_201311191523_0002])

    Romain

    On Thu, Nov 21, 2013 at 4:41 AM, Bert Cauwelier wrote:


    After implementing this :

    http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/4.5.4/Configuring-Hadoop-Security-with-Cloudera-Manager/cmeechs_topic_4.html

    i am unable to run a pig script from hue.

    i get the following log's

    =

    2013-11-20 14:31:08,575 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:] Start action
    [0000001-131119152417198-oozie-oozi-W@:start:] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:08,575 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
    [***0000001-131119152417198-oozie-oozi-W@:start:***]Action status=DONE

    2013-11-20 14:31:08,575 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
    [***0000001-131119152417198-oozie-oozi-W@:start:***]Action updated in DB!

    2013-11-20 14:31:08,689 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] Start action
    [0000001-131119152417198-oozie-oozi-W@pig] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:09,120 WARN
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] credentials is null for
    the action

    2013-11-20 14:31:10,104 INFO
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] checking action,
    external ID [job_201311191523_0002] status [RUNNING]

    2013-11-20 14:31:10,208 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig]
    [***0000001-131119152417198-oozie-oozi-W@pig***]Action status=RUNNING

    2013-11-20 14:31:10,208 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig]
    [***0000001-131119152417198-oozie-oozi-W@pig***]Action updated in DB!

    2013-11-20 14:31:14,489 INFO org.apache.oozie.servlet.CallbackServlet:
    USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] callback for action
    [0000001-131119152417198-oozie-oozi-W@pig]

    2013-11-20 14:31:14,631 INFO
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] action completed,
    external ID [job_201311191523_0002]

    2013-11-20 14:31:14,659 WARN
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] LauncherMapper died,
    check Hadoop log for job [tele8001.prd.bigd.telenet.be:8021
    :job_201311191523_0002]

    2013-11-20 14:31:14,867 INFO
    org.apache.oozie.command.wf.ActionEndXCommand: USER[hdfs] GROUP[-] TOKEN[]
    APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] ERROR is considered as
    FAILED for SLA

    2013-11-20 14:31:14,919 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill] Start action
    [0000001-131119152417198-oozie-oozi-W@kill] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:14,920 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill]
    [***0000001-131119152417198-oozie-oozi-W@kill***]Action status=DONE

    2013-11-20 14:31:14,920 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill]
    [***0000001-131119152417198-oozie-oozi-W@kill***]Action updated in DB!

    2013-11-20 14:31:15,011 WARN
    org.apache.oozie.command.coord.CoordActionUpdateXCommand: USER[hdfs]
    GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[-] E1100: Command
    precondition does not hold before execution, [, coord action is null],
    Error Code: E1100



    can anyone help ?

    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+unsubscribe@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Bert Cauwelier at Nov 22, 2013 at 10:18 am ⇧
    Do you mean these logs ?


    Error initializing attempt_201311211304_0002_m_000002_0:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



             at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

             at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

             at java.security.AccessController.doPrivileged(Native Method)

             at javax.security.auth.Subject.doAs(Subject.java:396)

             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

             at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

             at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

             at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

             at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_1:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 494, which is below the minimum allowed 1000



             at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

             at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

             at java.security.AccessController.doPrivileged(Native Method)

             at javax.security.auth.Subject.doAs(Subject.java:396)

             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

             at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

             at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

             at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

             at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_2:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



             at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

             at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

             at java.security.AccessController.doPrivileged(Native Method)

             at javax.security.auth.Subject.doAs(Subject.java:396)

             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

             at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

             at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

             at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

             at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_3:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



             at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

             at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

             at java.security.AccessController.doPrivileged(Native Method)

             at javax.security.auth.Subject.doAs(Subject.java:396)

             at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

             at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

             at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

             at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

             at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept


    Op vrijdag 22 november 2013 03:31:06 UTC+1 schreef Romain Rigaux:
    These are just warning. Could you click on the little 'log' icon or look
    in File Browser for more logs in the failed mapreduce? (as it died: LauncherMapper
    died, check Hadoop log for job
    [tele8001.prd.bigd.telenet.be:8021:job_201311191523_0002])

    Romain


    On Thu, Nov 21, 2013 at 4:41 AM, Bert Cauwelier <bertb...@gmail.com<javascript:>
    wrote:
    After implementing this :

    http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM4Ent/4.5.4/Configuring-Hadoop-Security-with-Cloudera-Manager/cmeechs_topic_4.html<http://www.google.com/url?q=http%3A%2F%2Fwww.cloudera.com%2Fcontent%2Fcloudera-content%2Fcloudera-docs%2FCM4Ent%2F4.5.4%2FConfiguring-Hadoop-Security-with-Cloudera-Manager%2Fcmeechs_topic_4.html&sa=D&sntz=1&usg=AFQjCNGSN0zUa-TTVGq2IiEop_pZvG99bA>

    i am unable to run a pig script from hue.

    i get the following log's

    =

    2013-11-20 14:31:08,575 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:] Start action
    [0000001-131119152417198-oozie-oozi-W@:start:] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:08,575 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
    [***0000001-131119152417198-oozie-oozi-W@:start:***]Action status=DONE

    2013-11-20 14:31:08,575 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@:start:]
    [***0000001-131119152417198-oozie-oozi-W@:start:***]Action updated in DB!

    2013-11-20 14:31:08,689 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] Start action
    [0000001-131119152417198-oozie-oozi-W@pig] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:09,120 WARN
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] credentials is null for
    the action

    2013-11-20 14:31:10,104 INFO
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] checking action, external
    ID [job_201311191523_0002] status [RUNNING]

    2013-11-20 14:31:10,208 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig]
    [***0000001-131119152417198-oozie-oozi-W@pig***]Action status=RUNNING

    2013-11-20 14:31:10,208 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig]
    [***0000001-131119152417198-oozie-oozi-W@pig***]Action updated in DB!

    2013-11-20 14:31:14,489 INFO org.apache.oozie.servlet.CallbackServlet:
    USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] callback for action
    [0000001-131119152417198-oozie-oozi-W@pig]

    2013-11-20 14:31:14,631 INFO
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] action completed, external
    ID [job_201311191523_0002]

    2013-11-20 14:31:14,659 WARN
    org.apache.oozie.action.hadoop.PigActionExecutor: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] LauncherMapper died, check
    Hadoop log for job [tele8001.prd.bigd.telenet.be:8021:job_201311191523_0002]

    2013-11-20 14:31:14,867 INFO
    org.apache.oozie.command.wf.ActionEndXCommand: USER[hdfs] GROUP[-] TOKEN[]
    APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] ERROR is considered as
    FAILED for SLA

    2013-11-20 14:31:14,919 INFO
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill] Start action
    [0000001-131119152417198-oozie-oozi-W@kill] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:14,920 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill]
    [***0000001-131119152417198-oozie-oozi-W@kill***]Action status=DONE

    2013-11-20 14:31:14,920 WARN
    org.apache.oozie.command.wf.ActionStartXCommand: USER[hdfs] GROUP[-]
    TOKEN[] APP[pig-app-hue-script] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@kill]
    [***0000001-131119152417198-oozie-oozi-W@kill***]Action updated in DB!

    2013-11-20 14:31:15,011 WARN
    org.apache.oozie.command.coord.CoordActionUpdateXCommand: USER[hdfs]
    GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[-] E1100: Command
    precondition does not hold before execution, [, coord action is null],
    Error Code: E1100



    can anyone help ?

    To unsubscribe from this group and stop receiving emails from it, send an
    email to scm-users+...@cloudera.org <javascript:>.
    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.
  • Darren Lo at Nov 22, 2013 at 5:43 pm ⇧
    On secure clusters, you shouldn't run MR jobs as system users like hdfs.
    Create a regular user (with a user id over 1000) and run your job as that.
    You of course need to set up kerb credentials for this user. You can also
    alter the minimum user id config in MapReduce configuration, but it's
    better to run jobs as a real user so you get real security and auditing.

    Thanks,
    Darren

    On Fri, Nov 22, 2013 at 2:18 AM, Bert Cauwelier wrote:

    Do you mean these logs ?


    Error initializing attempt_201311211304_0002_m_000002_0:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



    at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

    at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_1:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 494, which is below the minimum allowed 1000



    at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

    at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_2:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



    at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

    at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept

    Error initializing attempt_201311211304_0002_m_000002_3:

    java.io.IOException: Job initialization failed (255) with output: Reading task controller config from /etc/hadoop/conf.cloudera.mapreduce1/taskcontroller.cfg

    Requested user hdfs has id 496, which is below the minimum allowed 1000



    at org.apache.hadoop.mapred.LinuxTaskController.initializeJob(LinuxTaskController.java:194)

    at org.apache.hadoop.mapred.TaskTracker$4.run(TaskTracker.java:1470)

    at java.security.AccessController.doPrivileged(Native Method)

    at javax.security.auth.Subject.doAs(Subject.java:396)

    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1408)

    at org.apache.hadoop.mapred.TaskTracker.initializeJob(TaskTracker.java:1445)

    at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:1360)

    at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:2786)

    at org.apache.hadoop.mapred.TaskTracker$TaskLauncher.run(TaskTracker.java:2750)

    Caused by: org.apache.hadoop.util.Shell$ExitCodeExcept


    Op vrijdag 22 november 2013 03:31:06 UTC+1 schreef Romain Rigaux:
    These are just warning. Could you click on the little 'log' icon or look
    in File Browser for more logs in the failed mapreduce? (as it died: LauncherMapper
    died, check Hadoop log for job [tele8001.prd.bigd.telenet.be:
    8021:job_201311191523_0002])

    Romain

    On Thu, Nov 21, 2013 at 4:41 AM, Bert Cauwelier wrote:


    After implementing this :
    http://www.cloudera.com/content/cloudera-content/
    cloudera-docs/CM4Ent/4.5.4/Configuring-Hadoop-Security-
    with-Cloudera-Manager/cmeechs_topic_4.html<http://www.google.com/url?q=http%3A%2F%2Fwww.cloudera.com%2Fcontent%2Fcloudera-content%2Fcloudera-docs%2FCM4Ent%2F4.5.4%2FConfiguring-Hadoop-Security-with-Cloudera-Manager%2Fcmeechs_topic_4.html&sa=D&sntz=1&usg=AFQjCNGSN0zUa-TTVGq2IiEop_pZvG99bA>

    i am unable to run a pig script from hue.

    i get the following log's

    =

    2013-11-20 14:31:08,575 INFO org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@:start:] Start action
    [0000001-131119152417198-oozie-oozi-W@:start:] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:08,575 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@:start:] [***0000001-131119152417198-
    oozie-oozi-W@:start:***]Action status=DONE

    2013-11-20 14:31:08,575 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@:start:] [***0000001-131119152417198-
    oozie-oozi-W@:start:***]Action updated in DB!

    2013-11-20 14:31:08,689 INFO org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] Start action [0000001-131119152417198-
    oozie-oozi-W@pig] with user-retry state : userRetryCount [0],
    userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:09,120 WARN org.apache.oozie.action.hadoop.PigActionExecutor:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] credentials is null for the action

    2013-11-20 14:31:10,104 INFO org.apache.oozie.action.hadoop.PigActionExecutor:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] checking action, external ID
    [job_201311191523_0002] status [RUNNING]

    2013-11-20 14:31:10,208 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] [***0000001-131119152417198-
    oozie-oozi-W@pig***]Action status=RUNNING

    2013-11-20 14:31:10,208 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] [***0000001-131119152417198-
    oozie-oozi-W@pig***]Action updated in DB!

    2013-11-20 14:31:14,489 INFO org.apache.oozie.servlet.CallbackServlet:
    USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000001-131119152417198-oozie-oozi-W]
    ACTION[0000001-131119152417198-oozie-oozi-W@pig] callback for action
    [0000001-131119152417198-oozie-oozi-W@pig]

    2013-11-20 14:31:14,631 INFO org.apache.oozie.action.hadoop.PigActionExecutor:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] action completed, external ID
    [job_201311191523_0002]

    2013-11-20 14:31:14,659 WARN org.apache.oozie.action.hadoop.PigActionExecutor:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] LauncherMapper died, check Hadoop log
    for job [tele8001.prd.bigd.telenet.be:8021:job_201311191523_0002]

    2013-11-20 14:31:14,867 INFO org.apache.oozie.command.wf.ActionEndXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@pig] ERROR is considered as FAILED for SLA

    2013-11-20 14:31:14,919 INFO org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@kill] Start action
    [0000001-131119152417198-oozie-oozi-W@kill] with user-retry state :
    userRetryCount [0], userRetryMax [0], userRetryInterval [10]

    2013-11-20 14:31:14,920 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@kill] [***0000001-131119152417198-
    oozie-oozi-W@kill***]Action status=DONE

    2013-11-20 14:31:14,920 WARN org.apache.oozie.command.wf.ActionStartXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[0000001-
    131119152417198-oozie-oozi-W@kill] [***0000001-131119152417198-
    oozie-oozi-W@kill***]Action updated in DB!

    2013-11-20 14:31:15,011 WARN org.apache.oozie.command.coord.CoordActionUpdateXCommand:
    USER[hdfs] GROUP[-] TOKEN[] APP[pig-app-hue-script]
    JOB[0000001-131119152417198-oozie-oozi-W] ACTION[-] E1100: Command
    precondition does not hold before execution, [, coord action is null],
    Error Code: E1100



    can anyone help ?

    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+...@cloudera.org.
    To unsubscribe from this group and stop receiving emails from it, send
    an email to scm-users+unsubscribe@cloudera.org.


    --
    Thanks,
    Darren

    To unsubscribe from this group and stop receiving emails from it, send an email to scm-users+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedNov 21, '13 at 12:41p
activeNov 22, '13 at 5:43p
posts4
users3
websitecloudera.com
irc#hadoop

3 users in discussion

Bert Cauwelier: 2 posts Romain Rigaux: 1 post Darren Lo: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase