FAQ
Can someone please help out with this error :


12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to process
: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016


12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Search Discussions

  • Paul Lam at Jul 13, 2012 at 4:05 pm
    can you paste the whole stack please. the useful bit is near the bottom


    On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

    Can someone please help out with this error :


    12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
    found main method on: flipkart.null_search_evaluator
    12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
    /home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
    12/07/13 20:45:28 INFO property.AppProps: using app.id:
    03CEDD12347B222235E96B150B8E765D
    12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
    2.0.0-wip-291 [hadoop-0.20.2+]
    12/07/13 20:45:29 INFO flow.Flow: [] starting
    12/07/13 20:45:29 INFO flow.Flow: [] source:
    Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] sink:
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
    12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
    12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
    12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
    native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
    12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
    process : 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
    job_201207131219_0016


    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
    failed tasks
    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
    12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
    12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
    12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
    /user/rishabh/null-search-numbers2/_temporary
    Exception in thread "main" cascading.flow.FlowException: step failed:
    (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
    with job id: job_201207131219_0016, please see cluster logs for failure
    messages
    at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
    at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)
  • Rishabh at Jul 13, 2012 at 5:54 pm
    that was the whole stack .

    the jobtracker says : ( the reason the map n reduce jobs were killed was )
    :
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    and so on... ( same exception )
    On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

    can you paste the whole stack please. the useful bit is near the bottom


    On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

    Can someone please help out with this error :


    12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
    found main method on: flipkart.null_search_evaluator
    12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
    /home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
    12/07/13 20:45:28 INFO property.AppProps: using app.id:
    03CEDD12347B222235E96B150B8E765D
    12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
    2.0.0-wip-291 [hadoop-0.20.2+]
    12/07/13 20:45:29 INFO flow.Flow: [] starting
    12/07/13 20:45:29 INFO flow.Flow: [] source:
    Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] sink:
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
    12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
    12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
    12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
    native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
    12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
    process : 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
    job_201207131219_0016


    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
    failed tasks
    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
    12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
    12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
    12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
    /user/rishabh/null-search-numbers2/_temporary
    Exception in thread "main" cascading.flow.FlowException: step failed:
    (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
    with job id: job_201207131219_0016, please see cluster logs for failure
    messages
    at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
    at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)
  • Paul Lam at Jul 15, 2012 at 10:14 am
    can you post the source?


    On Friday, July 13, 2012 6:54:26 PM UTC+1, Rishabh wrote:

    that was the whole stack .

    the jobtracker says : ( the reason the map n reduce jobs were killed was )
    :
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    and so on... ( same exception )
    On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

    can you paste the whole stack please. the useful bit is near the bottom


    On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

    Can someone please help out with this error :


    12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
    found main method on: flipkart.null_search_evaluator
    12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
    /home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
    12/07/13 20:45:28 INFO property.AppProps: using app.id:
    03CEDD12347B222235E96B150B8E765D
    12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
    2.0.0-wip-291 [hadoop-0.20.2+]
    12/07/13 20:45:29 INFO flow.Flow: [] starting
    12/07/13 20:45:29 INFO flow.Flow: [] source:
    Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] sink:
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
    12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
    12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
    12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
    native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
    12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
    process : 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
    job_201207131219_0016


    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
    failed tasks
    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
    12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
    12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
    12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
    /user/rishabh/null-search-numbers2/_temporary
    Exception in thread "main" cascading.flow.FlowException: step failed:
    (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
    with job id: job_201207131219_0016, please see cluster logs for failure
    messages
    at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
    at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)
  • Rishabh at Jul 16, 2012 at 7:25 am
    Hi Paul ,

    Could you help me out with lzo usage for taking directories containing lzo
    files as inputs. I'm stuck with this problem . posted on the group in a
    separate thread but have not got a solution . could you help me out with it
    . would be a great help .
    On Sunday, July 15, 2012 3:44:04 PM UTC+5:30, Paul Lam wrote:

    can you post the source?


    On Friday, July 13, 2012 6:54:26 PM UTC+1, Rishabh wrote:

    that was the whole stack .

    the jobtracker says : ( the reason the map n reduce jobs were killed was
    ) :
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at
    cascading.pipe.OperatorException:
    [ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
    Method)] operator Each failed executing operation
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    at cascading.operation.Identity.operate(Identity.java:110)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
    at
    cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
    at
    cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
    and so on... ( same exception )
    On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

    can you paste the whole stack please. the useful bit is near the bottom


    On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

    Can someone please help out with this error :


    12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
    found main method on: flipkart.null_search_evaluator
    12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
    /home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
    12/07/13 20:45:28 INFO property.AppProps: using app.id:
    03CEDD12347B222235E96B150B8E765D
    12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
    2.0.0-wip-291 [hadoop-0.20.2+]
    12/07/13 20:45:29 INFO flow.Flow: [] starting
    12/07/13 20:45:29 INFO flow.Flow: [] source:
    Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] sink:
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled:
    true
    12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
    12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl
    library
    12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
    native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
    12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
    process : 1
    12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
    job_201207131219_0016


    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events
    identify failed tasks
    12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count:
    10
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_0, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_1, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000004_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_2, Status : FAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
    12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
    attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
    12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
    12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
    12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
    12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
    /user/rishabh/null-search-numbers2/_temporary
    Exception in thread "main" cascading.flow.FlowException: step failed:
    (1/1)
    Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
    with job id: job_201207131219_0016, please see cluster logs for failure
    messages
    at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
    at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
    at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
    at java.util.concurrent.FutureTask.run(FutureTask.java:138)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
    at
    java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
    at java.lang.Thread.run(Thread.java:662)

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcascalog-user @
categoriesclojure, hadoop
postedJul 13, '12 at 3:19p
activeJul 16, '12 at 7:25a
posts5
users3
websiteclojure.org
irc#clojure

3 users in discussion

Rishabh: 3 posts Paul Lam: 1 post Paul Lam: 1 post

People

Translate

site design / logo © 2022 Grokbase