[cascalog-user] blockOnJob Exception

[cascalog-user] blockOnJob Exception

	Rishabh
	Jul 13, 2012 at 3:19 pm

Can someone please help out with this error :

12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to process
: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016

12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

Search Discussions

4 responses
Oldest
Nested

Paul Lam can you paste the whole stack please. the useful bit is near the bottom

Paul Lam at Jul 13, 2012 at 4:05 pm ⇧

can you paste the whole stack please. the useful bit is near the bottom

On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

Can someone please help out with this error :

12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
process : 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016

12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed:
(1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

reply | permalink

Rishabh

at Jul 13, 2012 at 5:54 pm

⇧

that was the whole stack .

the jobtracker says : ( the reason the map n reduce jobs were killed was )
:
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
and so on... ( same exception )

On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

can you paste the whole stack please. the useful bit is near the bottom

On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

Can someone please help out with this error :

12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
process : 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016

12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed:
(1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

reply | permalink

Paul Lam can you post the source?

Paul Lam at Jul 15, 2012 at 10:14 am ⇧

can you post the source?

On Friday, July 13, 2012 6:54:26 PM UTC+1, Rishabh wrote:

that was the whole stack .

the jobtracker says : ( the reason the map n reduce jobs were killed was )
:
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
and so on... ( same exception )
On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

can you paste the whole stack please. the useful bit is near the bottom

On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

Can someone please help out with this error :

12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled: true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
process : 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016

12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events identify
failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count: 10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed:
(1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

reply | permalink

Rishabh

at Jul 16, 2012 at 7:25 am

⇧

Hi Paul ,

Could you help me out with lzo usage for taking directories containing lzo
files as inputs. I'm stuck with this problem . posted on the group in a
separate thread but have not got a solution . could you help me out with it
. would be a great help .

On Sunday, July 15, 2012 3:44:04 PM UTC+5:30, Paul Lam wrote:

can you post the source?

On Friday, July 13, 2012 6:54:26 PM UTC+1, Rishabh wrote:

that was the whole stack .

the jobtracker says : ( the reason the map n reduce jobs were killed was
) :
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at
cascading.pipe.OperatorException:
[ee8d5e01-4b28-4f6d-9f7...][sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)] operator Each failed executing operation
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:94)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
at cascading.operation.Identity.operate(Identity.java:110)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:86)
at
cascading.flow.stream.FunctionEachStage.receive(FunctionEachStage.java:38)
at
cascading.flow.stream.FunctionEachStage$1.collect(FunctionEachStage.java:67)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:86)
and so on... ( same exception )

On Friday, July 13, 2012 9:35:27 PM UTC+5:30, Paul Lam wrote:

can you paste the whole stack please. the useful bit is near the bottom

On Friday, 13 July 2012 16:18:58 UTC+1, Rishabh wrote:

Can someone please help out with this error :

12/07/13 20:45:28 INFO util.HadoopUtil: resolving application jar from
found main method on: flipkart.null_search_evaluator
12/07/13 20:45:28 INFO planner.HadoopPlanner: using application jar:
/home/rishabh.dhall/log-processor-1.0.0-SNAPSHOT-standalone.jar
12/07/13 20:45:28 INFO property.AppProps: using app.id:
03CEDD12347B222235E96B150B8E765D
12/07/13 20:45:29 INFO util.Version: Concurrent, Inc - Cascading
2.0.0-wip-291 [hadoop-0.20.2+]
12/07/13 20:45:29 INFO flow.Flow: [] starting
12/07/13 20:45:29 INFO flow.Flow: [] source:
Hfs["TextLine[['line']->[ALL]]"]["/user/log/website/events/w3-web9-events.log.2012-07-05"]"]
12/07/13 20:45:29 INFO flow.Flow: [] sink:
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO flow.Flow: [] parallel execution is enabled:
true
12/07/13 20:45:29 INFO flow.Flow: [] starting jobs: 1
12/07/13 20:45:29 INFO flow.Flow: [] allocating threads: 1
12/07/13 20:45:29 INFO flow.FlowStep: [] starting step: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:45:29 INFO lzo.GPLNativeCodeLoader: Loaded native gpl
library
12/07/13 20:45:29 INFO lzo.LzoCodec: Successfully loaded & initialized
native-lzo library [hadoop-lzo rev 6bb1b7f8b9044d8df9b4d2b6641db7658aab3cf8]
12/07/13 20:45:29 INFO mapred.FileInputFormat: Total input paths to
process : 1
12/07/13 20:45:29 INFO flow.FlowStep: [] submitted hadoop job:
job_201207131219_0016

12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events
identify failed tasks
12/07/13 20:46:03 WARN flow.FlowStep: [] task completion events count:
10
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000006_0, Status : SUCCEEDED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_0, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_1, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000004_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_2, Status : FAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000002_3, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000003_0, Status : TIPFAILED
12/07/13 20:46:03 WARN flow.FlowStep: [] event = Task Id :
attempt_201207131219_0016_m_000000_0, Status : TIPFAILED
12/07/13 20:46:03 INFO flow.Flow: [] stopping all jobs
12/07/13 20:46:03 INFO flow.FlowStep: [] stopping: (1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"]
12/07/13 20:46:03 INFO flow.Flow: [] stopped all jobs
12/07/13 20:46:03 INFO util.Hadoop18TapUtil: deleting temp path
/user/rishabh/null-search-numbers2/_temporary
Exception in thread "main" cascading.flow.FlowException: step failed:
(1/1)
Hfs["TextLine[['line']->[ALL]]"]["/user/rishabh/null-search-numbers2/"]"],
with job id: job_201207131219_0016, please see cluster logs for failure
messages
at cascading.flow.planner.FlowStepJob.blockOnJob(FlowStepJob.java:193)
at cascading.flow.planner.FlowStepJob.start(FlowStepJob.java:137)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:122)
at cascading.flow.planner.FlowStepJob.call(FlowStepJob.java:42)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)

reply | permalink

Related Discussions

Discussion Navigation

view	thread \| post

Discussion Overview

group	cascalog-user @
categories	clojure, hadoop
posted	Jul 13, '12 at 3:19p
active	Jul 16, '12 at 7:25a
posts	5
users	3
website	clojure.org
irc	#clojure

responses	expanded	Hotkey: s
font	variable	Hotkey: f
user style	avatars	Hotkey: a

[cascalog-user] blockOnJob Exception

Search Discussions

Related Discussions

3 users in discussion