FAQ
I'm trying to add a trap to a query and it's throwing an NPE. Has anyone
seen this before and know how to fix? To get this I just added (:trap
(stdout)) to an existing query. I tried using an hfs-textline as a trap too
and it also throws an NPE, but still writes out to the file. Any idea
what's going on?


WARN - job_local_0002
cascading.tuple.TupleException: unable to sink into output identifier:
/tmp/temp56747071979221331027984311794612
at
cascading.tuple.TupleEntrySchemeCollector.collect(TupleEntrySchemeCollector.java:160)
at
cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:71)
at
cascading.tuple.TupleEntrySchemeCollector.add(TupleEntrySchemeCollector.java:134)
at cascading.flow.stream.TrapHandler.handleException(TrapHandler.java:131)
at cascading.flow.stream.TrapHandler.handleException(TrapHandler.java:115)
at cascading.flow.stream.ElementStage.handleException(ElementStage.java:134)
at
cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:139)
at
cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:41)
at cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:90)
at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:129)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
Caused by: java.lang.NullPointerException
at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:987)
at
org.apache.hadoop.mapred.SequenceFileOutputFormat$1.write(SequenceFileOutputFormat.java:75)
at
cascading.tap.hadoop.io.TapOutputCollector.collect(TapOutputCollector.java:115)
at
cascading.tap.hadoop.util.MeasuredOutputCollector.collect(MeasuredOutputCollector.java:69)
at cascading.scheme.hadoop.SequenceFile.sink(SequenceFile.java:120)
at
cascading.tuple.TupleEntrySchemeCollector.collect(TupleEntrySchemeCollector.java:153)
... 13 more

RESULTS
-----------------------
****-07-02 14:09:29.318000
-----------------------
INFO - reduce > reduce

Search Discussions

  • David Kincaid at Jul 13, 2012 at 4:06 am
    It turns out that there was an NPE being thrown by a defbufferiterop that
    was causing this problem. Once I fixed that problem the trap started
    working.
    On Thursday, July 12, 2012 9:27:38 PM UTC-5, David Kincaid wrote:

    I'm trying to add a trap to a query and it's throwing an NPE. Has anyone
    seen this before and know how to fix? To get this I just added (:trap
    (stdout)) to an existing query. I tried using an hfs-textline as a trap too
    and it also throws an NPE, but still writes out to the file. Any idea
    what's going on?


    WARN - job_local_0002
    cascading.tuple.TupleException: unable to sink into output identifier:
    /tmp/temp56747071979221331027984311794612
    at
    cascading.tuple.TupleEntrySchemeCollector.collect(TupleEntrySchemeCollector.java:160)
    at
    cascading.tuple.TupleEntryCollector.safeCollect(TupleEntryCollector.java:93)
    at cascading.tuple.TupleEntryCollector.add(TupleEntryCollector.java:71)
    at
    cascading.tuple.TupleEntrySchemeCollector.add(TupleEntrySchemeCollector.java:134)
    at cascading.flow.stream.TrapHandler.handleException(TrapHandler.java:131)
    at cascading.flow.stream.TrapHandler.handleException(TrapHandler.java:115)
    at
    cascading.flow.stream.ElementStage.handleException(ElementStage.java:134)
    at
    cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:139)
    at
    cascading.flow.stream.BufferEveryWindow.receive(BufferEveryWindow.java:41)
    at
    cascading.flow.hadoop.stream.HadoopGroupGate.run(HadoopGroupGate.java:90)
    at cascading.flow.hadoop.FlowReducer.reduce(FlowReducer.java:129)
    at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
    at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
    at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:216)
    Caused by: java.lang.NullPointerException
    at org.apache.hadoop.io.SequenceFile$Writer.append(SequenceFile.java:987)
    at
    org.apache.hadoop.mapred.SequenceFileOutputFormat$1.write(SequenceFileOutputFormat.java:75)
    at
    cascading.tap.hadoop.io.TapOutputCollector.collect(TapOutputCollector.java:115)
    at
    cascading.tap.hadoop.util.MeasuredOutputCollector.collect(MeasuredOutputCollector.java:69)
    at cascading.scheme.hadoop.SequenceFile.sink(SequenceFile.java:120)
    at
    cascading.tuple.TupleEntrySchemeCollector.collect(TupleEntrySchemeCollector.java:153)
    ... 13 more

    RESULTS
    -----------------------
    ****-07-02 14:09:29.318000
    -----------------------
    INFO - reduce > reduce

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupcascalog-user @
categoriesclojure, hadoop
postedJul 13, '12 at 2:27a
activeJul 13, '12 at 4:06a
posts2
users1
websiteclojure.org
irc#clojure

1 user in discussion

David Kincaid: 2 posts

People

Translate

site design / logo © 2023 Grokbase