Grokbase Groups Pig user May 2011
FAQ
I have a pig script that is tested and working in local mode. But when I try to run it in mapreduce mode on a non-local hadoop cluster I get an error with this stack trace:

ERROR 2999: Unexpected internal error. java.lang.String cannot be cast to org.apache.pig.data.Tuple

java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.Tuple
at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:220)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:237)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)

I’m using pig 0.8.1. Locally I have hadoop 0.20.2; the remote cluster has Hadoop 0.20.2+320.

Has anyone seen this before? Any suggestions on how to track it down?
Thanks,

Will


William F Dowling
Sr Technical Specialist, Software Engineering
Thomson Reuters
0 +1 215 823 3853

Search Discussions

  • William Dowling at May 6, 2011 at 10:06 pm
    In case anyone comes across this ...

    This problem went away when I fixed a define ... ship(...)

    to make sure that the file I was shipping was accessible from the running environment on the non-local
    cluster.


    William F Dowling
    Sr Technical Specialist, Software Engineering
    Thomson Reuters
    0 +1 215 823 3853

    -----Original Message-----
    From: Dowling, William (Professional)
    Sent: Friday, May 06, 2011 4:17 PM
    To: user@pig.apache.org
    Subject: ERROR: String cannot be cast to org.apache.pig.data.Tuple

    I have a pig script that is tested and working in local mode. But when I try to run it in mapreduce mode on a non-local hadoop cluster I get an error with this stack trace:

    ERROR 2999: Unexpected internal error. java.lang.String cannot be cast to org.apache.pig.data.Tuple

    java.lang.ClassCastException: java.lang.String cannot be cast to org.apache.pig.data.Tuple
    at org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators.POSplit.getNext(POSplit.java:220)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.runPipeline(PigMapBase.java:237)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:232)
    at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigMapBase.map(PigMapBase.java:53)
    at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:144)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:621)
    at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)

    I’m using pig 0.8.1. Locally I have hadoop 0.20.2; the remote cluster has Hadoop 0.20.2+320.

    Has anyone seen this before? Any suggestions on how to track it down?
    Thanks,

    Will


    William F Dowling
    Sr Technical Specialist, Software Engineering
    Thomson Reuters
    0 +1 215 823 3853

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedMay 6, '11 at 8:17p
activeMay 6, '11 at 10:06p
posts2
users1
websitepig.apache.org

1 user in discussion

William Dowling: 2 posts

People

Translate

site design / logo © 2021 Grokbase