Grokbase Groups Pig user July 2011
FAQ
grunt> describe policies_by_type;
policies_by_type: {group: chararray,policies: {columns::udm_field:
chararray,columns::udm_value: chararray}}

grunt> dump policies_by_type;

(POLICY-29,{(policy,POLICY-29)})
(POLICY-71,{(policy,POLICY-71),(policy,POLICY-71),(policy,POLICY-71)})

grunt> policy_counts = FOREACH policies_by_type GENERATE
COUNT(policies);
grunt> describe policy_counts;
policy_counts: {long}

All looks good but when I
grunt> dump policy_counts;

I get:

2011-07-06 04:15:03,539 [main] ERROR
org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to
recreate exception from backed error: Error initializing
attempt_201107010359_0160_m_000000_3:
2011-07-06 04:15:03,539 [main] ERROR
org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
failed!
2011-07-06 04:15:03,540 [main] INFO
org.apache.pig.tools.pigstats.PigStats - Script Statistics:

Input(s):
Successfully read 5 records from: "cassandra://SPC/UDM"

Output(s):
Failed to produce result in "cfs://null/tmp/temp-1373091145/tmp-1591506274"

org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
to open iterator for alias policy_counts. Backend error : Unable to
recreate exception from backed error

Search Discussions

  • Colin Taylor at Jul 6, 2011 at 2:09 pm
    Ok so this works if I run in local mode but not map-reduce mode.
    Can someone enlighten me?
    On Wed, Jul 6, 2011 at 5:01 PM, Colin Taylor wrote:
    grunt> describe policies_by_type;
    policies_by_type: {group: chararray,policies: {columns::udm_field:
    chararray,columns::udm_value: chararray}}

    grunt> dump policies_by_type;

    (POLICY-29,{(policy,POLICY-29)})
    (POLICY-71,{(policy,POLICY-71),(policy,POLICY-71),(policy,POLICY-71)})

    grunt> policy_counts = FOREACH policies_by_type GENERATE
    COUNT(policies);
    grunt> describe policy_counts;
    policy_counts: {long}

    All looks good but when I
    grunt> dump policy_counts;

    I get:

    2011-07-06 04:15:03,539 [main] ERROR
    org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to
    recreate exception from backed error: Error initializing
    attempt_201107010359_0160_m_000000_3:
    2011-07-06 04:15:03,539 [main] ERROR
    org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
    failed!
    2011-07-06 04:15:03,540 [main] INFO
    org.apache.pig.tools.pigstats.PigStats - Script Statistics:

    Input(s):
    Successfully read 5 records from: "cassandra://SPC/UDM"

    Output(s):
    Failed to produce result in "cfs://null/tmp/temp-1373091145/tmp-1591506274"

    org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
    to open iterator for alias policy_counts. Backend error : Unable to
    recreate exception from backed error
  • Dmitriy Ryaboy at Jul 6, 2011 at 3:49 pm
    Can you send along the error log from your failing reduce task? That
    will have the actual error.

    I am guessing this has something to do with the fact that you are
    using cfs (Brisk?)

    D
    On Tue, Jul 5, 2011 at 10:15 PM, Colin Taylor wrote:
    Ok so this works if I run in local mode but not map-reduce mode.
    Can someone enlighten me?
    On Wed, Jul 6, 2011 at 5:01 PM, Colin Taylor wrote:
    grunt> describe policies_by_type;
    policies_by_type: {group: chararray,policies: {columns::udm_field:
    chararray,columns::udm_value: chararray}}

    grunt> dump policies_by_type;

    (POLICY-29,{(policy,POLICY-29)})
    (POLICY-71,{(policy,POLICY-71),(policy,POLICY-71),(policy,POLICY-71)})

    grunt> policy_counts = FOREACH policies_by_type GENERATE
    COUNT(policies);
    grunt> describe policy_counts;
    policy_counts: {long}

    All looks good but when I
    grunt> dump policy_counts;

    I get:

    2011-07-06 04:15:03,539 [main] ERROR
    org.apache.pig.tools.pigstats.PigStats - ERROR 2997: Unable to
    recreate exception from backed error: Error initializing
    attempt_201107010359_0160_m_000000_3:
    2011-07-06 04:15:03,539 [main] ERROR
    org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s)
    failed!
    2011-07-06 04:15:03,540 [main] INFO
    org.apache.pig.tools.pigstats.PigStats - Script Statistics:

    Input(s):
    Successfully read 5 records from: "cassandra://SPC/UDM"

    Output(s):
    Failed to produce result in "cfs://null/tmp/temp-1373091145/tmp-1591506274"

    org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable
    to open iterator for alias policy_counts. Backend error : Unable to
    recreate exception from backed error

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedJul 6, '11 at 2:09p
activeJul 6, '11 at 3:49p
posts3
users2
websitepig.apache.org

2 users in discussion

Colin Taylor: 2 posts Dmitriy Ryaboy: 1 post

People

Translate

site design / logo © 2021 Grokbase