Grokbase Groups Pig user July 2011
FAQ
Hello,
I run pig test case with cmd: ant test. I am wondering which part is the failure ones? test with Failures or with Errors?
And please help to check why these tests result with Failures or Errors.
Here is the ones with Failures and Errors:
[junit] Running org.apache.pig.test.TestDataModel
[junit] Tests run: 22, Failures: 1, Errors: 0, Time elapsed: 0.382 sec

[junit] Running org.apache.pig.test.TestLogToPhyCompiler
[junit] Tests run: 23, Failures: 1, Errors: 0, Time elapsed: 1.16 sec

[junit] Running org.apache.pig.test.TestMRCompiler
[junit] Tests run: 25, Failures: 1, Errors: 0, Time elapsed: 0.729 sec

[junit] Running org.apache.pig.test.TestMergeJoinOuter
[junit] Tests run: 5, Failures: 1, Errors: 0, Time elapsed: 132.66 sec

[junit] Running org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor
[junit] Tests run: 25, Failures: 3, Errors: 0, Time elapsed: 1.081 sec

[junit] Running org.apache.pig.test.TestPruneColumn
[junit] Tests run: 67, Failures: 4, Errors: 0, Time elapsed: 528.047 sec

[junit] Running org.apache.pig.test.TestUnionOnSchema
[junit] Tests run: 21, Failures: 1, Errors: 0, Time elapsed: 196.841 sec

[junit] Running org.apache.pig.test.TestJobSubmission
[junit] Tests run: 6, Failures: 0, Errors: 6, Time elapsed: 0.311 sec

[junit] Running org.apache.pig.test.TestPigContext
[junit] Tests run: 5, Failures: 0, Errors: 4, Time elapsed: 21.401 sec

[junit] Running org.apache.pig.test.TestPushDownForeachFlatten
[junit] Tests run: 37, Failures: 0, Errors: 8, Time elapsed: 1.455 sec

[junit] Running org.apache.pig.test.TestTypeCheckingValidator
[junit] Tests run: 120, Failures: 0, Errors: 1, Time elapsed: 15.047 sec

Search Discussions

  • Dmitriy Ryaboy at Jul 29, 2011 at 5:55 pm
    Failures and Errors are both bad.
    Look at the error logs (found in build/test/logs) to see why the tests are
    breaking.

    -Dmitriy

    2011/7/28 lulynn_2008 <lulynn_2008@163.com>
    Hello,
    I run pig test case with cmd: ant test. I am wondering which part is the
    failure ones? test with Failures or with Errors?
    And please help to check why these tests result with Failures or Errors.
    Here is the ones with Failures and Errors:
    [junit] Running org.apache.pig.test.TestDataModel
    [junit] Tests run: 22, Failures: 1, Errors: 0, Time elapsed: 0.382 sec

    [junit] Running org.apache.pig.test.TestLogToPhyCompiler
    [junit] Tests run: 23, Failures: 1, Errors: 0, Time elapsed: 1.16 sec

    [junit] Running org.apache.pig.test.TestMRCompiler
    [junit] Tests run: 25, Failures: 1, Errors: 0, Time elapsed: 0.729 sec

    [junit] Running org.apache.pig.test.TestMergeJoinOuter
    [junit] Tests run: 5, Failures: 1, Errors: 0, Time elapsed: 132.66 sec

    [junit] Running
    org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor
    [junit] Tests run: 25, Failures: 3, Errors: 0, Time elapsed: 1.081 sec

    [junit] Running org.apache.pig.test.TestPruneColumn
    [junit] Tests run: 67, Failures: 4, Errors: 0, Time elapsed: 528.047 sec

    [junit] Running org.apache.pig.test.TestUnionOnSchema
    [junit] Tests run: 21, Failures: 1, Errors: 0, Time elapsed: 196.841 sec

    [junit] Running org.apache.pig.test.TestJobSubmission
    [junit] Tests run: 6, Failures: 0, Errors: 6, Time elapsed: 0.311 sec

    [junit] Running org.apache.pig.test.TestPigContext
    [junit] Tests run: 5, Failures: 0, Errors: 4, Time elapsed: 21.401 sec

    [junit] Running org.apache.pig.test.TestPushDownForeachFlatten
    [junit] Tests run: 37, Failures: 0, Errors: 8, Time elapsed: 1.455 sec

    [junit] Running org.apache.pig.test.TestTypeCheckingValidator
    [junit] Tests run: 120, Failures: 0, Errors: 1, Time elapsed: 15.047 sec
  • Fang Fang FF Chen at Aug 1, 2011 at 2:23 am
  • Thejas Nair at Jul 29, 2011 at 5:59 pm
    All these tests should be passing. I ran a complete run yesterday and it
    passed.
    Can you check the log files for these failed test cases ? Do let us know
    what you find.

    Thanks,
    Thejas

    On 7/28/11 8:29 PM, lulynn_2008 wrote:
    Hello,
    I run pig test case with cmd: ant test. I am wondering which part is the failure ones? test with Failures or with Errors?
    And please help to check why these tests result with Failures or Errors.
    Here is the ones with Failures and Errors:
    [junit] Running org.apache.pig.test.TestDataModel
    [junit] Tests run: 22, Failures: 1, Errors: 0, Time elapsed: 0.382 sec

    [junit] Running org.apache.pig.test.TestLogToPhyCompiler
    [junit] Tests run: 23, Failures: 1, Errors: 0, Time elapsed: 1.16 sec

    [junit] Running org.apache.pig.test.TestMRCompiler
    [junit] Tests run: 25, Failures: 1, Errors: 0, Time elapsed: 0.729 sec

    [junit] Running org.apache.pig.test.TestMergeJoinOuter
    [junit] Tests run: 5, Failures: 1, Errors: 0, Time elapsed: 132.66 sec

    [junit] Running org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor
    [junit] Tests run: 25, Failures: 3, Errors: 0, Time elapsed: 1.081 sec

    [junit] Running org.apache.pig.test.TestPruneColumn
    [junit] Tests run: 67, Failures: 4, Errors: 0, Time elapsed: 528.047 sec

    [junit] Running org.apache.pig.test.TestUnionOnSchema
    [junit] Tests run: 21, Failures: 1, Errors: 0, Time elapsed: 196.841 sec

    [junit] Running org.apache.pig.test.TestJobSubmission
    [junit] Tests run: 6, Failures: 0, Errors: 6, Time elapsed: 0.311 sec

    [junit] Running org.apache.pig.test.TestPigContext
    [junit] Tests run: 5, Failures: 0, Errors: 4, Time elapsed: 21.401 sec

    [junit] Running org.apache.pig.test.TestPushDownForeachFlatten
    [junit] Tests run: 37, Failures: 0, Errors: 8, Time elapsed: 1.455 sec

    [junit] Running org.apache.pig.test.TestTypeCheckingValidator
    [junit] Tests run: 120, Failures: 0, Errors: 1, Time elapsed: 15.047 sec
  • Fang Fang FF Chen at Aug 1, 2011 at 3:10 am
  • Thejas Nair at Aug 1, 2011 at 6:48 pm
    Sun - java version "1.6.0_05"
    Linux 2.6.18-238.1.1.el5
    Apache Ant(TM) version 1.8.2 (there were some recent fixes on trunk to
    get it working with 1.8, v 1.7.x also should work fine.)

    A test case is considered failed if one of the junit asserts failed.
    It is supposed to have errored out if the test did not pass because of
    other reasons such as a run time exception.

    I think for some reason, the initializations might not be happening
    correctly for the junit tests in your environment.

    -Thejas


    On 7/31/11 8:08 PM, Fang Fang FF Chen wrote:
    Thank you.
    Could you please tell me your tests running environment?(including OS,
    ant version, java version or any other information you think it useful)
    Thank you.
    I have another question: what is the differences between Failure and Error?

    My last tests environment is IBM JDK 6.0.
    Now, I run tests with SUN JDK 6 at linux VM.
    Here are the failure ones:
    [junit] Running org.apache.pig.test.TestJobSubmission
    [junit] Tests run: 6, Failures: 0, Errors: 6, Time elapsed: 0.213 sec
    ERROR info:
    Testcase: testJobControlCompilerErr took 0.209 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler.<init>(MRCompiler.java:220)
    at org.apache.pig.test.Util.buildMRPlan(Util.java:610)
    at
    org.apache.pig.test.TestJobSubmission.testJobControlCompilerErr(TestJobSubmission.java:455)

    Testcase: testDefaultParallel took 0 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.TestJobSubmission.testDefaultParallel(TestJobSubmission.java:480)

    Testcase: testDefaultParallelInSort took 0 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.TestJobSubmission.testDefaultParallelInSort(TestJobSubmission.java:506)

    Testcase: testDefaultParallelInSkewJoin took 0 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.TestJobSubmission.testDefaultParallelInSkewJoin(TestJobSubmission.java:538)

    Testcase: testReducerNumEstimation took 0 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.utils.LogicalPlanTester.buildPlan(LogicalPlanTester.java:213)
    at
    org.apache.pig.test.utils.LogicalPlanTester.buildPlan(LogicalPlanTester.java:90)
    at
    org.apache.pig.test.TestJobSubmission.testReducerNumEstimation(TestJobSubmission.java:573)

    Testcase: testReducerNumEstimationForOrderBy took 0 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.TestJobSubmission.testReducerNumEstimationForOrderBy(TestJobSubmission.java:638)

    [junit] Running org.apache.pig.test.TestPigContext
    [junit] Tests run: 5, Failures: 0, Errors: 4, Time elapsed: 25.258 sec
    ERROR info:
    Testcase: testSetProperties_way_num01 took 7.342 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at org.apache.pig.test.Util.deleteFile(Util.java:355)
    at
    org.apache.pig.test.TestPigContext.registerAndStore(TestPigContext.java:247)
    at
    org.apache.pig.test.TestPigContext.testSetProperties_way_num01(TestPigContext.java:79)

    Testcase: testSetProperties_way_num02 took 6.744 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at org.apache.pig.test.Util.deleteFile(Util.java:355)
    at
    org.apache.pig.test.TestPigContext.registerAndStore(TestPigContext.java:247)
    at
    org.apache.pig.test.TestPigContext.testSetProperties_way_num02(TestPigContext.java:90)

    Testcase: testSetProperties_way_num03 took 6.529 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at org.apache.pig.test.Util.deleteFile(Util.java:355)
    at
    org.apache.pig.test.TestPigContext.registerAndStore(TestPigContext.java:247)
    at
    org.apache.pig.test.TestPigContext.testSetProperties_way_num03(TestPigContext.java:102)

    Testcase: testHadoopExceptionCreation took 0.001 sec
    Testcase: testImportList took 4.639 sec
    Caused an ERROR
    null
    java.lang.NullPointerException
    at
    org.apache.pig.test.TestPigContext.testImportList(TestPigContext.java:166)

    [junit] Running org.apache.pig.test.TestSecondarySort
    [junit] Tests run: 23, Failures: 0, Errors: 1, Time elapsed: 266.962 sec
    ERROR info:
    11/07/29 00:43:45 ERROR datanode.DataNode:
    DatanodeRegistration(127.0.0.1:58268,
    storageID=DS-1419642392-9.30.225.174-58268-1311925373248,
    infoPort=58078, ipcPort=54297):DataXceiver
    java.io.IOException: Block blk_-7540439302049668681_1012 is not valid.
    at
    org.apache.hadoop.hdfs.server.datanode.FSDataset.getBlockFile(FSDataset.java:734)
    at
    org.apache.hadoop.hdfs.server.datanode.FSDataset.getLength(FSDataset.java:722)
    at
    org.apache.hadoop.hdfs.server.datanode.BlockSender.<init>(BlockSender.java:92)
    at
    org.apache.hadoop.hdfs.server.datanode.DataXceiver.readBlock(DataXceiver.java:172)
    at
    org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:95)
    at java.lang.Thread.run(Thread.java:619)




    Thanks.
    Regards,
    FangFang CHEN / 陈芳芳
    ----------------------------------
    BigInsights Team, CDL
    Phone: 86-10-82453744
    ----------------------------------



    Inactive hide details for Thejas Nair ---2011-07-30 02:01:51---All these
    tests should be passing. I ran a complete run yesterdaThejas Nair
    ---2011-07-30 02:01:51---All these tests should be passing. I ran a
    complete run yesterday and it

    *Thejas Nair <thejas@hortonworks.com>*

    2011-07-30 01:59
    Please respond to
    user@pig.apache.org



    To

    user@pig.apache.org

    cc

    lulynn_2008 <lulynn_2008@163.com>

    Subject

    Re: about pig "ant test" result




    All these tests should be passing. I ran a complete run yesterday and it
    passed.
    Can you check the log files for these failed test cases ? Do let us know
    what you find.

    Thanks,
    Thejas

    On 7/28/11 8:29 PM, lulynn_2008 wrote:
    Hello,
    I run pig test case with cmd: ant test. I am wondering which part is
    the failure ones? test with Failures or with Errors?
    And please help to check why these tests result with Failures or Errors.
    Here is the ones with Failures and Errors:
    [junit] Running org.apache.pig.test.TestDataModel
    [junit] Tests run: 22, Failures: 1, Errors: 0, Time elapsed: 0.382 sec

    [junit] Running org.apache.pig.test.TestLogToPhyCompiler
    [junit] Tests run: 23, Failures: 1, Errors: 0, Time elapsed: 1.16 sec

    [junit] Running org.apache.pig.test.TestMRCompiler
    [junit] Tests run: 25, Failures: 1, Errors: 0, Time elapsed: 0.729 sec

    [junit] Running org.apache.pig.test.TestMergeJoinOuter
    [junit] Tests run: 5, Failures: 1, Errors: 0, Time elapsed: 132.66 sec

    [junit] Running org.apache.pig.test.TestNewPlanLogToPhyTranslationVisitor
    [junit] Tests run: 25, Failures: 3, Errors: 0, Time elapsed: 1.081 sec

    [junit] Running org.apache.pig.test.TestPruneColumn
    [junit] Tests run: 67, Failures: 4, Errors: 0, Time elapsed: 528.047 sec

    [junit] Running org.apache.pig.test.TestUnionOnSchema
    [junit] Tests run: 21, Failures: 1, Errors: 0, Time elapsed: 196.841 sec

    [junit] Running org.apache.pig.test.TestJobSubmission
    [junit] Tests run: 6, Failures: 0, Errors: 6, Time elapsed: 0.311 sec

    [junit] Running org.apache.pig.test.TestPigContext
    [junit] Tests run: 5, Failures: 0, Errors: 4, Time elapsed: 21.401 sec

    [junit] Running org.apache.pig.test.TestPushDownForeachFlatten
    [junit] Tests run: 37, Failures: 0, Errors: 8, Time elapsed: 1.455 sec

    [junit] Running org.apache.pig.test.TestTypeCheckingValidator
    [junit] Tests run: 120, Failures: 0, Errors: 1, Time elapsed: 15.047 sec

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categoriespig, hadoop
postedJul 29, '11 at 3:30a
activeAug 1, '11 at 6:48p
posts6
users4
websitepig.apache.org

People

Translate

site design / logo © 2022 Grokbase