FAQ
Mohit Sabharwal created HIVE-9206:
-------------------------------------

              Summary: Fix Desc Formatted related Java 8 ordering differences
                  Key: HIVE-9206
                  URL: https://issues.apache.org/jira/browse/HIVE-9206
              Project: Hive
           Issue Type: Sub-task
           Components: Tests
             Reporter: Mohit Sabharwal
             Assignee: Mohit Sabharwal


This patch fixes the following tests for Java 8:

(1) list_bucket_dml_*.q

{{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.

(2) partitions_json.q

{{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Search Discussions

  • Mohit Sabharwal (JIRA) at Dec 24, 2014 at 12:46 am
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mohit Sabharwal updated HIVE-9206:
    ----------------------------------
         Attachment: HIVE-9206.patch
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Mohit Sabharwal (JIRA) at Dec 24, 2014 at 12:47 am
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mohit Sabharwal updated HIVE-9206:
    ----------------------------------
         Status: Patch Available (was: Open)
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Hive QA (JIRA) at Dec 24, 2014 at 11:23 am
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258179#comment-14258179 ]

    Hive QA commented on HIVE-9206:
    -------------------------------



    {color:red}Overall{color}: -1 at least one tests failed

    Here are the results of testing the latest attachment:
    https://issues.apache.org/jira/secure/attachment/12688956/HIVE-9206.patch

    {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 6722 tests executed
    *Failed tests:*
    {noformat}
    org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
    org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_list_bucket_dml_10
    {noformat}

    Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2187/testReport
    Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2187/console
    Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2187/

    Messages:
    {noformat}
    Executing org.apache.hive.ptest.execution.PrepPhase
    Executing org.apache.hive.ptest.execution.ExecutionPhase
    Executing org.apache.hive.ptest.execution.ReportingPhase
    Tests exited with: TestsFailedException: 2 tests failed
    {noformat}

    This message is automatically generated.

    ATTACHMENT ID: 12688956 - PreCommit-HIVE-TRUNK-Build
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Brock Noland (JIRA) at Dec 24, 2014 at 2:36 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258297#comment-14258297 ]

    Brock Noland commented on HIVE-9206:
    ------------------------------------

    +1
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Mohit Sabharwal (JIRA) at Dec 24, 2014 at 5:03 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Mohit Sabharwal updated HIVE-9206:
    ----------------------------------
         Attachment: HIVE-9206.1.patch
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Mohit Sabharwal (JIRA) at Dec 24, 2014 at 5:06 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258377#comment-14258377 ]

    Mohit Sabharwal commented on HIVE-9206:
    ---------------------------------------

    Updated patch with fix for TestMinimrCliDriver.testCliDriver_list_bucket_dml_10 (previous version had output generated via {{TestCliDriver}} instead {{TestMinimrCliDriver}})
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Brock Noland (JIRA) at Dec 24, 2014 at 5:50 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258405#comment-14258405 ]

    Brock Noland commented on HIVE-9206:
    ------------------------------------

    +1
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Hive QA (JIRA) at Dec 24, 2014 at 6:30 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14258427#comment-14258427 ]

    Hive QA commented on HIVE-9206:
    -------------------------------



    {color:red}Overall{color}: -1 at least one tests failed

    Here are the results of testing the latest attachment:
    https://issues.apache.org/jira/secure/attachment/12689048/HIVE-9206.1.patch

    {color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 6722 tests executed
    *Failed tests:*
    {noformat}
    org.apache.hadoop.hive.cli.TestMiniTezCliDriver.testCliDriver_optimize_nullscan
    {noformat}

    Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2193/testReport
    Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/2193/console
    Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-2193/

    Messages:
    {noformat}
    Executing org.apache.hive.ptest.execution.PrepPhase
    Executing org.apache.hive.ptest.execution.ExecutionPhase
    Executing org.apache.hive.ptest.execution.ReportingPhase
    Tests exited with: TestsFailedException: 1 tests failed
    {noformat}

    This message is automatically generated.

    ATTACHMENT ID: 12689048 - PreCommit-HIVE-TRUNK-Build
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Brock Noland (JIRA) at Dec 29, 2014 at 4:22 am
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14259833#comment-14259833 ]

    Brock Noland commented on HIVE-9206:
    ------------------------------------

    Sorry [~mohitsabharwal] looks like this got out of date. Could you rebase and I will commit right away.
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Brock Noland (JIRA) at Dec 29, 2014 at 3:56 pm
    [ https://issues.apache.org/jira/browse/HIVE-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Brock Noland updated HIVE-9206:
    -------------------------------
            Resolution: Fixed
         Fix Version/s: 0.15.0
                Status: Resolved (was: Patch Available)

    Actually I noted that I committed this four days back. My mistake, not sure what happened there.
    Fix Desc Formatted related Java 8 ordering differences
    ------------------------------------------------------

    Key: HIVE-9206
    URL: https://issues.apache.org/jira/browse/HIVE-9206
    Project: Hive
    Issue Type: Sub-task
    Components: Tests
    Reporter: Mohit Sabharwal
    Assignee: Mohit Sabharwal
    Fix For: 0.15.0

    Attachments: HIVE-9206.1.patch, HIVE-9206.patch


    This patch fixes the following tests for Java 8:
    (1) list_bucket_dml_*.q
    {{DESC FORMATTED}} calls {{StorageDescriptor.getSkewedInfo()}} HMS API, which returns a thrift (unordered) map. Generate java version specific out file for these tests.
    (2) partitions_json.q
    {{SHOW PARTITIONS}} uses {{MapBuilder}} via {{JsonMetaDataFormatter}} which uses {{HashMap}}. Changed it to ordered map.


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categorieshive, hadoop
postedDec 24, '14 at 12:43a
activeDec 29, '14 at 3:56p
posts11
users1
websitehive.apache.org

1 user in discussion

Brock Noland (JIRA): 11 posts

People

Translate

site design / logo © 2021 Grokbase