Grokbase Groups Hive dev October 2014
FAQ
Alan Gates created HIVE-8543:
--------------------------------

              Summary: Compactions fail on metastore using postgres
                  Key: HIVE-8543
                  URL: https://issues.apache.org/jira/browse/HIVE-8543
              Project: Hive
           Issue Type: Bug
           Components: Metastore
     Affects Versions: 0.14.0
             Reporter: Alan Gates
             Assignee: Alan Gates
             Priority: Critical
              Fix For: 0.14.0


The worker fails to update the stats when the metastore is using Postgres as the RDBMS.

{code}
org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Search Discussions

  • Damien Carol (JIRA) at Oct 21, 2014 at 8:37 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179048#comment-14179048 ]

    Damien Carol commented on HIVE-8543:
    ------------------------------------

    I already have a patch for this one. You could assign it to me.
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Alan Gates (JIRA) at Oct 21, 2014 at 8:44 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179063#comment-14179063 ]

    Alan Gates commented on HIVE-8543:
    ----------------------------------

    I'm testing a fix as well. If it passes I'll post it shortly so you can make sure it works in your environment.
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Alan Gates (JIRA) at Oct 21, 2014 at 9:30 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated HIVE-8543:
    -----------------------------
         Attachment: HIVE-8543.patch

    This patch adds quotes to operations for the TABLE_COL_STATS and PART_COL_STATS tables. The code for this was taken almost exclusively from [~damien.carol]'s patch on HIVE-7689
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Alan Gates (JIRA) at Oct 21, 2014 at 9:30 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated HIVE-8543:
    -----------------------------
         Status: Patch Available (was: Open)
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Hive QA (JIRA) at Oct 22, 2014 at 2:14 am
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179482#comment-14179482 ]

    Hive QA commented on HIVE-8543:
    -------------------------------



    {color:red}Overall{color}: -1 at least one tests failed

    Here are the results of testing the latest attachment:
    https://issues.apache.org/jira/secure/attachment/12676181/HIVE-8543.patch

    {color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 6574 tests executed
    *Failed tests:*
    {noformat}
    org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchCommit_Json
    org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth
    {noformat}

    Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1381/testReport
    Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/1381/console
    Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-1381/

    Messages:
    {noformat}
    Executing org.apache.hive.ptest.execution.PrepPhase
    Executing org.apache.hive.ptest.execution.ExecutionPhase
    Executing org.apache.hive.ptest.execution.ReportingPhase
    Tests exited with: TestsFailedException: 2 tests failed
    {noformat}

    This message is automatically generated.

    ATTACHMENT ID: 12676181 - PreCommit-HIVE-TRUNK-Build
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Damien Carol (JIRA) at Oct 22, 2014 at 8:03 am
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179704#comment-14179704 ]

    Damien Carol commented on HIVE-8543:
    ------------------------------------

    [~alangates] I'm using your patch on a real cluster. Major compactions works. I reviewed the patch. LGTM
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Damien Carol (JIRA) at Oct 22, 2014 at 8:08 am
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14179707#comment-14179707 ]

    Damien Carol commented on HIVE-8543:
    ------------------------------------

    {{org.apache.hive.minikdc.TestJdbcWithMiniKdc.testNegativeTokenAuth}} fails since 15 builds.
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Eugene Koifman (JIRA) at Oct 22, 2014 at 4:57 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180161#comment-14180161 ]

    Eugene Koifman commented on HIVE-8543:
    --------------------------------------

    +1
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Alan Gates (JIRA) at Oct 23, 2014 at 10:49 pm
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Alan Gates updated HIVE-8543:
    -----------------------------
         Resolution: Fixed
             Status: Resolved (was: Patch Available)

    Test failures are not related. I ran the streaming test locally and saw no issues.

    Patch committed to trunk and 0.14 branch. Thanks Damien for writing most of the code for this and Eugene for reviewing it.
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)
  • Damien Carol (JIRA) at Oct 24, 2014 at 8:10 am
    [ https://issues.apache.org/jira/browse/HIVE-8543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182584#comment-14182584 ]

    Damien Carol commented on HIVE-8543:
    ------------------------------------

    [~alangates] You're welcome. I'm sorry I was very busy these last few weeks I have not been able to take care of these "postgres" tickets. You're making a good job with these ones.
    Compactions fail on metastore using postgres
    --------------------------------------------

    Key: HIVE-8543
    URL: https://issues.apache.org/jira/browse/HIVE-8543
    Project: Hive
    Issue Type: Bug
    Components: Metastore
    Affects Versions: 0.14.0
    Reporter: Alan Gates
    Assignee: Alan Gates
    Priority: Critical
    Fix For: 0.14.0

    Attachments: HIVE-8543.patch


    The worker fails to update the stats when the metastore is using Postgres as the RDBMS.
    {code}
    org.postgresql.util.PSQLException: ERROR: relation "tab_col_stats" does not exist
    {code}


    --
    This message was sent by Atlassian JIRA
    (v6.3.4#6332)

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categorieshive, hadoop
postedOct 21, '14 at 7:52p
activeOct 24, '14 at 8:10a
posts11
users1
websitehive.apache.org

1 user in discussion

Damien Carol (JIRA): 11 posts

People

Translate

site design / logo © 2022 Grokbase