Grokbase Groups Hive user March 2011
FAQ
We're upgrading our Hadoop cluster (including Hive) to CDH3B4 on our dev cluster. After doing so, we see some concerning WARN logs, when connecting via the embedded hive JDBC connector. It doesn't seem to cause any obvious ill-effects, but I thought I'd post to this list to see if anyone had any insight.

-Andrew Harrison

Logs:

2011-03-10 10:36:01 [ main] INFO DataNucleus.Persistence - ===========================================================
2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema - Initialising Catalog "", Schema "" using "None" auto-start option
2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema - Catalog "", Schema "" initialised - managing 0 classes [FIXED]
2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore - Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo, Partition,Database,Type,FieldSchema,Order"
2011-03-10 10:36:02 [ main] INFO DataNucleus.MetaData - Registering listener for metadata initialisation
2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore - Initialized ObjectStore
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the declaration of element 'jdo'. - Please check your specification of DTD and the validity of the MetaData XML that y ou have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 312, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 359, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 381, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 416, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 453, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 494, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 535, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 576, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 621, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData - MetaData Parser encountered an error in file "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C DH3B4.jar!/package.jdo" at line 666, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence - Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MDatabase [Table : `DBS`, InheritanceSt rategy : new-table]
2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence - Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table : `DATABASE _PARAMS`]
2011-03-10 10:36:03 [ main] INFO DataNucleus.MetaData - Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MDatabase
Hive history file=/tmp/aharrison/hive_job_log_aharrison_201103101036_1220815779.txt

Search Discussions

  • Carl Steinbach at Mar 10, 2011 at 8:59 pm
    Hi Andrew,

    You can safely ignore these warnings. Datanucleus is complaining because the
    metastore mapping file fails to validate against the JDO DTD, apparently
    because we failed to put the elements in a certain specific order. As far as
    I can tell Datanucleus ignores the validation errors, so this shouldn't be
    an issue.

    Thanks.

    Carl
    On Thu, Mar 10, 2011 at 12:51 PM, Andrew Harrison wrote:

    We’re upgrading our Hadoop cluster (including Hive) to CDH3B4 on our dev
    cluster. After doing so, we see some concerning WARN logs, when connecting
    via the embedded hive JDBC connector. It doesn’t seem to cause any obvious
    ill-effects, but I thought I’d post to this list to see if anyone had any
    insight.



    -Andrew Harrison



    Logs:



    2011-03-10 10:36:01 [ main] INFO DataNucleus.Persistence
    - ===========================================================

    2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema
    - Initialising Catalog "", Schema "" using "None" auto-start option

    2011-03-10 10:36:02 [ main] INFO DataNucleus.Datastore.Schema
    - Catalog "", Schema "" initialised - managing 0 classes [FIXED]

    2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore
    - Setting MetaStore object pin classes with
    hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,
    Partition,Database,Type,FieldSchema,Order"

    2011-03-10 10:36:02 [ main] INFO DataNucleus.MetaData
    - Registering listener for metadata initialisation

    2011-03-10 10:36:02 [ main] INFO oop.hive.metastore.ObjectStore
    - Initialized ObjectStore

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the
    declaration of element 'jdo'. - Please check your specification of DTD and
    the validity of the MetaData XML that y ou have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 312, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 359, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 381, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 416, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 453, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 494, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 535, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 576, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 621, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] WARN DataNucleus.MetaData
    - MetaData Parser encountered an error in file
    "jar:file:/usr/local/hive-0.7.0-CDH3B4/lib/hive-metastore-0.7.0-C
    DH3B4.jar!/package.jdo" at line 666, column 13 : The content of element type
    "class" must match
    "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreig
    n-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)".
    - Please check your specification of DTD and the validity of the MetaData
    XML that you have specified.

    2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence
    - Managing Persistence of Class :
    org.apache.hadoop.hive.metastore.model.MDatabase [Table : `DBS`,
    InheritanceSt rategy : new-table]

    2011-03-10 10:36:03 [ main] INFO DataNucleus.Persistence
    - Managing Persistence of Field :
    org.apache.hadoop.hive.metastore.model.MDatabase.parameters [Table :
    `DATABASE _PARAMS`]

    2011-03-10 10:36:03 [ main] INFO DataNucleus.MetaData
    - Listener found initialisation for persistable class
    org.apache.hadoop.hive.metastore.model.MDatabase

    Hive history
    file=/tmp/aharrison/hive_job_log_aharrison_201103101036_1220815779.txt

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedMar 10, '11 at 8:52p
activeMar 10, '11 at 8:59p
posts2
users2
websitehive.apache.org

2 users in discussion

Andrew Harrison: 1 post Carl Steinbach: 1 post

People

Translate

site design / logo © 2022 Grokbase