FAQ
Hi,

What is a good way to copy the entire content of a Hive metastore and insert it into another Hive metastore? The second metastore contains existing metadata that needs to be preserved. Both metastores are in MySQL, not fronted by any Hive metastore server.

My guess is Hive has some metastore API that may be appropriate here, but I don't know if that is true because I know zilch about that API - I don't even know where the API documentation is.

Thanks.
Steven

Search Discussions

  • Edward Capriolo at Sep 30, 2011 at 10:16 pm

    On Fri, Sep 30, 2011 at 5:05 PM, Steven Wong wrote:

    Hi,



    What is a good way to copy the entire content of a Hive metastore and
    insert it into another Hive metastore? The second metastore contains
    existing metadata that needs to be preserved. Both metastores are in MySQL,
    not fronted by any Hive metastore server.



    My guess is Hive has some metastore API that may be appropriate here, but I
    don’t know if that is true because I know zilch about that API — I don’t
    even know where the API documentation is.



    Thanks.

    Steven
    I would say a simple way is to take mysql dumps and then append the dump
    files together. As long as you do not have two tables with the same name I
    do not see any challenges with that. This portion of the API is not very
    well documented because most do not interact with the metastore directly,
    they only interact with HQL.
  • Steven Wong at Sep 30, 2011 at 11:47 pm
    I think going to MySQL directly will have the problem of colliding internal ids (e.g. TBLS.TBL_ID). I don't know if the API will have the same problem or not.

    If there is no API documentation, which code (classes, methods) should I look at?


    From: Edward Capriolo
    Sent: Friday, September 30, 2011 3:16 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore


    On Fri, Sep 30, 2011 at 5:05 PM, Steven Wong wrote:
    Hi,

    What is a good way to copy the entire content of a Hive metastore and insert it into another Hive metastore? The second metastore contains existing metadata that needs to be preserved. Both metastores are in MySQL, not fronted by any Hive metastore server.

    My guess is Hive has some metastore API that may be appropriate here, but I don't know if that is true because I know zilch about that API - I don't even know where the API documentation is.

    Thanks.
    Steven

    I would say a simple way is to take mysql dumps and then append the dump files together. As long as you do not have two tables with the same name I do not see any challenges with that. This portion of the API is not very well documented because most do not interact with the metastore directly, they only interact with HQL.
  • Jander g at Oct 9, 2011 at 5:54 am
    Yes, you are right. I had merged two hive metastore several months
    ago. I restored one metastore to HQL and run this hql file to finish
    the task. Just as Edward says, I interact with HQL directly. Hope this
    helps.
    On 10/1/11, Steven Wong wrote:
    I think going to MySQL directly will have the problem of colliding internal
    ids (e.g. TBLS.TBL_ID). I don't know if the API will have the same problem
    or not.

    If there is no API documentation, which code (classes, methods) should I
    look at?


    From: Edward Capriolo
    Sent: Friday, September 30, 2011 3:16 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore


    On Fri, Sep 30, 2011 at 5:05 PM, Steven Wong
    wrote:
    Hi,

    What is a good way to copy the entire content of a Hive metastore and insert
    it into another Hive metastore? The second metastore contains existing
    metadata that needs to be preserved. Both metastores are in MySQL, not
    fronted by any Hive metastore server.

    My guess is Hive has some metastore API that may be appropriate here, but I
    don't know if that is true because I know zilch about that API - I don't
    even know where the API documentation is.

    Thanks.
    Steven

    I would say a simple way is to take mysql dumps and then append the dump
    files together. As long as you do not have two tables with the same name I
    do not see any challenges with that. This portion of the API is not very
    well documented because most do not interact with the metastore directly,
    they only interact with HQL.

    --
    Thanks,
    Jander
  • Steven Wong at Oct 10, 2011 at 11:52 pm
    How do you generate an HQL file from a metastore?


    -----Original Message-----
    From: Jander g
    Sent: Saturday, October 08, 2011 10:54 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore

    Yes, you are right. I had merged two hive metastore several months
    ago. I restored one metastore to HQL and run this hql file to finish
    the task. Just as Edward says, I interact with HQL directly. Hope this
    helps.
    On 10/1/11, Steven Wong wrote:
    I think going to MySQL directly will have the problem of colliding internal
    ids (e.g. TBLS.TBL_ID). I don't know if the API will have the same problem
    or not.

    If there is no API documentation, which code (classes, methods) should I
    look at?


    From: Edward Capriolo
    Sent: Friday, September 30, 2011 3:16 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore


    On Fri, Sep 30, 2011 at 5:05 PM, Steven Wong
    wrote:
    Hi,

    What is a good way to copy the entire content of a Hive metastore and insert
    it into another Hive metastore? The second metastore contains existing
    metadata that needs to be preserved. Both metastores are in MySQL, not
    fronted by any Hive metastore server.

    My guess is Hive has some metastore API that may be appropriate here, but I
    don't know if that is true because I know zilch about that API - I don't
    even know where the API documentation is.

    Thanks.
    Steven

    I would say a simple way is to take mysql dumps and then append the dump
    files together. As long as you do not have two tables with the same name I
    do not see any challenges with that. This portion of the API is not very
    well documented because most do not interact with the metastore directly,
    they only interact with HQL.

    --
    Thanks,
    Jander
  • Jander g at Oct 11, 2011 at 2:01 am
    We develop a little tool which can hack to get create table HQL and
    insert data HQL from hive metastore. Thus the hive metastore can be
    restored.

    On 10/11/11, Steven Wong wrote:
    How do you generate an HQL file from a metastore?


    -----Original Message-----
    From: Jander g
    Sent: Saturday, October 08, 2011 10:54 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore

    Yes, you are right. I had merged two hive metastore several months
    ago. I restored one metastore to HQL and run this hql file to finish
    the task. Just as Edward says, I interact with HQL directly. Hope this
    helps.
    On 10/1/11, Steven Wong wrote:
    I think going to MySQL directly will have the problem of colliding
    internal
    ids (e.g. TBLS.TBL_ID). I don't know if the API will have the same
    problem
    or not.

    If there is no API documentation, which code (classes, methods) should I
    look at?


    From: Edward Capriolo
    Sent: Friday, September 30, 2011 3:16 PM
    To: user@hive.apache.org
    Subject: Re: Copying a Hive metastore


    On Fri, Sep 30, 2011 at 5:05 PM, Steven Wong
    wrote:
    Hi,

    What is a good way to copy the entire content of a Hive metastore and
    insert
    it into another Hive metastore? The second metastore contains existing
    metadata that needs to be preserved. Both metastores are in MySQL, not
    fronted by any Hive metastore server.

    My guess is Hive has some metastore API that may be appropriate here, but
    I
    don't know if that is true because I know zilch about that API - I don't
    even know where the API documentation is.

    Thanks.
    Steven

    I would say a simple way is to take mysql dumps and then append the dump
    files together. As long as you do not have two tables with the same name I
    do not see any challenges with that. This portion of the API is not very
    well documented because most do not interact with the metastore directly,
    they only interact with HQL.

    --
    Thanks,
    Jander

    --
    Thanks,
    Jander
  • Vikas srivastava at Oct 11, 2011 at 7:30 am
    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !
  • Harold(陳春宏) at Oct 11, 2011 at 10:11 am
    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499

    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !
  • Vikas Srivastava at Oct 11, 2011 at 11:48 am
    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>

    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499

    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900
    One97 | Let's get talking !
  • Ankit Jain at Oct 11, 2011 at 12:10 pm
    Hello Vikas,

    I think you have to put the mysql Driver in lib dir of hive.

    Thanks,
    Ankit
    On Tue, Oct 11, 2011 at 5:18 PM, Vikas Srivastava wrote:

    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>

    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499

    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900

    One97 | Let's get talking !
  • Vikas Srivastava at Oct 11, 2011 at 12:26 pm
    that also i have dine.. i put msql connector in that lib
    On Tue, Oct 11, 2011 at 5:39 PM, Ankit Jain wrote:

    Hello Vikas,

    I think you have to put the mysql Driver in lib dir of hive.

    Thanks,
    Ankit

    On Tue, Oct 11, 2011 at 5:18 PM, Vikas Srivastava <
    vikas.srivastava@one97.net> wrote:
    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>

    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499

    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900

    One97 | Let's get talking !

    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900
    One97 | Let's get talking !
  • Ankit Jain at Oct 11, 2011 at 12:52 pm
    Is it hive database created in MySQL ??
    On Tue, Oct 11, 2011 at 5:55 PM, Vikas Srivastava wrote:

    that also i have dine.. i put msql connector in that lib
    On Tue, Oct 11, 2011 at 5:39 PM, Ankit Jain wrote:

    Hello Vikas,

    I think you have to put the mysql Driver in lib dir of hive.

    Thanks,
    Ankit

    On Tue, Oct 11, 2011 at 5:18 PM, Vikas Srivastava <
    vikas.srivastava@one97.net> wrote:
    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>

    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499

    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and
    provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver
    (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900

    One97 | Let's get talking !

    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    Mob:+91 9560885900
    One97 | Let's get talking !
  • Vikas srivastava at Oct 11, 2011 at 12:58 pm
    Yup!!!!!!!



    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    From: Ankit Jain
    Sent: Tuesday, October 11, 2011 6:22 PM
    To: user@hive.apache.org
    Subject: Re: problem in hive



    Is it hive database created in MySQL ??


    On Tue, Oct 11, 2011 at 5:55 PM, Vikas Srivastava wrote:

    that also i have dine.. i put msql connector in that lib



    On Tue, Oct 11, 2011 at 5:39 PM, Ankit Jain wrote:

    Hello Vikas,

    I think you have to put the mysql Driver in lib dir of hive.

    Thanks,
    Ankit



    On Tue, Oct 11, 2011 at 5:18 PM, Vikas Srivastava wrote:

    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>



    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499


    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !







    --

    With Regards
    Vikas Srivastava

    DWH & Analytics Team

    Mob:+91 9560885900


    One97 | Let's get talking !








    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team

    Mob:+91 9560885900
    One97 | Let's get talking !
  • Harold(陳春宏) at Oct 12, 2011 at 1:47 am
    Maybe you have check config file again



    Or put your hive config file on mail







    Best Regard

    Mail: Harold.Chen@sunplus-technology.com

    MSN: chen0727@hotmail.com

    SKYPE: chen0727

    Mobil: 886-937545215

    Tel: 886-2-8798-2988 #222

    Fax:886-2-8751-5499



    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 8:57 PM
    To: user@hive.apache.org
    Subject: RE: problem in hive



    Yup!!!!!!!



    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !



    From: Ankit Jain
    Sent: Tuesday, October 11, 2011 6:22 PM
    To: user@hive.apache.org
    Subject: Re: problem in hive



    Is it hive database created in MySQL ??


    On Tue, Oct 11, 2011 at 5:55 PM, Vikas Srivastava wrote:

    that also i have dine.. i put msql connector in that lib



    On Tue, Oct 11, 2011 at 5:39 PM, Ankit Jain wrote:

    Hello Vikas,

    I think you have to put the mysql Driver in lib dir of hive.

    Thanks,
    Ankit



    On Tue, Oct 11, 2011 at 5:18 PM, Vikas Srivastava wrote:

    hey thanks for replay but already have at that place..

    2011/10/11 Harold(陳春宏) <harold.chen@sunplus-technology.com>



    You have to add jar file like this
    add jar ../hive-0.6.0/lib/hive_contrib.jar;



    Best Regard
    Mail: Harold.Chen@sunplus-technology.com
    MSN: chen0727@hotmail.com
    SKYPE: chen0727
    Mobil: 886-937545215
    Tel: 886-2-8798-2988 #222
    Fax:886-2-8751-5499


    -----Original Message-----
    From: vikas srivastava
    Sent: Tuesday, October 11, 2011 3:29 PM
    To: user@hive.apache.org
    Subject: problem in hive

    Hi All,

    I facing a problem like I have installed hive on a new server and provide
    the connectivity with the namenode,

    Create a user in mysql and give the proper privileges to that user,

    Put that user in hive-site.xml and now when I fired a query like

    Show tables;
    Not showing any table

    when I fired
    Desc table or select table is throwing an error

    hive> desc aircel_obd;
    FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask


    The hive.log are :-

    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,131 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,134 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:30,135 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:25:35,031 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,146 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.resources" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.core.runtime" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:14,150 ERROR DataNucleus.Plugin
    (Log4JLogger.java:error(115)) - Bundle "org.eclipse.jdt.core" requires
    "org.eclipse.text" but it cannot be resolved.
    2011-10-11 12:45:21,053 ERROR ql.Driver (SessionState.java:printError(365))
    - FAILED: Execution Error, return code 1 from
    org.apache.hadoop.hive.ql.exec.DDLTask

    Please help I m stuck here....


    With Regards
    Vikas Srivastava

    DWH & Analytics Team
    M: +91 9560885900
    P: + 91 120 4770102
    Email: vikas.srivastava@one97.net
    W: www.one97world.com

    One97 | Let's get talking !






    --

    With Regards
    Vikas Srivastava

    DWH & Analytics Team

    Mob:+91 9560885900


    One97 | Let's get talking !








    --
    With Regards
    Vikas Srivastava

    DWH & Analytics Team

    Mob:+91 9560885900
    One97 | Let's get talking !

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupuser @
categorieshive, hadoop
postedSep 30, '11 at 9:06p
activeOct 12, '11 at 1:47a
posts14
users6
websitehive.apache.org

People

Translate

site design / logo © 2022 Grokbase