FAQ
Hi ,
             when I try to establish a connection from Hive UI -->Add
service -->Custom database-->the connection is successful but at the next
step it fails with an Error : at create Hive metastore tables which further
details that Hive1 has same value as Hive warehouse directory.

I am trying to get access the MySQL database (in which I have created
tables) from Cloudera manager to do an impala query on it.


Thanks,
Akangsha.

Search Discussions

  • Darren Lo at Jul 25, 2013 at 5:07 pm
    Hi Akangsha,

    Do you have another Hive service that is configured with the same warehouse
    directory? CM does validation to make sure you don't have two services with
    such a conflict. Depending on what you're trying to do, you may want to
    just edit your existing Hive service rather than creating a new one.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 8:33 AM, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.


    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 25, 2013 at 6:59 pm
    Hi Darren,

                         Thank you for the response. I don't think so as there
    is only one hive1 on the Cloudera manager main page. But if that is the
    case where can I check to see if there is another Hive service running or
    edit as you mentioned in the response. Which is the field I should be
    looking at?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 10:07:41 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    Do you have another Hive service that is configured with the same
    warehouse directory? CM does validation to make sure you don't have two
    services with such a conflict. Depending on what you're trying to do, you
    may want to just edit your existing Hive service rather than creating a new
    one.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:33 AM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.


    --
    Thanks,
    Darren
  • Darren Lo at Jul 25, 2013 at 7:05 pm
    Hi Akangsha,

    Can you share the exact error message and/or a screenshot of the error?

    What is your configured value of the warehouse directory on the hive that
    failed?

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 11:59 AM, akanksha Nirmale wrote:

    Hi Darren,

    Thank you for the response. I don't think so as there
    is only one hive1 on the Cloudera manager main page. But if that is the
    case where can I check to see if there is another Hive service running or
    edit as you mentioned in the response. Which is the field I should be
    looking at?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 10:07:41 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    Do you have another Hive service that is configured with the same
    warehouse directory? CM does validation to make sure you don't have two
    services with such a conflict. Depending on what you're trying to do, you
    may want to just edit your existing Hive service rather than creating a new
    one.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 8:33 AM, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.


    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 25, 2013 at 7:04 pm
    I realized that it is the hive-site.xml file I need to make the changes. To
    tell you have a back-up copy of the same file as hive-site.xml.mysql in the
    same as I didn't wanted to lose the default settings .How do set the Hive
    (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.
  • Darren Lo at Jul 25, 2013 at 7:42 pm
    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather than
    tell it to use your own hive-site.xml. This will enable things like Impala,
    hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the appropriate
    setting in the Cloudera Manager UI (you can use the search feature in the
    upper left). If anything does not have a setting in the CM UI, you can use
    the service or client safety valve, depending on if it is a service or a
    client config. CM will then generate the correct hive-site.xml for your
    Hive Metastore Server and everything else that needs to talk to Hive.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale wrote:

    I realized that it is the hive-site.xml file I need to make the changes.
    To tell you have a back-up copy of the same file as hive-site.xml.mysql in
    the same as I didn't wanted to lose the default settings .How do set the
    Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 25, 2013 at 8:59 pm
    Hi Derren,
                      Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather than
    tell it to use your own hive-site.xml. This will enable things like Impala,
    hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the appropriate
    setting in the Cloudera Manager UI (you can use the search feature in the
    upper left). If anything does not have a setting in the CM UI, you can use
    the service or client safety valve, depending on if it is a service or a
    client config. CM will then generate the correct hive-site.xml for your
    Hive Metastore Server and everything else that needs to talk to Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    I realized that it is the hive-site.xml file I need to make the changes.
    To tell you have a back-up copy of the same file as hive-site.xml.mysql in
    the same as I didn't wanted to lose the default settings .How do set the
    Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren
  • Darren Lo at Jul 25, 2013 at 9:21 pm
    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you can use
    the mysql command line tool, or any other RDBMS tool to look at the tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale wrote:

    Hi Derren,
    Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather than
    tell it to use your own hive-site.xml. This will enable things like Impala,
    hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the appropriate
    setting in the Cloudera Manager UI (you can use the search feature in the
    upper left). If anything does not have a setting in the CM UI, you can use
    the service or client safety valve, depending on if it is a service or a
    client config. CM will then generate the correct hive-site.xml for your
    Hive Metastore Server and everything else that needs to talk to Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    I realized that it is the hive-site.xml file I need to make the changes.
    To tell you have a back-up copy of the same file as hive-site.xml.mysql in
    the same as I didn't wanted to lose the default settings .How do set the
    Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 25, 2013 at 9:46 pm
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do impala
    queries on existing tables from MySQL database in CM. If yes, is there any
    documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you can
    use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    Hi Derren,
    Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather than
    tell it to use your own hive-site.xml. This will enable things like Impala,
    hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the appropriate
    setting in the Cloudera Manager UI (you can use the search feature in the
    upper left). If anything does not have a setting in the CM UI, you can use
    the service or client safety valve, depending on if it is a service or a
    client config. CM will then generate the correct hive-site.xml for your
    Hive Metastore Server and everything else that needs to talk to Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Darren Lo at Jul 25, 2013 at 9:54 pm
    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale wrote:

    Hi Darren

    Thanks for your response. I have one question. Is it possible to do impala
    queries on existing tables from MySQL database in CM. If yes, is there any
    documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you can
    use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale wrote:

    Hi Derren,
    Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather
    than tell it to use your own hive-site.xml. This will enable things like
    Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the appropriate
    setting in the Cloudera Manager UI (you can use the search feature in the
    upper left). If anything does not have a setting in the CM UI, you can use
    the service or client safety valve, depending on if it is a service or a
    client config. CM will then generate the correct hive-site.xml for your
    Hive Metastore Server and everything else that needs to talk to Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have created
    tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 26, 2013 at 2:50 am
    Hi Darren,
                             Gotcha. But what if have some tables in an local
    MySQL database and I want to integrate/establish a connection of MySQL
    database to CM so that I can query against it and also create tales from CM
    side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you can
    use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    Hi Derren,
    Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather
    than tell it to use your own hive-site.xml. This will enable things like
    Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI -->Add
    service -->Custom database-->the connection is successful but at the next
    step it fails with an Error : at create Hive metastore tables which further
    details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 26, 2013 at 3:13 am
    Hi Darren,
                         I have attached the error I get when I try to configure
    connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the steps
    2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an local
    MySQL database and I want to integrate/establish a connection of MySQL
    database to CM so that I can query against it and also create tales from CM
    side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale wrote:

    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you can
    use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration changes and
    restarted the service successfully. Now where can I see my MySQL database
    tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather
    than tell it to use your own hive-site.xml. This will enable things like
    Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Darren Lo at Jul 26, 2013 at 5:28 pm
    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale wrote:

    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the steps
    2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an local
    MySQL database and I want to integrate/establish a connection of MySQL
    database to CM so that I can query against it and also create tales from CM
    side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you
    can use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration changes
    and restarted the service successfully. Now where can I see my MySQL
    database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather
    than tell it to use your own hive-site.xml. This will enable things like
    Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.
    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale wrote:

    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 26, 2013 at 6:45 pm
    Hi Darren,
                        So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an local
    MySQL database and I want to integrate/establish a connection of MySQL
    database to CM so that I can query against it and also create tales from CM
    side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you
    can use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration changes
    and restarted the service successfully. Now where can I see my MySQL
    database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager rather
    than tell it to use your own hive-site.xml. This will enable things like
    Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Darren Lo at Jul 26, 2013 at 8:20 pm
    You should define a separate warehouse directory for your new hive service.
    When adding your Hive Service, you can configure this property and should
    pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right? Not
    data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren

    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale wrote:

    Hi Darren,
    So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren

    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale wrote:

    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you
    can use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the Hue
    service in CM and use the UI to run hive queries, or you can deploy hive
    client configuration (see the Actions menu for the command), ssh into any
    host with a hive role, then use the "hive" command-line tool and type "show
    databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration changes
    and restarted the service successfully. Now where can I see my MySQL
    database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 26, 2013 at 10:23 pm
    so I have installed a MySQL database , created database called Metastore in
    it that has (EMP1 & Example) tables .How to I establish a connection
    between MySQL and Cloudera so that I am able to see my MySQL database
    tables in Hive Metastore.


    On Friday, July 26, 2013 1:19:53 PM UTC-7, Darren Lo wrote:

    You should define a separate warehouse directory for your new hive
    service. When adding your Hive Service, you can configure this property and
    should pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right? Not
    data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    Hi Darren,
    So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql, you
    can use the mysql command line tool, or any other RDBMS tool to look at the
    tables.

    If you want to see the logical hive tables, then you can add the
    Hue service in CM and use the UI to run hive queries, or you can deploy
    hive client configuration (see the Actions menu for the command), ssh into
    any host with a hive role, then use the "hive" command-line tool and type
    "show databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration changes
    and restarted the service successfully. Now where can I see my MySQL
    database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Darren Lo at Jul 26, 2013 at 11:20 pm
    Hi Akangsha,

    Can you please confirm that your mysql schema has hive metastore tables
    only? If you include the output of "show tables" in your mysql database,
    then it should not have anything named emp or example. It kind of sounds
    like you are trying to import RDBMS data into hive tables, as opposed to
    configure the Hive Metastore Server's persistent RDBMS storage.

    CM helps you configure the persistent storage for the Hive Metastore, which
    is easily accomplished through the connection wizard when you add a new
    service. If you are trying to populate hive tables with data from an RDBMS,
    then that is a completely different task and you should look into relevant
    tools to assist you, such as sqoop.

    Thanks,
    Darren

    On Fri, Jul 26, 2013 at 3:23 PM, akanksha Nirmale wrote:

    so I have installed a MySQL database , created database called Metastore
    in it that has (EMP1 & Example) tables .How to I establish a connection
    between MySQL and Cloudera so that I am able to see my MySQL database
    tables in Hive Metastore.


    On Friday, July 26, 2013 1:19:53 PM UTC-7, Darren Lo wrote:

    You should define a separate warehouse directory for your new hive
    service. When adding your Hive Service, you can configure this property and
    should pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right? Not
    data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    Hi Darren,
    So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to do
    impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql,
    you can use the mysql command line tool, or any other RDBMS tool to look at
    the tables.

    If you want to see the logical hive tables, then you can add the
    Hue service in CM and use the UI to run hive queries, or you can deploy
    hive client configuration (see the Actions menu for the command), ssh into
    any host with a hive role, then use the "hive" command-line tool and type
    "show databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration
    changes and restarted the service successfully. Now where can I see my
    MySQL database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make the
    changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • akanksha Nirmale at Jul 26, 2013 at 11:41 pm
    Hi,
                          Yes I am trying to populate hive tables with data from
    an RDBMS .I was wondering if you can provide with a documentation to
    achieve then that would be wonderful.

    Really Appreciate your help!

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 4:20:10 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    Can you please confirm that your mysql schema has hive metastore tables
    only? If you include the output of "show tables" in your mysql database,
    then it should not have anything named emp or example. It kind of sounds
    like you are trying to import RDBMS data into hive tables, as opposed to
    configure the Hive Metastore Server's persistent RDBMS storage.

    CM helps you configure the persistent storage for the Hive Metastore,
    which is easily accomplished through the connection wizard when you add a
    new service. If you are trying to populate hive tables with data from an
    RDBMS, then that is a completely different task and you should look into
    relevant tools to assist you, such as sqoop.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 3:23 PM, akanksha Nirmale <nirmale....@gmail.com<javascript:>
    wrote:
    so I have installed a MySQL database , created database called Metastore
    in it that has (EMP1 & Example) tables .How to I establish a connection
    between MySQL and Cloudera so that I am able to see my MySQL database
    tables in Hive Metastore.


    On Friday, July 26, 2013 1:19:53 PM UTC-7, Darren Lo wrote:

    You should define a separate warehouse directory for your new hive
    service. When adding your Hive Service, you can configure this property and
    should pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right?
    Not data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service named
    hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to
    do impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql,
    you can use the mysql command line tool, or any other RDBMS tool to look at
    the tables.

    If you want to see the logical hive tables, then you can add the
    Hue service in CM and use the UI to run hive queries, or you can deploy
    hive client configuration (see the Actions menu for the command), ssh into
    any host with a hive role, then use the "hive" command-line tool and type
    "show databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration
    changes and restarted the service successfully. Now where can I see my
    MySQL database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make
    the changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive UI
    -->Add service -->Custom database-->the connection is successful but at the
    next step it fails with an Error : at create Hive metastore tables which
    further details that Hive1 has same value as Hive warehouse directory.

    I am trying to get access the MySQL database (in which I have
    created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Darren Lo at Jul 27, 2013 at 12:03 am
    Try sqoop2:
    https://cwiki.apache.org/confluence/display/SQOOP/Sqoop2+Quickstart

    Setting up Sqoop2 servers can be done through CM. Just add a Sqoop service
    if you don't already have one.

    Thanks,
    Darren

    On Fri, Jul 26, 2013 at 4:41 PM, akanksha Nirmale wrote:

    Hi,
    Yes I am trying to populate hive tables with data
    from an RDBMS .I was wondering if you can provide with a documentation to
    achieve then that would be wonderful.

    Really Appreciate your help!

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 4:20:10 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    Can you please confirm that your mysql schema has hive metastore tables
    only? If you include the output of "show tables" in your mysql database,
    then it should not have anything named emp or example. It kind of sounds
    like you are trying to import RDBMS data into hive tables, as opposed to
    configure the Hive Metastore Server's persistent RDBMS storage.

    CM helps you configure the persistent storage for the Hive Metastore,
    which is easily accomplished through the connection wizard when you add a
    new service. If you are trying to populate hive tables with data from an
    RDBMS, then that is a completely different task and you should look into
    relevant tools to assist you, such as sqoop.

    Thanks,
    Darren

    On Fri, Jul 26, 2013 at 3:23 PM, akanksha Nirmale wrote:

    so I have installed a MySQL database , created database called Metastore
    in it that has (EMP1 & Example) tables .How to I establish a connection
    between MySQL and Cloudera so that I am able to see my MySQL database
    tables in Hive Metastore.


    On Friday, July 26, 2013 1:19:53 PM UTC-7, Darren Lo wrote:

    You should define a separate warehouse directory for your new hive
    service. When adding your Hive Service, you can configure this property and
    should pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right?
    Not data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    So I need the hive1 service. But can I create a new
    service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service
    named hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials are
    filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to
    do impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql,
    you can use the mysql command line tool, or any other RDBMS tool to look at
    the tables.

    If you want to see the logical hive tables, then you can add the
    Hue service in CM and use the UI to run hive queries, or you can deploy
    hive client configuration (see the Actions menu for the command), ssh into
    any host with a hive role, then use the "hive" command-line tool and type
    "show databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration
    changes and restarted the service successfully. Now where can I see my
    MySQL database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make
    the changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha Nirmale
    wrote:
    Hi ,
    when I try to establish a connection from Hive
    UI -->Add service -->Custom database-->the connection is successful but at
    the next step it fails with an Error : at create Hive metastore tables
    which further details that Hive1 has same value as Hive warehouse
    directory.

    I am trying to get access the MySQL database (in which I
    have created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren
  • Romain Rigaux at Jul 27, 2013 at 4:27 pm
    Sqoop2 can only directly transfer to HDFS currently but then just create
    the Hive table from the new files (by doing a create table ... or using the
    create table wizard in the Hue Hadoop UI:
    http://blog.cloudera.com/blog/2013/04/demo-analyzing-data-with-hue-and-hive/
    ).

    Romain

    On Fri, Jul 26, 2013 at 5:03 PM, Darren Lo wrote:

    Try sqoop2:
    https://cwiki.apache.org/confluence/display/SQOOP/Sqoop2+Quickstart

    Setting up Sqoop2 servers can be done through CM. Just add a Sqoop service
    if you don't already have one.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 4:41 PM, akanksha Nirmale <
    nirmale.akangsha@gmail.com> wrote:
    Hi,
    Yes I am trying to populate hive tables with data
    from an RDBMS .I was wondering if you can provide with a documentation to
    achieve then that would be wonderful.

    Really Appreciate your help!

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 4:20:10 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    Can you please confirm that your mysql schema has hive metastore tables
    only? If you include the output of "show tables" in your mysql database,
    then it should not have anything named emp or example. It kind of sounds
    like you are trying to import RDBMS data into hive tables, as opposed to
    configure the Hive Metastore Server's persistent RDBMS storage.

    CM helps you configure the persistent storage for the Hive Metastore,
    which is easily accomplished through the connection wizard when you add a
    new service. If you are trying to populate hive tables with data from an
    RDBMS, then that is a completely different task and you should look into
    relevant tools to assist you, such as sqoop.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 3:23 PM, akanksha Nirmale <nirmale....@gmail.com
    wrote:
    so I have installed a MySQL database , created database called
    Metastore in it that has (EMP1 & Example) tables .How to I establish a
    connection between MySQL and Cloudera so that I am able to see my MySQL
    database tables in Hive Metastore.


    On Friday, July 26, 2013 1:19:53 PM UTC-7, Darren Lo wrote:

    You should define a separate warehouse directory for your new hive
    service. When adding your Hive Service, you can configure this property and
    should pick something other than the default. Maybe /user/hive/warehouse2.

    Just to be clear, you have Hive Metastore tables in the mysql, right?
    Not data that you want in Hive tables, but Hive metadata.

    Thanks,
    Darren


    On Fri, Jul 26, 2013 at 11:45 AM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    So I need the hive1 service. But can I create a
    new service to establish a connection to MySQL database ?If so how can I go
    about to achieve this.

    Thanks,
    Akangsha.
    On Friday, July 26, 2013 10:28:08 AM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    I can see in your screenshot that you are creating a new service
    named hive2, and the error message says the warehouse dir conflicts with an
    existing service hive1. It looks like you really do have multiple Hive
    services. If you don't have valuable data in your existing hive service,
    you can just edit it to match your mysql database config, or you can delete
    and re-create it.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 8:13 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren,
    I have attached the error I get when I try to
    configure connection with external local MySQL database that I have.
    The steps taken are as follows:
    from the CM main page

    Add service (from actions) -->Custom database--> the credentials
    are filled and test connection is successful but at the next step it fails
    with an Error : at create Hive metastore tables which further details that
    Hive1 has same value as Hive warehouse directory.

    I have attached the errors 1. Screenshot is the actual error on the
    steps 2. Screenshot gives the details of the error .
    On Thursday, July 25, 2013 7:50:21 PM UTC-7, akanksha Nirmale wrote:

    Hi Darren,
    Gotcha. But what if have some tables in an
    local MySQL database and I want to integrate/establish a connection of
    MySQL database to CM so that I can query against it and also create tales
    from CM side that gets stored in MySQL database.



    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:54:43 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    All Impala queries run on hive tables.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 2:46 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Darren

    Thanks for your response. I have one question. Is it possible to
    do impala queries on existing tables from MySQL database in CM. If yes, is
    there any documentation or guidelines to do that?

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 2:21:53 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    If you want to see the Hive metastore database tables in mysql,
    you can use the mysql command line tool, or any other RDBMS tool to look at
    the tables.

    If you want to see the logical hive tables, then you can add
    the Hue service in CM and use the UI to run hive queries, or you can deploy
    hive client configuration (see the Actions menu for the command), ssh into
    any host with a hive role, then use the "hive" command-line tool and type
    "show databases", "use <database>", and "show tables".

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 1:59 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    Hi Derren,
    Thank you so much I did the configuration
    changes and restarted the service successfully. Now where can I see my
    MySQL database tables that I have created .

    Thanks,
    Akangsha.
    On Thursday, July 25, 2013 12:42:08 PM UTC-7, Darren Lo wrote:

    Hi Akangsha,

    You should set these configurations through Cloudera Manager
    rather than tell it to use your own hive-site.xml. This will enable things
    like Impala, hue, the Hive Metastore Server, HiveServer2, WebHCat, client
    configurations, etc. to get the correct hive-site.xml.

    For each configuration in your hive-site.xml, configure the
    appropriate setting in the Cloudera Manager UI (you can use the search
    feature in the upper left). If anything does not have a setting in the CM
    UI, you can use the service or client safety valve, depending on if it is a
    service or a client config. CM will then generate the correct hive-site.xml
    for your Hive Metastore Server and everything else that needs to talk to
    Hive.

    Thanks,
    Darren


    On Thu, Jul 25, 2013 at 12:04 PM, akanksha Nirmale <
    nirmale....@gmail.com> wrote:
    I realized that it is the hive-site.xml file I need to make
    the changes. To tell you have a back-up copy of the same file as
    hive-site.xml.mysql in the same as I didn't wanted to lose the default
    settings .How do set the Hive (cloudera manager) to pick the modified file.

    Thanks,
    akangsha.

    On Thursday, July 25, 2013 8:33:01 AM UTC-7, akanksha
    Nirmale wrote:
    Hi ,
    when I try to establish a connection from Hive
    UI -->Add service -->Custom database-->the connection is successful but at
    the next step it fails with an Error : at create Hive metastore tables
    which further details that Hive1 has same value as Hive warehouse
    directory.

    I am trying to get access the MySQL database (in which I
    have created tables) from Cloudera manager to do an impala query on it.


    Thanks,
    Akangsha.

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

    --
    Thanks,
    Darren

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupscm-users @
categorieshadoop
postedJul 25, '13 at 3:33p
activeJul 27, '13 at 4:27p
posts20
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase