Grokbase › Groups › Hadoop › impala-user › March 2013
FAQ
Hi,

I'm following this
tutorial: https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:

*[root@impala2 ~]# hadoop fs -ls /user/hive/
*
*Found 1 items*
*drwxrwxr-t - hive hive 0 2013-03-25 08:11 /user/hive/warehouse*

    - I created some tables already:

*[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
*Found 4 items*
*drwxrwxr-t - root hive 0 2013-03-25 08:04
/user/hive/warehouse/minhnd_db.db*
*drwxrwxrwx - root hdfs 0 2013-03-25 08:10
/user/hive/warehouse/tab1*
*drwxr-xr-x - root hdfs 0 2013-03-25 08:11
/user/hive/warehouse/tab2*
*drwxrwxr-t - root hive 0 2013-03-25 08:08
/user/hive/warehouse/tab3*

*hive> show tables; *
*OK*
*tab1*
*tab2*
*tab3*
*Time taken: 0.084 seconds*
*
*
*hive> select * from tab1;*
*OK*
*1 true 123.123 2012-10-24 08:55:00*
*2 false 1243.5 2012-10-25 13:40:00*
*3 false 24453.325 2008-08-22 09:33:21.123*
*4 false 243423.325 2007-05-12 22:32:21.33454*
*5 true 243.325 1953-04-22 09:11:33*
*Time taken: 0.149 seconds*
*
*
*
*
But, Impala still can't see Hive's table after running the "refresh"
command:

*[localhost:21000] > refresh*
*Successfully refreshed catalog*
*[localhost:21000] > show databases;*
*Query: show databases*
*Query finished, fetching results ...*
*default*
*Returned 1 row(s) in 0.10s*
*[localhost:21000] > show tables;*
*Query: show tables*
*Query finished, fetching results ...*
*
*
*Returned 0 row(s) in 0.11s*
*
*
Please help me fix it.

Search Discussions

  • Miklos Christine at Mar 25, 2013 at 6:01 pm ⇧
    Hello Andy,

    Can you provide which version of impala and CDH you are currently running?
    The impala version is printed when you start the shell.
    Is your environment set up for namenode HA?

    Thanks,
    Miklos



    On Mon, Mar 25, 2013 at 12:24 AM, Udai Kiran Potluri wrote:

    Hi,

    What metastore are you using for Hive, is it Mysql? Does it have correct
    Grant permissions?

    Also does Impala have the updated and relevant config files -
    hive-site.xml, core-site.xml, hdfs-site.xml to IMPALA_CONF_DIR(typically
    /etc/impala/conf)?

    Thanks,
    Udai

    On Mon, Mar 25, 2013 at 6:21 AM, Andy wrote:

    Hi,

    I'm following this tutorial:
    https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/
    *
    *Found 1 items*
    *drwxrwxr-t - hive hive 0 2013-03-25 08:11
    /user/hive/warehouse*

    - I created some tables already:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
    *Found 4 items*
    *drwxrwxr-t - root hive 0 2013-03-25 08:04
    /user/hive/warehouse/minhnd_db.db*
    *drwxrwxrwx - root hdfs 0 2013-03-25 08:10
    /user/hive/warehouse/tab1*
    *drwxr-xr-x - root hdfs 0 2013-03-25 08:11
    /user/hive/warehouse/tab2*
    *drwxrwxr-t - root hive 0 2013-03-25 08:08
    /user/hive/warehouse/tab3*

    *hive> show tables; *
    *OK*
    *tab1*
    *tab2*
    *tab3*
    *Time taken: 0.084 seconds*
    *
    *
    *hive> select * from tab1;*
    *OK*
    *1 true 123.123 2012-10-24 08:55:00*
    *2 false 1243.5 2012-10-25 13:40:00*
    *3 false 24453.325 2008-08-22 09:33:21.123*
    *4 false 243423.325 2007-05-12 22:32:21.33454*
    *5 true 243.325 1953-04-22 09:11:33*
    *Time taken: 0.149 seconds*
    *
    *
    *
    *
    But, Impala still can't see Hive's table after running the "refresh"
    command:

    *[localhost:21000] > refresh*
    *Successfully refreshed catalog*
    *[localhost:21000] > show databases;*
    *Query: show databases*
    *Query finished, fetching results ...*
    *default*
    *Returned 1 row(s) in 0.10s*
    *[localhost:21000] > show tables;*
    *Query: show tables*
    *Query finished, fetching results ...*
    *
    *
    *Returned 0 row(s) in 0.11s*
    *
    *
    Please help me fix it.
  • Andy at Mar 27, 2013 at 8:10 pm ⇧
    Hi Miklos Christine,

    This is my Impala's version:
    *(Build version: Impala v0.5 (5a64c63) built on Fri Feb 1 11:21:22 PST
    2013)*
    *
    *
    CDH:
    *Version: 4.4.908 (#104 built by jenkins on 20121221-0210 git*

    I didn't set up for Namenode HA.

    On Tuesday, March 26, 2013 2:00:50 AM UTC+8, Miklos Christine wrote:

    Hello Andy,

    Can you provide which version of impala and CDH you are currently running?
    The impala version is printed when you start the shell.
    Is your environment set up for namenode HA?

    Thanks,
    Miklos




    On Mon, Mar 25, 2013 at 12:24 AM, Udai Kiran Potluri <ud...@cloudera.com<javascript:>
    wrote:
    Hi,

    What metastore are you using for Hive, is it Mysql? Does it have correct
    Grant permissions?

    Also does Impala have the updated and relevant config files -
    hive-site.xml, core-site.xml, hdfs-site.xml to IMPALA_CONF_DIR(typically
    /etc/impala/conf)?

    Thanks,
    Udai


    On Mon, Mar 25, 2013 at 6:21 AM, Andy <nguyend...@gmail.com <javascript:>
    wrote:
    Hi,

    I'm following this tutorial:
    https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/
    *
    *Found 1 items*
    *drwxrwxr-t - hive hive 0 2013-03-25 08:11
    /user/hive/warehouse*

    - I created some tables already:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
    *Found 4 items*
    *drwxrwxr-t - root hive 0 2013-03-25 08:04
    /user/hive/warehouse/minhnd_db.db*
    *drwxrwxrwx - root hdfs 0 2013-03-25 08:10
    /user/hive/warehouse/tab1*
    *drwxr-xr-x - root hdfs 0 2013-03-25 08:11
    /user/hive/warehouse/tab2*
    *drwxrwxr-t - root hive 0 2013-03-25 08:08
    /user/hive/warehouse/tab3*

    *hive> show tables; *
    *OK*
    *tab1*
    *tab2*
    *tab3*
    *Time taken: 0.084 seconds*
    *
    *
    *hive> select * from tab1;*
    *OK*
    *1 true 123.123 2012-10-24 08:55:00*
    *2 false 1243.5 2012-10-25 13:40:00*
    *3 false 24453.325 2008-08-22 09:33:21.123*
    *4 false 243423.325 2007-05-12 22:32:21.33454*
    *5 true 243.325 1953-04-22 09:11:33*
    *Time taken: 0.149 seconds*
    *
    *
    *
    *
    But, Impala still can't see Hive's table after running the "refresh"
    command:

    *[localhost:21000] > refresh*
    *Successfully refreshed catalog*
    *[localhost:21000] > show databases;*
    *Query: show databases*
    *Query finished, fetching results ...*
    *default*
    *Returned 1 row(s) in 0.10s*
    *[localhost:21000] > show tables;*
    *Query: show tables*
    *Query finished, fetching results ...*
    *
    *
    *Returned 0 row(s) in 0.11s*
    *
    *
    Please help me fix it.
  • Greg Rahn at Mar 25, 2013 at 10:16 pm ⇧
    Try this:

        1. Open two terminal windows.
        2. In the first, run "impala-shell -i <your host running impalad>" or
        use the "connect <host>" while in the impala-shell.
        3. Type "show tables" and if you do not see the expected results go the
        the next step.
        4. In the second terminal window, ssh to <your host running impalad>
        (the one you connected to with impala-shell) and type "tail -0f
        /var/log/impalad/impalad.INFO".
        5. Now type "show tables" in the impala-shell terminal.
        6. If the problem is not obvious, then respond with the output from the
        "tail" terminal -- this is the information that is required to understand
        your issue.

    Example from my system:

    $ tail -0f /var/log/impalad/impalad.INFO
    I0325 15:03:41.738780 29677 impala-server.cc:1201] Refreshing catalog
    INFO0325 15:03:41.738000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.760000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.760000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    WARN0325 15:03:41.824000 Thread-25 org.apache.hadoop.conf.Configuration]
    org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@58bdc3d0:an attempt
    to override final parameter:
    mapreduce.job.end-notification.max.retry.interval; Ignoring.
    WARN0325 15:03:41.829000 Thread-25 org.apache.hadoop.conf.Configuration]
    org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@58bdc3d0:an attempt
    to override final parameter: mapreduce.job.end-notification.max.attempts;
      Ignoring.
    WARN0325 15:03:41.831000 Thread-25 org.apache.hadoop.hive.conf.HiveConf]
    DEPRECATED: Configuration property hive.metastore.local no longer has any
    effect. Make sure to provide a valid value for hive.metastore.uris if you
    are connecting to a remote metastore.
    INFO0325 15:03:41.832000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: get_all_databases
    INFO0325 15:03:41.833000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=get_all_databases
    INFO0325 15:03:41.833000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Opening raw store with
    implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
    INFO0325 15:03:41.834000 Thread-25
    org.apache.hadoop.hive.metastore.ObjectStore] ObjectStore, initialize called
    INFO0325 15:03:41.835000 Thread-25
    org.apache.hadoop.hive.metastore.ObjectStore] Initialized ObjectStore
  • Andy at Mar 27, 2013 at 8:04 pm ⇧
    Hi Greg Rahn,

    I did all the steps you said, and this is the log:

    *[root@impala2 ~]# tail -0f /var/log/impalad/impalad.INFO *
    *I0328 04:06:31.862589 32462 impala-beeswax-server.cc:138] query():
    query=show tables*
    *I0328 04:06:31.862774 32462 impala-beeswax-server.cc:429] query: Query {*
    * 01: query (string) = "show tables",*
    * 03: configuration (list) = list<string>[9] {*
    * [0] = "NUM_SCANNER_THREADS=0",*
    * [1] = "MAX_IO_BUFFERS=0",*
    * [2] = "MAX_SCAN_RANGE_LENGTH=0",*
    * [3] = "NUM_NODES=0",*
    * [4] = "DISABLE_CODEGEN=false",*
    * [5] = "MAX_ERRORS=0",*
    * [6] = "ABORT_ON_ERROR=false",*
    * [7] = "BATCH_SIZE=0",*
    * [8] = "ALLOW_UNSUPPORTED_FORMATS=false",*
    * },*
    * 04: hadoop_user (string) = "",*
    *}*
    *I0328 04:06:31.862871 32462 impala-beeswax-server.cc:444]
    TClientRequest.queryOptions: TQueryOptions {*
    * 01: abort_on_error (bool) = false,*
    * 02: max_errors (i32) = 0,*
    * 03: disable_codegen (bool) = false,*
    * 04: batch_size (i32) = 0,*
    * 05: return_as_ascii (bool) = true,*
    * 06: num_nodes (i32) = 0,*
    * 07: max_scan_range_length (i64) = 0,*
    * 08: num_scanner_threads (i32) = 0,*
    * 09: max_io_buffers (i32) = 0,*
    * 10: allow_unsupported_formats (bool) = false,*
    * 11: default_order_by_limit (i64) = -1,*
    *}*
    *INFO0328 04:06:31.863000 Thread-2 com.cloudera.impala.service.Frontend]
    analyze query show tables*
    *INFO0328 04:06:31.910000 Thread-2 com.cloudera.impala.service.JniFrontend]
    *
    *I0328 04:06:32.012634 32462 impala-beeswax-server.cc:311] close():
    query_id=82c40bf972ce4857:a632faf223c6f77a*
    *I0328 04:06:32.012732 32462 impala-server.cc:967] UnregisterQuery():
    query_id=82c40bf972ce4857:a632faf223c6f77a*

    On Tuesday, March 26, 2013 6:15:58 AM UTC+8, Greg Rahn wrote:

    Try this:

    1. Open two terminal windows.
    2. In the first, run "impala-shell -i <your host running impalad>" or
    use the "connect <host>" while in the impala-shell.
    3. Type "show tables" and if you do not see the expected results go
    the the next step.
    4. In the second terminal window, ssh to <your host running impalad>
    (the one you connected to with impala-shell) and type "tail -0f
    /var/log/impalad/impalad.INFO".
    5. Now type "show tables" in the impala-shell terminal.
    6. If the problem is not obvious, then respond with the output from
    the "tail" terminal -- this is the information that is required to
    understand your issue.

    Example from my system:

    $ tail -0f /var/log/impalad/impalad.INFO
    I0325 15:03:41.738780 29677 impala-server.cc:1201] Refreshing catalog
    INFO0325 15:03:41.738000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.748000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.749000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.750000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.760000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.760000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Shutting down the object
    store...
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Shutting down the object store...
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Metastore shutdown
    complete.
    INFO0325 15:03:41.761000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=Metastore shutdown complete.
    WARN0325 15:03:41.824000 Thread-25 org.apache.hadoop.conf.Configuration]
    org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@58bdc3d0:an attempt
    to override final parameter:
    mapreduce.job.end-notification.max.retry.interval; Ignoring.
    WARN0325 15:03:41.829000 Thread-25 org.apache.hadoop.conf.Configuration]
    org.apache.hadoop.hive.conf.LoopingByteArrayInputStream@58bdc3d0:an attempt
    to override final parameter: mapreduce.job.end-notification.max.attempts;
    Ignoring.
    WARN0325 15:03:41.831000 Thread-25 org.apache.hadoop.hive.conf.HiveConf]
    DEPRECATED: Configuration property hive.metastore.local no longer has any
    effect. Make sure to provide a valid value for hive.metastore.uris if you
    are connecting to a remote metastore.
    INFO0325 15:03:41.832000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: get_all_databases
    INFO0325 15:03:41.833000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore.audit] ugi=impala
    ip=unknown-ip-addr cmd=get_all_databases
    INFO0325 15:03:41.833000 Thread-25
    org.apache.hadoop.hive.metastore.HiveMetaStore] 1: Opening raw store with
    implemenation class:org.apache.hadoop.hive.metastore.ObjectStore
    INFO0325 15:03:41.834000 Thread-25
    org.apache.hadoop.hive.metastore.ObjectStore] ObjectStore, initialize called
    INFO0325 15:03:41.835000 Thread-25
    org.apache.hadoop.hive.metastore.ObjectStore] Initialized ObjectStore
  • Andy at Mar 27, 2013 at 8:19 pm ⇧
    Hi Udai,

    I'm using MySQL for metastore. What do you mean "have correct Grant
    permissions"? Is it permission of user *hive *on database *metastoredb*?

    There's nothing in my /etc/impala/conf/

    On Monday, March 25, 2013 3:24:52 PM UTC+8, Udai wrote:

    Hi,

    What metastore are you using for Hive, is it Mysql? Does it have correct
    Grant permissions?

    Also does Impala have the updated and relevant config files -
    hive-site.xml, core-site.xml, hdfs-site.xml to IMPALA_CONF_DIR(typically
    /etc/impala/conf)?

    Thanks,
    Udai


    On Mon, Mar 25, 2013 at 6:21 AM, Andy <nguyend...@gmail.com <javascript:>>wrote:
    Hi,

    I'm following this tutorial:
    https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/
    *
    *Found 1 items*
    *drwxrwxr-t - hive hive 0 2013-03-25 08:11
    /user/hive/warehouse*

    - I created some tables already:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
    *Found 4 items*
    *drwxrwxr-t - root hive 0 2013-03-25 08:04
    /user/hive/warehouse/minhnd_db.db*
    *drwxrwxrwx - root hdfs 0 2013-03-25 08:10
    /user/hive/warehouse/tab1*
    *drwxr-xr-x - root hdfs 0 2013-03-25 08:11
    /user/hive/warehouse/tab2*
    *drwxrwxr-t - root hive 0 2013-03-25 08:08
    /user/hive/warehouse/tab3*

    *hive> show tables; *
    *OK*
    *tab1*
    *tab2*
    *tab3*
    *Time taken: 0.084 seconds*
    *
    *
    *hive> select * from tab1;*
    *OK*
    *1 true 123.123 2012-10-24 08:55:00*
    *2 false 1243.5 2012-10-25 13:40:00*
    *3 false 24453.325 2008-08-22 09:33:21.123*
    *4 false 243423.325 2007-05-12 22:32:21.33454*
    *5 true 243.325 1953-04-22 09:11:33*
    *Time taken: 0.149 seconds*
    *
    *
    *
    *
    But, Impala still can't see Hive's table after running the "refresh"
    command:

    *[localhost:21000] > refresh*
    *Successfully refreshed catalog*
    *[localhost:21000] > show databases;*
    *Query: show databases*
    *Query finished, fetching results ...*
    *default*
    *Returned 1 row(s) in 0.10s*
    *[localhost:21000] > show tables;*
    *Query: show tables*
    *Query finished, fetching results ...*
    *
    *
    *Returned 0 row(s) in 0.11s*
    *
    *
    Please help me fix it.
  • Aliza Panitz at Apr 3, 2014 at 6:36 pm ⇧
    When this happened to me the solution was to explicitly re-deploy the hive
    client configuration from Cloudera Manager. Apparently this *should* have
    happened automatically but sometimes doesn't.
    On Wednesday, March 27, 2013 5:30:40 PM UTC-4, Andy wrote:

    Hi all,

    I fixed it. This problem is totally because of me. I didn't understand
    Hive/Impala metastore mechanism clearly.

    I tried to stop MySQL server, then restarted Impala. The result was Impala
    could not start, but Hive still could query database. It turns out that
    they were using different metastores: Impala's using MySQL server, Hive's
    using its embedded database (Apache Derby).

    So, I configured Hive's database connection for working with MySQL server
    as the following guideline then it worked well:

    https://ccp.cloudera.com/display/CDHDOC/Hive+Installation#HiveInstallation-ConfiguringtheHiveMetastore

    Thanks for your help!
    On Monday, March 25, 2013 8:51:59 AM UTC+8, Andy wrote:

    Hi,

    I'm following this tutorial:
    https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:


    *[root@impala2 ~]# hadoop fs -ls /user/hive/*
    *Found 1 items*
    *drwxrwxr-t - hive hive 0 2013-03-25 08:11
    /user/hive/warehouse*

    - I created some tables already:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
    *Found 4 items*
    *drwxrwxr-t - root hive 0 2013-03-25 08:04
    /user/hive/warehouse/minhnd_db.db*
    *drwxrwxrwx - root hdfs 0 2013-03-25 08:10
    /user/hive/warehouse/tab1*
    *drwxr-xr-x - root hdfs 0 2013-03-25 08:11
    /user/hive/warehouse/tab2*
    *drwxrwxr-t - root hive 0 2013-03-25 08:08
    /user/hive/warehouse/tab3*

    *hive> show tables; *
    *OK*
    *tab1*
    *tab2*
    *tab3*
    *Time taken: 0.084 seconds*

    *hive> select * from tab1;*
    *OK*
    *1 true 123.123 2012-10-24 08:55:00*
    *2 false 1243.5 2012-10-25 13:40:00*
    *3 false 24453.325 2008-08-22 09:33:21.123*
    *4 false 243423.325 2007-05-12 22:32:21.33454*
    *5 true 243.325 1953-04-22 09:11:33*
    *Time taken: 0.149 seconds*


    But, Impala still can't see Hive's table after running the "refresh"
    command:

    *[localhost:21000] > refresh*
    *Successfully refreshed catalog*
    *[localhost:21000] > show databases;*
    *Query: show databases*
    *Query finished, fetching results ...*
    *default*
    *Returned 1 row(s) in 0.10s*
    *[localhost:21000] > show tables;*
    *Query: show tables*
    *Query finished, fetching results ...*

    *Returned 0 row(s) in 0.11s*

    Please help me fix it.
    To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.
  • Aliza Panitz at Apr 3, 2014 at 6:39 pm ⇧

    On Thursday, April 3, 2014 2:36:37 PM UTC-4, Aliza Panitz wrote:
    When this happened to me the solution was to explicitly re-deploy the hive
    client configuration from Cloudera Manager. Apparently this *should* have
    happened automatically but sometimes doesn't.
    (This was after several attempts to fix the problem with

    invalidate metadata;

    removing and reinstalling impala, etc.

    On Wednesday, March 27, 2013 5:30:40 PM UTC-4, Andy wrote:

    Hi all,

    I fixed it. This problem is totally because of me. I didn't understand
    Hive/Impala metastore mechanism clearly.

    I tried to stop MySQL server, then restarted Impala. The result was
    Impala could not start, but Hive still could query database. It turns out
    that they were using different metastores: Impala's using MySQL server,
    Hive's using its embedded database (Apache Derby).

    So, I configured Hive's database connection for working with MySQL server
    as the following guideline then it worked well:

    https://ccp.cloudera.com/display/CDHDOC/Hive+Installation#HiveInstallation-ConfiguringtheHiveMetastore

    Thanks for your help!
    On Monday, March 25, 2013 8:51:59 AM UTC+8, Andy wrote:

    Hi,

    I'm following this tutorial:
    https://ccp.cloudera.com/display/IMPALA10BETADOC/Data+Loading+and+Querying+Examples


    - I modified directory permission:


    *[root@impala2 ~]# hadoop fs -ls /user/hive/*
    *Found 1 items*
    *drwxrwxr-t - hive hive 0 2013-03-25 08:11
    /user/hive/warehouse*

    - I created some tables already:

    *[root@impala2 ~]# hadoop fs -ls /user/hive/warehouse/*
    *Found 4 items*
    *drwxrwxr-t - root hive 0 2013-03-25 08:04
    /user/hive/warehouse/minhnd_db.db*
    *drwxrwxrwx - root hdfs 0 2013-03-25 08:10
    /user/hive/warehouse/tab1*
    *drwxr-xr-x - root hdfs 0 2013-03-25 08:11
    /user/hive/warehouse/tab2*
    *drwxrwxr-t - root hive 0 2013-03-25 08:08
    /user/hive/warehouse/tab3*

    *hive> show tables; *
    *OK*
    *tab1*
    *tab2*
    *tab3*
    *Time taken: 0.084 seconds*

    *hive> select * from tab1;*
    *OK*
    *1 true 123.123 2012-10-24 08:55:00*
    *2 false 1243.5 2012-10-25 13:40:00*
    *3 false 24453.325 2008-08-22 09:33:21.123*
    *4 false 243423.325 2007-05-12 22:32:21.33454*
    *5 true 243.325 1953-04-22 09:11:33*
    *Time taken: 0.149 seconds*


    But, Impala still can't see Hive's table after running the "refresh"
    command:

    *[localhost:21000] > refresh*
    *Successfully refreshed catalog*
    *[localhost:21000] > show databases;*
    *Query: show databases*
    *Query finished, fetching results ...*
    *default*
    *Returned 1 row(s) in 0.10s*
    *[localhost:21000] > show tables;*
    *Query: show tables*
    *Query finished, fetching results ...*

    *Returned 0 row(s) in 0.11s*

    Please help me fix it.
    To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupimpala-user @
categorieshadoop
postedMar 25, '13 at 12:52a
activeApr 3, '14 at 6:39p
posts8
users4
websitecloudera.com
irc#hadoop

4 users in discussion

Andy: 4 posts Aliza Panitz: 2 posts Greg Rahn: 1 post Miklos Christine: 1 post

Content

People

Support

Translate

site design / logo © 2022 Grokbase