impala-user@cloudera.org discussions for December 2013

7	Looking for percentile UDAF (or median, histogram, etc.)

Hi everyone- I'm trying to find an efficient implementation of a percentile UDAF (or a median or histogram function, since those would be built on the same approach) for Impala 1.2/1.2.1. The Hive ...

Noah Lorang
Dec 9, 2013 at 8:13 pm
Aug 24, 2014 at 3:44 pm

7	Error querying HBASE table in Impala 1.2.2

Hello, I just tried Impala 1.2.2 on our cluster and ran into the following class not found problem. 13:26:35.887 UhrINFOinit.cc:81 OS version: Linux version 3.2.0-32-generic (buildd@batsu) (gcc ...

Johannes Kirschnick
Dec 18, 2013 at 1:34 pm
Dec 18, 2013 at 10:13 pm

7	how to verify that Impala is actually using multiple cores?

Hi All, I'm new to impala and I have a basic (paranoid) question: How can I verify that a query is really running on multiple cores? I'm looking for some execution statistics, I guess. Below is the ...

Matthewcornell
Dec 2, 2013 at 5:35 pm
Dec 6, 2013 at 6:35 pm

6	Re: Connection pooling - JDBC driver - Is impala production ready to be used for connection pooling ?

Hi Anath, I kinda wonder if you've simply reached the connection limit (64 by default). You can see the number of connections from the impala debug webpage. Did you also close the query when you're ...

Alan Choi
Dec 16, 2013 at 10:39 pm
Jan 8, 2014 at 6:55 pm

5	Impala 1.2.1 Issue:- Invalidate Metadata taking large time

Hi, We are setting up CDH Cluster with Cloudera Hadoop 4.4 and Impala 1.2.1 When we issue invalidate metadata command from impala-shell, it is taking large amount of time(~1 minute) where as it ...

Ashish Agrawal
Dec 11, 2013 at 12:14 pm
Dec 19, 2013 at 4:38 pm

5	ERROR: IllegalStateException: null in query containing UNION (Impala 1.2.1)

Hi, On impala 1.2.1, my select containing union gives "ERROR: IllegalStateException: null". - Individual parts of Union run fine when run as separate query. - Running the union with codegen disabled ...

Manoj Samel
Dec 18, 2013 at 8:41 pm
Dec 18, 2013 at 11:48 pm

4	Connection reset when accessing HBase table

The following statement terminates with an error message: create table kdgforum_raw_t as select * from kdgforum_raw; Unknown Exception : [Errno 104] Connection reset by peer Query aborted. Version ...

Henrik B.
Dec 18, 2013 at 9:39 pm
Jan 9, 2014 at 12:12 am

4	Bad data in Impala 1.2.1 compared to Impala 1.1.1

Hi, I have two cluster setups * One cluster is setup with Impala 1.1.1 and was set up using cloudera manager * Other cluster is setup with Impala 1.2.1 / CDH 4.5 and was setup manually i.e. without ...

Manoj Samel
Dec 18, 2013 at 12:22 am
Dec 28, 2013 at 1:26 am

4	ODBC Connection to EC2

Hi, We are trying to test the ODBC connection from a local Microstrategy dev server to our remote dev Impala cluster in EC2. We are using Cloudera Connector 2.0 for Microstrategy along with CDH4.5.0, ...

Benjamin Kim
Dec 12, 2013 at 8:14 pm
Dec 12, 2013 at 9:43 pm

4	Memory consumption by impalad

Hi Impalans, I'm trying to understand impala memory usage. We configured impala with a 15GB memory limit and gave the cgroup hard memory limit 1GB higher and daemons that clients ran some queries on ...

Sean O'Brien
Dec 6, 2013 at 9:08 pm
Dec 7, 2013 at 1:34 am

4	tuning Impala - how much more performance might I expect after these changes?

Hello everyone. I continue to evaluate Impala for our lab, and I'm impressed. My simple benchmarking so far shows a speedup compared to postgres of somewhere around 4x (maybe 9x if I understand Query ...

Matthewcornell
Dec 5, 2013 at 2:36 pm
Dec 6, 2013 at 6:14 pm

4	Impala does not have WRITE access to at least one HDFS path

After upgrading to Impala 1.2.1 and Cloudera Manager 4.8, past impala queries stop working with external tables with the following error: ERROR: AnalysisException: Unable to INSERT into target table ...

Shaun Sit
Dec 3, 2013 at 9:51 am
Dec 5, 2013 at 5:31 am

4	Impala 1.2.1 source code

Hi, I checked Impala source code at github, but could not find the source code for version 1.2.1. The master is still for 1.2.0-INTERNAL and there is no tag for 1.2.1. When will the github source ...

Jian Fang
Dec 1, 2013 at 10:24 pm
Dec 5, 2013 at 1:24 am

4	Is there a way to obfuscate queries in the Impala 'http://hadoop.xxx.com:25000/queries' page

Hi - We have a security concern with Impala. It seems all users within the cluster can access the queries page for impala. That page exposes all the queries initiated on that particular daemon. It is ...

Bps cdh
Dec 4, 2013 at 8:13 pm
Dec 4, 2013 at 9:15 pm

3	Impala with Kerberos won't start

I tried this on Impala 1.1.1 and Impala 1.2.3. I use ClouderaManager Free edition to setup cluster version 4.8.0. All other services have startup and work fine: hdfs, hive, hue, mapreduce, oozie, ...

Stanislav Antic
Dec 30, 2013 at 2:31 pm
Jan 6, 2014 at 5:34 pm

3	[help] How to start impalad?

Dear all : I used rpm packet to install impala. All the rpms are installed well. But the default install path is different, impala is installed in /usr/lib/impala. When I use "service impala-server ...

Qiuxincsu
Dec 27, 2013 at 12:42 pm
Dec 27, 2013 at 3:57 pm

3	HBase Counters

In our transition from using Hive to Impala, I saw that in Hive the HBase counter columns returned the correct numbers, but in Impala, they come back as NULL. Is there a way in Impala to return the ...

Benjamin Kim
Dec 17, 2013 at 5:18 pm
Dec 17, 2013 at 10:06 pm

3	Observations regarding performance using build-in functions

The use of the build in functions significantly slows down queries. I have a external table with a "timestamp" column: create external table if not exists logdata_simple ( transaction_id string, ...

Henrik Ring
Dec 11, 2013 at 1:46 pm
Dec 16, 2013 at 12:54 pm

3	Re: Impala support for custom serde

Impala currently does not support custom SerDes. To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Alex Behm
Dec 13, 2013 at 9:20 pm
Dec 14, 2013 at 1:54 am

3	UDA: Could not find symbol 'AvgUpdate' in: /user/hive/udfs/libudasample.so

Hi, I have a "Could not find symbol" error when I import an UDA function in Impala 1.2.1, Cloudera Manager 4.8.0. I use the functions from https://github.com/cloudera/impala-udf-samples and the ...

Nicolas Fouché
Dec 11, 2013 at 10:41 pm
Dec 13, 2013 at 1:04 am

3	Re: Impala 1.2.1 not supported CM-5 Beta

Hi Dhanasekaran, When you click on a particular impala process, what do the stderr, stdout, and role logs say? If nothing is there, is there anything interesting in the CM agent logs? ...

Darren Lo
Dec 11, 2013 at 8:59 pm
Dec 11, 2013 at 9:57 pm

3	String columns from CSV File not NULL but ""

Hello there, I have loaded external tables from csv files. Some columns of type String are empty. I expected them to be NULL when loaded into Impala. Instead, they contain the value "" , an empty ...

Antony
Dec 10, 2013 at 7:06 pm
Dec 10, 2013 at 8:36 pm

3	Re: Debugging backend/parquet failures.

We ran into the same error. The parquet-hadoop subproject of parquet-mr jar has a bug where it writes an incorrect size for dictionary pages (the size doesn't include the header, only the data) ...

Keith Simmons
Dec 9, 2013 at 7:04 pm
Dec 9, 2013 at 8:43 pm

3	java.lang.NoSuchMethodError: Method com.cloudera.impala.service.FeSupport.NativeFeTestInit()V

Through an idiotic confusion of "yum update" from "yum upgrade", I managed to do full update on my impala "namenode", moving it from 1.1.1 to 1.2.1, along with s*ton of other updates. Now, when I ...

Mike Barretta
Dec 4, 2013 at 7:58 pm
Dec 5, 2013 at 10:04 pm

3	Re: Table statistics can currently only be stored in a MySQL database?

Unfortunately, that is still the case. Future versions of Impala will have their own command for computing stats that will remove this limitation. The perf hit caused by not having stats may be ...

Alex Behm
Dec 2, 2013 at 8:34 pm
Dec 3, 2013 at 4:35 pm

2	some catalogd failed to start, even though some succeeded to start.

Hello, I am trying to use impala 1.2.3 (w/ CDH4.5) with a 20-node cluster. After I installed it, I have some problem starting catalogd daemons in some node. (I successfully ran impala in one node, ...

Fakie
Dec 28, 2013 at 10:10 am
Dec 31, 2013 at 6:46 pm

2	Re: why can not partitioned table be compressed?

are you using hive or impala to do the insert? To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Alan Choi
Dec 27, 2013 at 8:09 pm
Dec 27, 2013 at 11:24 pm

2	Re: Impala Parquet File size concerns

Hi, You're doing INSERT INTO (not INSERT OVERWRITE). Data size should go up and count should go up too. Did you do "insert into" or "insert overwrite"? Thanks, Alan To unsubscribe from this group and ...

Alan Choi
Dec 23, 2013 at 9:08 pm
Dec 26, 2013 at 5:50 am

2	Re: Is it possible to write a Impala UDAF in Java?

No Java UDAFs. That's a doc error, corrected in 1.2.2 released today. Thanks, John -- Sent from my iPad To unsubscribe from this group and stop receiving emails from it, send an email to ...

John Russell
Dec 18, 2013 at 5:22 am
Dec 18, 2013 at 5:38 am

2	CDH5-b1 - problems starting up Impala

Hi, I am running into a problem starting Impala. The cluster is on CDH5-b1(parcels) on Ubuntu 12.04 and has bunch of databases and tables created by hive. When I start Impala service, I see the error ...

Prashant gokhale
Dec 12, 2013 at 8:54 am
Dec 13, 2013 at 12:36 am

2	During DDL/Invalidate, ERROR: Couldn't open transport for localhost:26000(connect() failed: Connecti

Hi, Using impala-shell, I can see the hive metastore, use any data base created by Hive and query any table created by Hive. When I try to create a table in impala-shell or do a "invalidate ...

Manoj Samel
Dec 12, 2013 at 1:18 am
Dec 12, 2013 at 2:12 am

2	"Query finished, fetching results ..." is fast, results are slower

Hi there. I'm testing some queries in Impala, and I noticed that when I run them interactively I see the message "Query finished, fetching results ..." early on, then the results after more time. My ...

Matthewcornell
Dec 3, 2013 at 4:09 pm
Dec 5, 2013 at 12:42 pm

1	[ANNOUNCE] Cloudera Impala 1.2.2 and ODBC Driver for Impala version 2.5.13 releaed

Dear CDH, Cloudera Manager, and Cloudera Impala users, We are pleased to announce the general availability of Cloudera Impala 1.2.2 and version 2.5.13 of the Cloudera ODBC Driver for Cloudera ...

Wendy Turner
Dec 17, 2013 at 10:15 pm
Jul 29, 2014 at 6:52 pm

1	Question on group resolution for "impala" ...

From https://hadoop.apache.org/docs/r2.2.0/hadoop-project-dist/hadoop-hdfs/HdfsPermissionsGuide.html it says "For HDFS, the mapping of users to groups is performed on the NameNode. Thus, the host ...

Manoj Samel
Dec 30, 2013 at 7:27 pm
Jan 8, 2014 at 2:02 am

1	Impala caching of name node and other metadata ...

Can someone explains what metadata from Namenode is cached in Impala-d when it starts ? What does catalog-d caches ? To unsubscribe from this group and stop receiving emails from it, send an email to ...

Manoj Samel
Dec 30, 2013 at 7:30 pm
Jan 7, 2014 at 10:01 pm

1	Re: IMPALA-723

You may see Alan's comment on the JIRA. I'm afraid that both 1.2.2 and 1.2.3 have this problem. We know what the problem is and a fix is in review. There is no quick workaround, but you can try ...

Alex Behm
Dec 30, 2013 at 11:59 pm
Dec 31, 2013 at 6:34 pm

1	Re: Query seems finished, but the query result is returned after a while.

Hi - When you say the query 'seems finished', how are you determining that? The Impala debug webpage (and the shell) will say a query is 'FINISHED' when its first rows are available to fetch ...

Henry Robinson
Dec 30, 2013 at 5:19 pm
Dec 31, 2013 at 12:11 pm

1	impalad.INFO question

Impala 1.2.3 /var/log/impala/impalad.INFO lists disks I1227 19:00:02.885730 15147 init.cc:79] Disk Info: Num disks 3: xvdf (rotational=false) xvdp (rotational=false) xvde (rotational=false) Curious ...

Manoj Samel
Dec 27, 2013 at 7:43 pm
Dec 28, 2013 at 12:31 am

1	Re: [help] The problem when I install impala-shell-1.2.3

I believe that rpm is looking for the packaged version of python-setuptools, but you installed it via pypi. I think the best solution is to yum install python-setuptools, then try again. -- Henry ...

Henry Robinson
Dec 26, 2013 at 8:32 pm
Dec 27, 2013 at 2:23 pm

1	Impala configs... what is MINI_DFS_BASE_DATA_DIR ??

Hey, i'm new to impala and i'm trying to install and configure it. In the impala-config.sh i found this *export MINI_DFS_BASE_DATA_DIR=$IMPALA_HOME/hdfs-data* . I wish to know for what this folder is ...

Bruno Andrade
Dec 26, 2013 at 10:38 am
Dec 26, 2013 at 8:39 pm

1	Predicate ignored when more columns are selected (HBase)

Server version: impalad version 1.2.2 RELEASE (build 3f5048c7fe027886d32f96a5e77297ad159f7467) select rowkey,text from kdgforum_raw where text="Heiner" limit 2 ...

Henrik B.
Dec 20, 2013 at 6:45 pm
Dec 20, 2013 at 7:38 pm

1	Invalid or unknown query handle when accessing large HBase cell

I cannot access an HBase Cell containing a HTML page using Impala: select rowkey, page_id, length from kdgforum_extract where page_id = '0737733181' ...

Henrik B.
Dec 20, 2013 at 4:08 pm
Dec 20, 2013 at 5:47 pm

1	impala query plan execution

Hi All, I'm interested to know the detailed explanation of how impala distributequery plan among HDFS DNs. how it decompose query, based on what it distribute decomposed query among HDFS DNs (what is ...

Soheila Dehghanzadeh
Dec 19, 2013 at 4:32 pm
Dec 20, 2013 at 10:07 am

1	Re: Partition pruning

Hi Keith, you are correct. Impala versions below 1.2.2 have that limitation due to the OR condition. This particular issue has been fixed in Impala 1.2.2. If you don't want to upgrade, one option is ...

Alex Behm
Dec 20, 2013 at 1:45 am
Dec 20, 2013 at 1:46 am

1	unknown query id exception raises with Impala INSERT query

Hi, I am using CDH4.5 p 30 and impala 1.2.1. When try to insert using JDBC to hive table , INSERT query is not performing correctly . Looks like it is closing the session before even complete the ...

RP
Dec 18, 2013 at 9:16 pm
Dec 19, 2013 at 1:49 am

1	ArrayIndexOutOfBoundsException / Invalid query handle when reading large HBase cell

I get an error when I try to access an HBase cell containing an HTML page (CDH 4.5): select rowkey, page_id, length from kdgforum_extract where page_id = '0737733181' ...

Henrik B.
Dec 17, 2013 at 12:44 pm
Dec 18, 2013 at 8:14 pm

1	Subqueries in where clause ...

I couldn't do a simple subquery in Impala 1.2.1. E.g. something like * create table t1 ( c1 int, c2, int, c3 int ) * Add bunch of rows ... * select * from t1 where a.c1 = ( select max(c1) from t1 ...

Manoj Samel
Dec 18, 2013 at 5:51 am
Dec 18, 2013 at 2:53 pm

1	Error when loading data into Impala Created table

I read the input on this web page: https://issues.cloudera.org/browse/IMPALA-529?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel and still don't know what I'm doing wrong and ...

Luis Montoya
Dec 16, 2013 at 9:26 pm
Dec 18, 2013 at 4:21 am

1	wired error while launching analyzer report - Pentaho & Impala

I have created one analyzer report using Impala connection, I am using two tables with 3000, 1000 records respectively. while launching analyzer report, i am getting following error: Oops. There is ...

Pari Margu
Dec 16, 2013 at 6:27 pm
Dec 17, 2013 at 8:17 am

1	No of catalog server instances

Hi, Im upgrading Impala from 1.1 to 1.2. This page (http://www.cloudera.com/content/cloudera-content/cloudera-docs/Impala/latest/Installing-and-Using-Impala/ciiu_upgrading.html) says "start the ...

Sam William
Dec 13, 2013 at 12:54 am
Dec 13, 2013 at 12:59 am

group	impala-user @
categories	hadoop
discussions	66
posts	207
users	64
website	cloudera.com
irc	#hadoop

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Hadoop > impala-user > December 2013

Search Discussions

66 discussions - 207 posts

64 users for December 2013

Content

People

Support

Translate