FAQ
Hi Carmit,

Thanks for sharing. That's helpful.

Can you also tell us if you're using Cloudera Manager?

Right now, we tried to update all the partitions in a single Hive Metastore
call. So, that might have caused the timeout.

Thanks,
Alan



On Thu, Mar 13, 2014 at 1:49 AM, wrote:

Partitions upadted # = 7911
Column upadted # = 36

Running compute stats on 7412 partitions, 36 column - succeeded
Running compute stats on 7911 partitions , 36 column - failed

Many 10x!!!!!






בתאריך יום חמישי, 13 במרץ 2014 04:02:35 UTC+2, מאת Alan:
Hi Carmit,

The amount of update done to the HiveMetastore depends on the number of
partitions and the number of columns. If you've a large number of
partitions or columns, it seems quite possible to timeout. Would you mind
sharing with us how many partitions/columns are you using?

On Wed, Mar 12, 2014 at 8:46 AM, wrote:

Alan Thanks!
create and drop and compute stats are working fine.

i have tried to load data step by step to the table and it was worked
fine but the last compute stats which over of all the table failed (like i
had at the beginning)

do u think that the problem related to timeout? maybe mysql timeout?

--running time of the compute stats faild after 30 s

10x!!!
Carmit


בתאריך יום שלישי, 11 במרץ 2014 23:14:17 UTC+2, מאת Alan:
Hi Carmit,

The error is thrown by the HiveMetastore. Let's first verify that you
can update the Hive Metastore by creating and dropping a tmp table:
create table tmp1(a int); insert into tmp1 values(1); compute stats
tmp1; drop table tmp1;

If the above stmt works but yours compute stats fails consistently,
then we might need to look deeper.

Thanks,
Alan

On Tue, Mar 11, 2014 at 1:32 PM, wrote:

Hey,

i
I'm trying to run compute stats on a table(about 300,000,000 raw,
100 G compressed,1.3 T not compressed ) and i have got error that i don't
understand:

"The transaction for alter partition did not commit successfully."


attached the error .


please someone know what is the problem?

10x!!!
Carmit
To unsubscribe from this group and stop receiving emails from it,
send an email to impala-user...@cloudera.org.
To unsubscribe from this group and stop receiving emails from it,
send an email to impala-user...@cloudera.org.
To unsubscribe from this group and stop receiving emails from it, send
an email to impala-user+unsubscribe@cloudera.org.
To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Search Discussions

Discussion Posts

Previous

Follow ups

Related Discussions

Discussion Navigation
viewthread | post
posts ‹ prev | 5 of 8 | next ›
Discussion Overview
groupimpala-user @
categorieshadoop
postedMar 11, '14 at 8:32p
activeMar 14, '14 at 5:49p
posts8
users3
websitecloudera.com
irc#hadoop

People

Translate

site design / logo © 2022 Grokbase