FAQ
Hi Manoj,

Can you send me some more logging? Here's how to do it:

1. add "--vmodule=plan-fragment-executor=3" to the impalad startup
parameter. If you're using CM, go to service->Impala->Configuration. Then
add this option to *Impalad Command Line Argument Safety Valve* and restart
Impala.

2. Identify the host that has the last region. Send the impala.INFO log of
that host.

Thanks,
Alan

On Wed, Oct 23, 2013 at 6:38 AM, Manoj H.P. wrote:

I see the issue is fixed, but I this the issue still prevails in my
environment on 1.1.1 as well, any pointers plz?

On Monday, 22 April 2013 11:29:41 UTC+5:30, kane...@gmail.com wrote:

Cluster Information:
Total of 2 Nodes in the cluster - with CDH42 installed by RPM and impala
beta .6

At first the Hbase, Hive and Impala all work well, but after the
HRegion(s) changing(region split or move it to another region server),
Impala return wrong results, on the other hand, the Hbase and Hive still
work right.



For example,



A. 4 regions distribute in 2 RServers.



*Name***

*Region Server***

*Start Key***

*End Key***

*Requests***

testhive,,1365649095895.**35878eef07f63754bc6e08314b4d65**59.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

2

testhive,0.3334863476115134,**1365649095895.**
b938a2f65d4947d017bb246e63daf8**f5.

*vm-9e88-17b6.nam.nsroot.net:60030*<http://vm-9e88-17b6.nam.nsroot.net:60030/>

0.3334863476115134

key0

12

testhive,key0,1365649096332.**8a6ba2a39c67ce00fb41b5f760dc86**e4.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key0

key90

12

testhive,key90,1365649096332.**b69882f6e5337f41036aba0f5a8f93**47.

*vm-9e88-17b6.nam.nsroot.net:60030*<http://vm-9e88-17b6.nam.nsroot.net:60030/>

key90

12





hbase(main):001:0> count 'testhive'

30 row(s) in 0.1650 seconds



hive> select * from testhive; (These servers haven’t installed MR, so
just can execute select *)

OK

(list 30 rows)



[vm-9e88-17b6.nam.nsroot.net:**21000<http://vm-9e88-17b6.nam.nsroot.net:21000>]
select count(*) from testhive;
Query: select count(*) from testhive

Query finished, fetching results ...

30

Returned 1 row(s) in 2.68s





B. Shutdown Region Server on vm-9e88-17b6, and all region will be moved
to vm-0660-ba06.



*Name***

*Region Server***

*Start Key***

*End Key***

*Requests***

testhive,,1365649095895.**35878eef07f63754bc6e08314b4d65**59.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

6

testhive,0.3334863476115134,**1365649095895.**
b938a2f65d4947d017bb246e63daf8**f5.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

key0



testhive,key0,1365649096332.**8a6ba2a39c67ce00fb41b5f760dc86**e4.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key0

key90

35

testhive,key90,1365649096332.**b69882f6e5337f41036aba0f5a8f93**47.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key90







hbase(main):001:0> count 'testhive'

30 row(s) in 0.0970 seconds



hive> select * from testhive;

OK

(list 30 rows)



[vm-9e88-17b6.nam.nsroot.net:**21000<http://vm-9e88-17b6.nam.nsroot.net:21000>]
select count(*) from testhive;
Query: select count(*) from testhive

Query finished, fetching results ...

20

Returned 1 row(s) in 1.24s





And I found that when executing Impala query, the requests of the first 3
regions increased, but the last region didn’t get any requests.



Before querying:

*Name***

*Region Server***

*Start Key***

*End Key***

*Requests***

testhive,,1365649095895.**35878eef07f63754bc6e08314b4d65**59.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

24

testhive,0.3334863476115134,**1365649095895.**
b938a2f65d4947d017bb246e63daf8**f5.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

key0

101

testhive,key0,1365649096332.**8a6ba2a39c67ce00fb41b5f760dc86**e4.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key0

key90

136

testhive,key90,1365649096332.**b69882f6e5337f41036aba0f5a8f93**47.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key90

57



After querying:



*Name***

*Region Server***

*Start Key***

*End Key***

*Requests***

testhive,,1365649095895.**35878eef07f63754bc6e08314b4d65**59.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

26

testhive,0.3334863476115134,**1365649095895.**
b938a2f65d4947d017bb246e63daf8**f5.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

0.3334863476115134

key0

112

testhive,key0,1365649096332.**8a6ba2a39c67ce00fb41b5f760dc86**e4.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key0

key90

147

testhive,key90,1365649096332.**b69882f6e5337f41036aba0f5a8f93**47.

*vm-0660-ba06.nam.nsroot.net:60030*<http://vm-0660-ba06.nam.nsroot.net:60030/>

key90

57



If query by Hbase or Hive, all regions are able to get requests.





If a region split to 2 ones, sometimes the new regions can’t get requests
too, but not always.



Anyone ever encountered the same issue?



Please help me if you have any ideas. Thanks.
To unsubscribe from this group and stop receiving emails from it, send an
email to impala-user+unsubscribe@cloudera.org.
To unsubscribe from this group and stop receiving emails from it, send an email to impala-user+unsubscribe@cloudera.org.

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupimpala-user @
categorieshadoop
postedOct 23, '13 at 9:36p
activeOct 23, '13 at 9:36p
posts1
users1
websitecloudera.com
irc#hadoop

1 user in discussion

Alan Choi: 1 post

People

Translate

site design / logo © 2022 Grokbase