Search Discussions
-
26
Row Counters
1. How do I count rows fast in hbase? First I tired count 'test' , takes ages. Saw that I could use RowCounter, but looks like it is deprecated. When I try to use it, I get java.io.IOException: ...Vivek Krishna
Mar 16, 2011 at 8:36 pm
Mar 17, 2011 at 6:49 pm -
Hi, I'm running some performance tests on a cluster with 5 member servers (not counting the masters of all kinds), each node running a data node, a region server and a thrift server. Each server has ...
Eran Kutner
Mar 28, 2011 at 10:17 am
May 9, 2011 at 8:42 pm -
21
Hash keys
Hi, To help avoid hotspots, I'm planning to use hashed keys in some tables. 1. I wonder if this strategy is adviced for range queries (from/to key) use case, because the rows will be randomly ...Eric Charles
Mar 16, 2011 at 8:53 am
Apr 21, 2011 at 3:18 pm -
Hi, I'm trying to use replication between two HBase clusters and I'm encountering all kinds of crashes and weird behavior. First, it seems that starting a region server when the peer ZKs are not ...
Eran Kutner
Mar 22, 2011 at 5:40 pm
Mar 29, 2011 at 11:30 am -
Hi everyone, We are having this problem for a while and would really appreciate any suggestions. We have a 5 node cluster, 4 of them being region servers. I am running a custom workload with YCSB and ...
M.Deniz OKTAR
Mar 7, 2011 at 1:44 pm
Mar 11, 2011 at 6:09 pm -
All was well, until this happen: http://pastebin.com/iM1niwrS and all regionservers went down, is this xciever issue? <property <name dfs.datanode.max.xcievers</name <value 12047</value </property ...
Jack Levin
Mar 10, 2011 at 6:31 pm
Mar 31, 2011 at 6:21 am -
I just had to upgrade our second cluster CDH3B4 (the 2GB log file problem, same as the reason for upgrading another cluster) and now the master is not coming up, it dies with this error: 2011-03-17 ...
Chris Tarnas
Mar 17, 2011 at 11:21 pm
Mar 18, 2011 at 2:56 am -
15
hole in META
Hi Using hbase-0.20.6..This has happened quite often..Is this a known issue in 0.20.6 that we would n't see in 0.90.1 (or) see less of? ..Attempt to fix/avoid this earlier times by truncating table, ...Venkatesh
Mar 29, 2011 at 2:39 pm
Mar 31, 2011 at 4:17 pm -
Hi, I recently set up a 2-node Hadoop and HBase cluster and am trying to load data into my HBase table using HBase client. The issue bothers me is that the data are always written into one node of ...
Weiwei Xiong
Mar 14, 2011 at 5:50 pm
Mar 15, 2011 at 6:33 am -
15
min, max
How to get the first or last row in the HBase table? like the min(), max() in mysql? Thank you.Weishung Chung
Mar 1, 2011 at 10:04 pm
Mar 4, 2011 at 2:55 pm -
Hi, We had a troubling experience today that I wanted to share. Our dev cluster got completely shut down by a developer by mistake, without said developer even realizing it. Here's how... We have ...
Bill Graham
Mar 3, 2011 at 1:23 am
Mar 5, 2011 at 3:50 am -
Hey folks, What would be the best approach for migrating away from a given region server implementation back to the default out-of-the box one? My goal here is to upgrade our cluster to 0.90 and ...
George P. Stathis
Mar 24, 2011 at 7:15 pm
Mar 25, 2011 at 4:22 am -
Hi, What's the best place to learn about HBase replication? I found http://hbase.apache.org/book/cluster_replication.html , but note how there is only a link there, and that link points to a 404. ...
Otis Gospodnetic
Mar 2, 2011 at 4:51 pm
Mar 3, 2011 at 10:04 pm -
How to copy HTable from one cluster to another cluster ? The table is very big . -- Thanks & Best regards jiajun
陈加俊
Mar 9, 2011 at 10:28 am
Mar 31, 2011 at 3:48 pm -
I am using the Java client API to write 10,000 rows with about 6000 columns each, via 8 threads making multiple calls to the HTable.put(List<Put ) method. I start with an empty table with one column ...
Bryan Keller
Mar 13, 2011 at 8:15 am
Mar 15, 2011 at 9:04 pm -
Hello, does anybody use MapReduce streaming over HBase? When I use TableInputFormat, I get this line on std input: 72 6f 77 31 keyvalues={row1/family1:a/1298037737154/Put/vlen=1, ...
Ondrej Holecek
Mar 8, 2011 at 10:51 am
Mar 9, 2011 at 11:41 pm -
11
Blob storage
Hi all, I have just had a new requirement to store blob data. I recall seeing this discussed in the past, but my search only turned up references to Lily and the hbase hackathon: ...Buttler, David
Mar 8, 2011 at 6:34 pm
Mar 9, 2011 at 10:14 pm -
Hi, I tried to use my hbase-default.xml from 0.89 with my new 0.90.1 installation. I get a message stating "hbase-default.xml seems to be from an old version of hbase(null), this version is 0.90.1. ...
Geoff Hendrey
Mar 4, 2011 at 10:45 pm
Mar 8, 2011 at 12:28 am -
Hi, I am experiencing severe connection leak in my MR client that uses Hbase as input/output . Every job that uses TableInputFormat leaks 1 zookeeper connection per run as evidenced by netstat. I ...
Dmitriy Lyubimov
Mar 23, 2011 at 8:54 pm
Apr 16, 2011 at 1:44 pm -
I scan the table ,It just has 29000 rows and each row only has not reached 1 k . I save it to files which has 18M. But I used /app/cloud/hadoop/bin/hadoop fs -copyFromLocal , it has 99G . Why ? -- ...
陈加俊
Mar 31, 2011 at 4:35 am
Apr 1, 2011 at 4:52 pm -
Some body execute the command : /app/cloud/hadoop/bin/hadoop fs -rmr /hbase/.META. So the regions of all tables is lost ,Can I rebuild the tables by hdfs files ? -- Thanks & Best regards jiajun
陈加俊
Mar 30, 2011 at 7:07 am
Mar 30, 2011 at 9:59 am -
Hi, I am trying to create table in hbase v0.90.1 and I get the following error: 11/03/28 18:39:52 INFO zookeeper.ClientCnxn: Opening socket connection to server hadoop2/192.168.1.111:2181 11/03/28 ...
Hari Sreekumar
Mar 28, 2011 at 1:29 pm
Mar 30, 2011 at 5:46 am -
Is it possible using stargate interface to hbase, fetch all rows where more than one column family:<qualifier must be present? like :select rows which contains keyword:a and keyword:b ? Thanks
sreejith P. K.
Mar 24, 2011 at 1:19 pm
Mar 25, 2011 at 5:38 pm -
I am browsing through the hadoop.io package and was wondering what other file formats are available in hadoop other than SequenceFile and TFile? Is all data written through hadoop including those ...
Weishung Chung
Mar 19, 2011 at 4:02 pm
Mar 23, 2011 at 1:43 pm -
Hi, What is the API or configuration for changing the default hash function for a specific htable. thanks, Lior
Lior Schachter
Mar 20, 2011 at 5:07 pm
Mar 22, 2011 at 1:31 am -
Friends, how do I best achieve intersection of sets of row ids suppose I have two tables with similar row ids how can I get the row ids present in one and not in the other? does things get better if ...
Vishal Kapoor
Mar 11, 2011 at 4:09 am
Mar 13, 2011 at 11:48 pm -
Hi, I'm trying to figure out the root cause of the crush on a small HBase cluster and I need some help from the experts here. I tried to post my question earlier but it seems the message was blocked ...
Tatsuya Kawano
Mar 5, 2011 at 2:27 am
Mar 10, 2011 at 11:40 pm -
Has anything changed with the way compression is handled in 0.90? I'm in the process of testing 0.90 CDH3B4 on my development machine (OS X). Up until 0.89 SNAPSHOTS, I have been able to re-use the ...
George P. Stathis
Mar 28, 2011 at 3:04 pm
Apr 1, 2011 at 12:52 pm -
Trying to understand why out test program was generating so many threads (HBase 0.90.0), I discover that every time we instantiate HTable we get a new thread pool (ThreadPoolExecutor). This seems a ...
Joe Pallas
Mar 29, 2011 at 10:50 pm
Mar 30, 2011 at 4:30 pm -
I am trying to estimate the cost of hosting own HBase cluster vs using EC2. Could anyone give me some guidance? Cluster size ~ 6 to 8 nodes Usage ~ at least 12 hours/day with lot of read/write ...
Weishung Chung
Mar 10, 2011 at 5:13 pm
Mar 11, 2011 at 5:46 pm -
Hi, I'm setting a 4-region-nodes hbase clusters, with the master running outside the data clusters. It works 'well'. The problem is after some sort of stress tests, say launching 20 threads, putting ...
茅旭峰
Mar 9, 2011 at 10:06 am
Mar 10, 2011 at 10:46 pm -
My cluster (10 nodes, hbase-0.20.6 + hadoop 0.20.2) is very very slow for any operation like disable table or delete. Master's thread dump says they are blocked by the metaScanner thread. When I ...
Nanheng Wu
Mar 2, 2011 at 1:08 am
Mar 2, 2011 at 4:37 am -
We had an issue a day ago with some OOME's on the region servers. The master shutdown ok, but most of the RegionServers didn't and so eventually had to kill -9 them. Brought it all back up and ran a ...
Marc Limotte
Mar 6, 2011 at 12:23 am
Apr 16, 2011 at 3:53 am -
Dear Buddies, I need to re-calculate the entries in a hbase everyday, like let x = 0.9x everyday, to make the time has impact on the entry values. So I write a TableMapper to get the Entry, and ...
Stanley Xu
Mar 25, 2011 at 2:37 am
Mar 29, 2011 at 9:58 am -
Hi all, We're experiencing a problem where a map-only job using TableInputFormat and TableOutputFormat to export data from one table into another is not reading all of the rows in the source table. ...
Sean Sechrist
Mar 18, 2011 at 1:51 pm
Mar 22, 2011 at 7:33 pm -
Hi, Can anyone help please? How stable is Hbase when inserting data? I have seen a few emails regarding issues with this. The reason I ask is that we have built a 12 data-node cluster, with region ...
Stuart Scott
Mar 21, 2011 at 8:17 pm
Mar 22, 2011 at 12:56 am -
Hello experts, I have a scenario as follows, I need to maintain a huge table for a 'web crawler' project in HBASE. Basically it contains thousands of keywords and for each keyword i need to maintain ...
sreejith P. K.
Mar 15, 2011 at 5:19 pm
Mar 17, 2011 at 4:56 am -
Hi All, I am working on benchmarking different data stores to find the best fit for our use case. I would like to know views and suggestions of the HBase user and developer community on some of my ...
Aditya Sharma
Mar 4, 2011 at 6:20 am
Mar 7, 2011 at 11:54 pm -
Hi, I have few basic question related to HBase shell. Please help me out in these issues. 1. When I start the HBase Shell I am not getting the HBase prompt. 2. When I enter the command wrongly shell ...
James Ram
Mar 1, 2011 at 9:37 am
Mar 3, 2011 at 5:50 am -
Hello guys, we are getting those errors: 2011-03-28 15:08:33,485 INFO org.apache.hadoop.hdfs.server.datanode.DataNode.clienttrace: src: /10.101.6.5:50010, dest: /10.101.6.5:51365, bytes: 66564, op: ...
Jack Levin
Mar 28, 2011 at 11:19 pm
Mar 30, 2011 at 5:29 pm -
Hi, Unable to use the Increment function, can anybody suggest what am I doing wrong... I enter data by :- theput.add(Bytes.toBytes("uid"),Bytes.toBytes("1"), 1301087829999L + t, Bytes.toBytes(10)) ...
Sulabh choudhury
Mar 29, 2011 at 3:23 pm
Mar 29, 2011 at 7:35 pm -
Hello, I've set up a test HBase+Hadoop cluster yesterday and got the following error in logs during running MR job (which internally creates HTable for Reducer): KeeperErrorCode = ConnectionLoss for ...
Alex Baranau
Mar 25, 2011 at 7:37 pm
Mar 26, 2011 at 8:44 pm -
Hi, In our tests, we've accumulated lots of WAL logs, in .logs, which leads to quite long time pause or even OOME when restarting either master or region server. We're doing sort of bulk import and ...
茅旭峰
Mar 17, 2011 at 7:12 am
Mar 22, 2011 at 4:54 am -
Hi, My Q is around the suggested or maximum number of CFs per table (see http://hbase.apache.org/book/schema.html#number.of.cfs ) Consider the following use-case. * A multi-tenant system. * All ...
Otis Gospodnetic
Mar 17, 2011 at 6:30 am
Mar 17, 2011 at 9:45 pm -
Hi, We are trying a small hbase environment, including 2-node masters, 4-node regionservers, and 3-node zookeeper cluster. Now we're doing stress tests, using cells of bigger size(4mb - 15mb). What ...
茅旭峰
Mar 14, 2011 at 1:43 pm
Mar 16, 2011 at 3:43 pm -
I've subclassed RegionObserver and am overriding postPut. How does one obtain the row byte[] of the Put that generated the call? Is it available via from the familyMap? What is the purpose of the ...
Jason Rutherglen
Mar 14, 2011 at 7:54 pm
Mar 15, 2011 at 2:36 am -
~resending to hbase-user@hadoop.apache.org~ Is there a best-practice for modeling multi-valued fields (fields that are repeated or collections of fields)? Our current data model allows for a User to ...
Cameron Leach
Mar 10, 2011 at 1:47 am
Mar 12, 2011 at 12:47 am -
Hi, Since HBase has a mechanism to replicate edit logs to another HBase cluster, I was wondering if people think it would be possible to implement HBase= Hive replication? (and really make the ...
Otis Gospodnetic
Mar 11, 2011 at 6:43 am
Mar 11, 2011 at 7:52 pm -
Hi, I have set up replication, and it is working. Now i am interested in the performance implications of it. What is the best way to approach this? Should I use the "verifyrep" mentioned at the ...
Mark Kerzner
Mar 7, 2011 at 2:22 pm
Mar 7, 2011 at 11:51 pm -
Hi, Last week I consulted he forum about hbase insertion optimization when the key format is : date_key. This key format is very good for efficient scans but creates hotspot a single region when ...
Lior Schachter
Mar 27, 2011 at 5:01 pm
Mar 30, 2011 at 3:58 pm
Group Overview
group | user |
categories | hbase, hadoop |
discussions | 191 |
posts | 1,095 |
users | 127 |
website | hbase.apache.org |
127 users for March 2011
Archives
- June 2016 (130)
- May 2016 (187)
- April 2016 (267)
- March 2016 (237)
- February 2016 (206)
- January 2016 (173)
- December 2015 (189)
- November 2015 (166)
- October 2015 (238)
- September 2015 (226)
- August 2015 (236)
- July 2015 (259)
- June 2015 (262)
- May 2015 (435)
- April 2015 (391)
- March 2015 (360)
- February 2015 (353)
- January 2015 (313)
- December 2014 (217)
- November 2014 (436)
- October 2014 (434)
- September 2014 (467)
- August 2014 (605)
- July 2014 (504)
- June 2014 (356)
- May 2014 (390)
- April 2014 (509)
- March 2014 (551)
- February 2014 (483)
- January 2014 (554)
- December 2013 (483)
- November 2013 (488)
- October 2013 (534)
- September 2013 (620)
- August 2013 (753)
- July 2013 (694)
- June 2013 (579)
- May 2013 (633)
- April 2013 (722)
- March 2013 (677)
- February 2013 (772)
- January 2013 (761)
- December 2012 (742)
- November 2012 (798)
- October 2012 (785)
- September 2012 (681)
- August 2012 (802)
- July 2012 (803)
- June 2012 (586)
- May 2012 (768)
- April 2012 (522)
- March 2012 (643)
- February 2012 (636)
- January 2012 (655)
- December 2011 (563)
- November 2011 (556)
- October 2011 (540)
- September 2011 (680)
- August 2011 (756)
- July 2011 (778)
- June 2011 (830)
- May 2011 (828)
- April 2011 (1,051)
- March 2011 (1,095)
- February 2011 (753)
- January 2011 (1,000)
- December 2010 (755)
- November 2010 (561)
- October 2010 (529)
- September 2010 (770)
- August 2010 (461)
- July 2010 (634)
- June 2010 (506)
- May 2010 (458)
- April 2010 (518)
- March 2010 (843)
- February 2010 (363)
- January 2010 (578)
- December 2009 (414)
- November 2009 (542)
- October 2009 (578)
- September 2009 (428)
- August 2009 (493)
- July 2009 (610)
- June 2009 (459)
- May 2009 (351)
- April 2009 (357)
- March 2009 (328)
- February 2009 (302)
- January 2009 (341)
- December 2008 (342)
- November 2008 (274)
- October 2008 (362)
- September 2008 (311)
- August 2008 (298)
- July 2008 (326)
- June 2008 (158)
- May 2008 (190)
- April 2008 (168)
- March 2008 (150)
- February 2008 (136)