Search Discussions
-
Hi HBase users, I try to implement multiple threads for HBase writing process, but looks like the table.flushCommites() breaks thread easily. Then I add a synchronized blocker for it, it flows but ...
Hotec04
Jun 6, 2014 at 10:43 pm
Jun 9, 2014 at 4:16 pm -
Hi, The cat is already out of the bag on Trafodion on this dlist (and we are very happy about it actually). But, here's an official announcement anyway. Hewlett-Packard is pleased to announce the ...
Birdsall, Dave
Jun 11, 2014 at 9:59 pm
Jun 12, 2014 at 10:59 pm -
Folk, I am trying to bulk load the hdfs file into hbase with LoadIncrementalHFiles loader = new LoadIncrementalHFiles(conf); loader.doBulkLoad(new Path(args[1]), hTable); However, i receive exception ...
Chen Wang
Jun 18, 2014 at 4:54 am
Jun 19, 2014 at 7:10 pm -
borthakur.com/ftp/RealtimeHadoopSigmod2011.pdf Thanks, 发件人: Ramasubramanian Narayanan [<span class="m_body_email_addr" title="fe8d5d859a1752f2225a8d9b46b45bfb" ...
谢良
Jun 9, 2014 at 9:04 am
Jun 11, 2014 at 9:26 pm -
Last night a regionserver in my cluster stopped responding in a timely manner for about 20 minutes. I know that stop-the-world GC can cause this type of behavior, but 20 minutes seems excessive. The ...
Tom Brown
Jun 10, 2014 at 6:06 pm
Jun 11, 2014 at 4:11 am -
One option is to write your own Comparator (similar to BinaryPrefixComparator in essence) that treats the known column name specially. Cheers
Ted Yu
Jun 5, 2014 at 8:26 pm
Jun 6, 2014 at 9:22 pm -
I have a map reduce job using hbase table as input. when the job starts, it says: ERROR main org.apache.hadoop.hbase.mapreduce.TableInputFormatBase Cannot resolve the host name for ...
Li Li
Jun 25, 2014 at 8:30 am
Jun 25, 2014 at 9:43 am -
Hello all, I'm trying to view the master status of a 6 node (0.94.10; hadoop 1.1.2) cluster but I keep getting a timeout exception. The rest of the cluster is operating quite normally. From the ...
Tom Brown
Jun 18, 2014 at 5:20 pm
Jun 27, 2014 at 5:20 pm -
Could we see the full stack trace? It would help confirm Qiang's prognosis. Do you have monitoring of this server setup? What did it show for loading, handler-count, at this time? Thanks, St.Ack
Michael Stack
Jun 6, 2014 at 4:16 pm
Jun 24, 2014 at 2:15 pm -
Hello I am interested in doing a comparative study of Hfile v2 and Hfile v3 under different workload condition. I have following questions in this regard: 1) Is HFile v3 available in HBase .98? 2) ...
Abhishek1015
Jun 13, 2014 at 12:59 am
Jun 15, 2014 at 3:21 am -
Hi I'm using a heavy-write hbase0.96 . I find this in regionserver log: 2014-06-03 15:13:19,445 INFO [regionserver60020.logRoller] wal.FSHLog: Too many hlogs: logs=33, maxlogs=32; forcing flush of 3 ...
Sunweiwei
Jun 3, 2014 at 7:44 am
Jun 7, 2014 at 2:06 am -
When I use row prefix scan, how hbase find start row internally? is it finding start row using binary search? plz, anyone know that? thanks
Intae Kim
Jun 28, 2014 at 12:48 am
Jun 30, 2014 at 7:30 am -
Hi all, we have been experiencing the same problem with 2 of our clusters. We are currently using HDP 2.1 that comes with HBase 0.98. The problem manifested by showing a huge differences (hundreds of ...
Giuseppe Reina
Jun 25, 2014 at 9:55 am
Jun 27, 2014 at 9:40 pm -
Please see http://hbase.apache.org/book/node.management.html Especially 15.3.1.1 Did you stop the datanode on that server or let datanode run ? Cheers
Ted Yu
Jun 3, 2014 at 1:07 pm
Jun 5, 2014 at 11:34 am -
Hi All I basically have a thread pool which has the task of pushing data into HBASE. However, it is seen that wheneever the data rate is very high, which means that i have many records to be pushed ...
Arunas
Jun 18, 2014 at 5:20 pm
Jul 1, 2014 at 3:18 am -
I have a question. I want to execute an MapReduce and the output of my reduce it's going to store in HBase. So, it's a MapReduce with an output which it's going to be stored in HBase. I can do a Map ...
Guillermo Ortiz
Jun 26, 2014 at 3:25 pm
Jun 27, 2014 at 4:07 pm -
Hi All, I am running HBase 0.94.3 and trying to get ACL working on a single node cluster. I followed the steps in http://hbase.apache.org/book/hbase.accesscontrol.configuration.html step 8.4.3 and ...
Enoch Hsu
Jun 19, 2014 at 10:05 pm
Jun 20, 2014 at 5:43 pm -
Hi I have several regionservers. One regionserver has 434 regions and other regionservers only have about 300+ regions. I think it's not balance. Then I run balancer command in hbase shell and return ...
Sunweiwei
Jun 17, 2014 at 3:20 am
Jun 18, 2014 at 12:50 am -
Hello, We are trying to export HBase table on S3 for backup purpose. By default export tool run a map per region and we want to limit output bandwidth on internet (to amazon s3). We were thinking in ...
Damien Hardy
Jun 4, 2014 at 12:40 pm
Jun 5, 2014 at 10:08 pm -
Last piece of the puzzle! My Mapreduce succeeded in generating hdfs file, However, bulk load with the following code: LoadIncrementalHFiles loader = new LoadIncrementalHFiles(hbaseConf) ...
Chen Wang
Jun 20, 2014 at 1:10 am
Jun 20, 2014 at 3:09 am -
hi all, the hbase client send too much requests and the some region server down. 1. region server down because of gc pause I can see it from log: [JvmPauseMonitor] util.JvmPauseMonitor: Detected ...
Li Li
Jun 18, 2014 at 9:59 am
Jun 18, 2014 at 11:16 am -
Hi ya Anoop the comparison was between SCVF and Custom Filter. Seeing the deployment process of Custom Filter, i.e building a jar deploying it on to all RS *i thought that the work in similar fashion ...
Vikram Singh Chandel
Jun 17, 2014 at 11:51 am
Jun 18, 2014 at 11:01 am -
Yes, the hadoop cluster is using maprfs, so the hdfs files are are in maprfs:/ format: 2014-06-17 21:48:58 WARN: org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles - Skipping non-directory ...
Chen Wang
Jun 18, 2014 at 5:04 am
Jun 18, 2014 at 10:15 am -
I'd highly recommend it. In general, compressing your column families will improve performance by reducing the resources required to get data from disk (even when taking into account the CPU overhead ...
Dima Spivak
Jun 13, 2014 at 6:00 pm
Jun 16, 2014 at 9:31 pm -
final HBaseAdmin admin = new HBaseAdmin(config); HTableDescriptor table = new HTableDescriptor(TableName.valueOf(TABLE_NAME)); table.addFamily(new ...
Jean-Marc Spaggiari
Jun 11, 2014 at 9:55 pm
Jun 12, 2014 at 11:39 pm -
Hi, I'm generating key with SHA1, as it's a hex representation after generating the keys, I use Hex.decode to save memory since I could store them in half space. I have a MapReduce process which ...
Guillermo Ortiz
Jun 9, 2014 at 9:02 am
Jun 12, 2014 at 12:21 pm -
Hi, Is it possible to delete a particular version values in a Hbase table? for example, hbase(main):050:0* scan 'test1',{VERSIONS= 3} ROW COLUMN+CELL 1 column=f1:id, timestamp=1404138357648, ...
Ramasubramanian Narayanan
Jun 30, 2014 at 2:18 pm
Jul 1, 2014 at 10:58 am -
Hi, I am importing millions of records in to HBase using a custom application. We have 3 data servers. The processing time increased 4x after getting this error from region server 3 (master ...
John Cooper
Jun 27, 2014 at 1:33 pm
Jun 27, 2014 at 3:50 pm -
Hello, I was wondering if there is a defined client configuration for hbase client for connecting to a secure hbase cluster? With my client attempting to talk to a secure cluster, I keep getting the ...
Kulkarni Swarnim
Jun 25, 2014 at 10:14 pm
Jun 26, 2014 at 6:18 am -
I have deleted many rows in a table. as far as I know, only after major compaction, they are really deleted. So I run major compact 'tablename' in hbase shell it returns very fast. is the real ...
Li Li
Jun 18, 2014 at 3:19 am
Jun 20, 2014 at 1:50 am -
Hi , I got into trouble in bulkload hfiles to hbase after i enable HBase ACL in hbase-site.xml <property <name hbase.rpc.engine</name <value org.apache.hadoop.hbase.ipc.SecureRpcEngine</value ...
Bi,hongyu—mike
Jun 11, 2014 at 1:42 am
Jun 11, 2014 at 2:15 am -
Hi all, We are running a number of Map/Reduce jobs on top of HBase. We are not using HBase for any of its realtime capabilities, only for batch-processing. So we aren't doing lookups, just scans ...
Matt K
Jun 2, 2014 at 7:55 pm
Jun 2, 2014 at 11:02 pm -
Hi, Recently my Hbase cluster was migrated to 0.98.3 from 0.92 version. Now all my java client code which scans the table and puts data into the table is not working. Earlier I use to set just the ...
AnandaVelMurugan Chandra Mohan
Jun 30, 2014 at 12:14 pm
Jul 1, 2014 at 4:19 am -
Hi, I have a 6 node grid that I have upgraded from hadoop 2.0 to hadoop 2.4. I am facing issues with hbase upgrade from 0.94.6-cdh4.3.0 to apache hbase-0.98.2-hadoop2. Appreciate any pointers on how ...
Mejo Tom
Jun 30, 2014 at 4:56 pm
Jun 30, 2014 at 5:19 pm -
Hi I'm using a hbase0.94.2 cluster, which has 3 zookeepers, 17 regionservers, about 40000 regions. each regionserver has about 2300 regions. Maybe the cluster has too many regions. 1、If a ...
Sunweiwei
Jun 27, 2014 at 2:41 am
Jun 27, 2014 at 11:48 am -
my table has about 700 million rows and about 80 regions. each task tracker is configured with 4 mappers and 4 reducers at the same time. The hadoop/hbase cluster has 5 nodes so at the same time, it ...
Li Li
Jun 26, 2014 at 7:35 am
Jun 27, 2014 at 1:06 am -
Hi, With HBase 0.96, HConnection.getTable method used to throw an exception in case the table did not exist. Based on this exection, I was creating tables in HBase as required. With HBase 0.98.3 I'm ...
Anand Nalya
Jun 25, 2014 at 1:18 pm
Jun 25, 2014 at 1:24 pm -
What is a good way of checking RegionState? I am getting the following error when I programmatically try to merge regions. Exception in thread "main" java.lang.RuntimeException ...
Geovanie Marquez
Jun 24, 2014 at 6:35 pm
Jun 24, 2014 at 6:44 pm -
2
java.lang.NoSuchMethodError: org.apache.hadoop.hbase.io.hfile.AbstractHFileWriter.compressionByName
Hi folks, I am running bulk load with HFileOutputFormat. The reducer throws the following NoSuchMethodError.Just wondering where this class is? My pom looks like this:(0.96.1.1-cdh5.0.1) <dependency ...Chen Wang
Jun 20, 2014 at 12:21 am
Jun 20, 2014 at 12:48 am -
The following hbase artifacts from maven work JUST FINE including the sources: hbase-client hbase-common hbase-server hbase-shell hbase-examples hbase-thrift hbase-protocol Here is an example of the ...
Stephen Boesch
Jun 19, 2014 at 11:14 pm
Jun 19, 2014 at 11:28 pm -
Hi, I had an issue last night where one of the regionservers crashed due to running out of memory while doing a count on a table with 8M rows, This left the system in a state where is though the ...
Ian Brooks
Jun 17, 2014 at 9:08 am
Jun 17, 2014 at 12:11 pm -
hi maillist: i want to campare the number of store file before and after minor compaction ,but how can i calculate number of store file first?
Ch huang
Jun 16, 2014 at 7:50 am
Jun 16, 2014 at 4:20 pm -
hi,maillist: any difference between the following two command in hbase shell? *deleteall ‘t1′, ‘r1′, ‘c1′, ts1 * * delete ‘t1′, ‘r1′, ‘c1′, ts1*
Ch huang
Jun 16, 2014 at 7:21 am
Jun 16, 2014 at 12:02 pm -
Hi Vikram, Maybe I'm misunderstanding your question, but isn't this expected since coprocessors do the heavy lifting at the level of the RegionServer whereas the client API means you hit a bottleneck ...
Dima Spivak
Jun 16, 2014 at 10:49 am
Jun 16, 2014 at 11:43 am -
I have this data set and the value I want to test is "cf:c" = "hung": hbase(main):001:0 scan 'TEST' ROW COLUMN+CELL \x00\x00\x00\x03abc\x00\x00\x00\x02 column=cf:a, timestamp=1402649511909, value=abc ...
Henry Hung
Jun 16, 2014 at 3:22 am
Jun 16, 2014 at 4:07 am -
Hi, I am planning to have one table with 3 column families(cf) ,having around 200,100,200 column qualifiers (cq) in each of them resp. Whats the number of cq a cf can hold ? Also having different ...
Vimal Jain
Jun 15, 2014 at 10:56 am
Jun 15, 2014 at 11:41 am -
bq. what is the process do recover? You need to bring zookeeper nodes back as soon as possible. bq. will all clients reconnect or do you have to restart all servers? This depends on the release of ...
Ted Yu
Jun 14, 2014 at 2:14 pm
Jun 14, 2014 at 9:57 pm -
hi, there. I have noticed that https://issues.apache.org/jira/browse/HBASE-3171 has dropped the -ROOT- Region, and use .META. Region only. If I can remember the previous logic of hbase, it can ...
Bing Jiang
Jun 12, 2014 at 11:05 am
Jun 12, 2014 at 11:18 am -
hi, everyone : Our hbase version is 0.96.1.1-hadoop2 ,and we use kerberos for security. but when I use bulkload . that code runs to the location LoadIncrementalHFiles(line 307): .... new ...
Jhaobull
Jun 10, 2014 at 2:15 am
Jun 11, 2014 at 7:09 am -
I run start-hbase.sh and after a few minutes, the HMaster process disappears, but the HQuorumPeer process is ok. I can telnet localhost 2181. I am using hadoop-1.2.1(which is ok by visit ...
Li Li
Jun 9, 2014 at 5:17 am
Jun 9, 2014 at 6:36 am
Group Overview
group | user |
categories | hbase, hadoop |
discussions | 97 |
posts | 356 |
users | 101 |
website | hbase.apache.org |
101 users for June 2014
Archives
- June 2016 (130)
- May 2016 (187)
- April 2016 (267)
- March 2016 (237)
- February 2016 (206)
- January 2016 (173)
- December 2015 (189)
- November 2015 (166)
- October 2015 (238)
- September 2015 (226)
- August 2015 (236)
- July 2015 (259)
- June 2015 (262)
- May 2015 (435)
- April 2015 (391)
- March 2015 (360)
- February 2015 (353)
- January 2015 (313)
- December 2014 (217)
- November 2014 (436)
- October 2014 (434)
- September 2014 (467)
- August 2014 (605)
- July 2014 (504)
- June 2014 (356)
- May 2014 (390)
- April 2014 (509)
- March 2014 (551)
- February 2014 (483)
- January 2014 (554)
- December 2013 (483)
- November 2013 (488)
- October 2013 (534)
- September 2013 (620)
- August 2013 (753)
- July 2013 (694)
- June 2013 (579)
- May 2013 (633)
- April 2013 (722)
- March 2013 (677)
- February 2013 (772)
- January 2013 (761)
- December 2012 (742)
- November 2012 (798)
- October 2012 (785)
- September 2012 (681)
- August 2012 (802)
- July 2012 (803)
- June 2012 (586)
- May 2012 (768)
- April 2012 (522)
- March 2012 (643)
- February 2012 (636)
- January 2012 (655)
- December 2011 (563)
- November 2011 (556)
- October 2011 (540)
- September 2011 (680)
- August 2011 (756)
- July 2011 (778)
- June 2011 (830)
- May 2011 (828)
- April 2011 (1,051)
- March 2011 (1,095)
- February 2011 (753)
- January 2011 (1,000)
- December 2010 (755)
- November 2010 (561)
- October 2010 (529)
- September 2010 (770)
- August 2010 (461)
- July 2010 (634)
- June 2010 (506)
- May 2010 (458)
- April 2010 (518)
- March 2010 (843)
- February 2010 (363)
- January 2010 (578)
- December 2009 (414)
- November 2009 (542)
- October 2009 (578)
- September 2009 (428)
- August 2009 (493)
- July 2009 (610)
- June 2009 (459)
- May 2009 (351)
- April 2009 (357)
- March 2009 (328)
- February 2009 (302)
- January 2009 (341)
- December 2008 (342)
- November 2008 (274)
- October 2008 (362)
- September 2008 (311)
- August 2008 (298)
- July 2008 (326)
- June 2008 (158)
- May 2008 (190)
- April 2008 (168)
- March 2008 (150)
- February 2008 (136)