Search Discussions
-
Hi all! We have been using HBase 0.20.4 (cdh3b1) in production on 2 nodes for a few months now and we are having constant issues with it. We fell over all standard traps (like "Too many open files", ...
Anze
Dec 13, 2010 at 10:42 am
Dec 20, 2010 at 7:58 am -
Hi All. After heavy load into hbase (single node, nondistributed test system) I got 4Gb process size of my HBase java process. On 6GB machine there was no room for anything else (disk cache and so ...
Andrey Stepachev
Dec 30, 2010 at 8:02 am
Jan 13, 2011 at 4:14 pm -
We would like some help with cluster sizing estimates. We have 15TB of currently relational data we want to store in hbase. Once that is replicated to a factor of 3 and stored with secondary indexes ...
Wayne
Dec 17, 2010 at 5:10 pm
Feb 19, 2011 at 11:23 pm -
Dear all, I set up my HBase server in standalone mode. Can HBase Client (from another machine) connect to this HBase server? How can I do that? A lot of people have the same question. But I did not ...
King JKing
Dec 23, 2010 at 6:57 am
Dec 23, 2010 at 8:56 pm -
Hello. We plan to run a set of queries on tables with multiple columns. What is the most efficient method to say, insert 1000 rows, and/or read 1000 rows. We are considering just using REST. But what ...
Jack Levin
Dec 11, 2010 at 5:59 am
Dec 18, 2010 at 7:29 pm -
We are in the process of evaluating hbase in an effort to switch from a different nosql solution. Performance is of course an important part of our evaluation. We are a python shop and we are very ...
Wayne
Dec 24, 2010 at 1:09 pm
Jan 3, 2011 at 5:47 pm -
I have been testing a couple of different approaches to storing customer orders. One is a tall table, where each order is a row. The other is a wide table where each customer is a row, and orders are ...
Bryan Keller
Dec 22, 2010 at 11:41 pm
Dec 23, 2010 at 10:44 pm -
Hi all, we are using HBase 0.20.6 on a cluster of about 25 nodes with about 30k regions and are experiencing as issue which causes running M/R jobs to fail. When we restart single RegionServer, then ...
Jan Lukavský
Dec 13, 2010 at 4:36 pm
Jan 12, 2011 at 7:08 pm -
Hello HBasers, I had a regionserver crash recently, and in perusing the logs it looks like it simply had a bit too little memory. I'm running with 2200 MB heap on reach regionserver. I plan to shave ...
Sandy Pratt
Dec 16, 2010 at 11:08 pm
Dec 20, 2010 at 8:24 pm -
Hi, I am facing with some issues when I try to write the results of my Reducer to an HBase table, in pseudo-distributed mode. HBase version: 0.20.6 Hadoop version: 0.20.2 I let HBase manage ...
Gökhan Çapan
Dec 6, 2010 at 4:13 pm
Dec 9, 2010 at 12:57 am -
Hi , I am using hbase with hadoop 0.20.1 version and I am planning to upgrade to the latest hadoop release 0.21.0 Is there any hbase compatibility issue with hadoop 0.21.0 ? -- Thanks and Regards, ...
Gokul
Dec 26, 2010 at 2:04 pm
Jan 3, 2011 at 10:28 pm -
Hi all, I wrote a MR job for inserting rows into hbase. I open a CSV file which is present in the hdfs and i use put function in the map() to insert into hbase. This technique worked just for 50% and ...
Rajgopalv
Dec 7, 2010 at 1:37 pm
Dec 16, 2010 at 5:20 am -
Hi, I am trying to setup replication for my HBase clusters. I have two small clusters for testing each with 4 machines. The setup for the two clusters is identical. Each machine runs a DataNode, and ...
Nathaniel Cook
Dec 13, 2010 at 6:53 pm
Dec 14, 2010 at 6:35 pm -
Hi, dumb question again. I have been using a Scan to return a result back to my client which works fine except when I am returning a million rows just to aggregate the results. The next logical step ...
Peter Haidinyak
Dec 17, 2010 at 6:56 pm
Dec 30, 2010 at 12:59 pm -
The latest CDH3 beta includes security changes that currently HBase 0.90 and trunk don't incorporate. Of course we can help out with clear HBase issues, but for security exceptions or similar, what ...
Andrew Purtell
Dec 22, 2010 at 2:45 am
Dec 22, 2010 at 7:15 pm -
Greetings HBase Homies, I'm running the .89 dev release (though I had this problem in .20.6 as well). Trying to load 10 x 8.5 CSV files from HDFS into an empty HBase table. Getting pretty slow loads ...
Bradford Stephens
Dec 21, 2010 at 3:56 am
Dec 23, 2010 at 5:30 am -
After 11 hours I give up. I am trying to get a 5 node system up on my ESXi server. OS CentOS 5.5 x64 Hadoop Version 0.20.2+737 HBase Version 0.87.20100924+28 Name Node - Zoo Keeper - HBase Master on ...
Pete Haidinyak
Dec 21, 2010 at 11:33 pm
Dec 22, 2010 at 3:13 pm -
hello, I have written a simple java program to load data and scan table in hbase, but get problems. this is my code snap: HBaseConfiguration config = new HBaseConfiguration(); HTable table = new ...
Exception qin
Dec 6, 2010 at 7:55 am
Dec 8, 2010 at 5:09 am -
Hi, I have to test hbase as to how long it takes to store 100 Million Records. So i wrote a simple java code which 1 : generates random key and 10 columns per key and random values for the 10 ...
Rajgopalv
Dec 1, 2010 at 2:48 pm
Dec 3, 2010 at 7:37 pm -
I have a small JAVA system using relational database. Basically, the app have 3 entities: CUSTOMER has many CONTRACTs and each CONTRACT has many INSTALLMENTS Very classic. I am figuring out what is ...
Valter Nogueira
Dec 28, 2010 at 11:27 pm
Jan 3, 2011 at 1:13 am -
Hi, I'm using HBase .89 and Hadoop .20.2 I'm trying to create a connection to HBase from a remote Java Client. I am using the following code... final Configuration configuration = ...
Peter Haidinyak
Dec 9, 2010 at 7:22 pm
Dec 10, 2010 at 6:49 am -
Hi, I set up a small test hbase cluster on ec2. If I want to now store some data in the cluster from outside ec2 using the java client, what should I do? I am very new to hbase and ec2 so any help ...
Nanheng Wu
Dec 4, 2010 at 7:29 am
Dec 6, 2010 at 6:59 am -
Hi, My cluster was running great till yesterday. Today, I submitted some jobs and I saw that the jobs were taking way too long. On investigation, I saw that the "Child" processes created by previous ...
Hari Sreekumar
Dec 7, 2010 at 12:36 pm
Nov 17, 2011 at 4:15 pm -
Hi,i found a problem in my hbase mapreduce case. when first running mapreduce TableMapReduceUtil runs ok. and i use hbase shell to delete some data from the table that mapreduce one . then ran ...
梁景明
Dec 1, 2010 at 8:02 am
Dec 6, 2010 at 11:11 am -
Are there any hooks in hbase to do data replication? We have to try to move our 12 hour batch jobs down to 3 hours or so and are looking at moving into a noSQL environment, but currently, customers ...
Hiller, Dean (Contractor)
Dec 21, 2010 at 5:15 pm
Jan 10, 2011 at 8:25 pm -
Hi, Is there a way to get the Row Key for the result from a Scanner? I've seen examples where you get the bytes for the row and extract the row key from there but my keys are of random lenght. Thanks ...
Pete Haidinyak
Dec 28, 2010 at 7:41 am
Dec 28, 2010 at 6:08 pm -
Hi, I have a cluster of 8 hdfs datanodes and 8 hbase regionservers. When I shutdown one node(a pc with one datanode and one regionserver running), all hbase regionservers shutdown after a while. ...
Zhou Shuaifeng
Dec 20, 2010 at 4:16 am
Dec 22, 2010 at 5:30 pm -
We are getting those errors in the logs: 12781689 is mtag2.prod.imageshack.com:60020 2010-12-21 12:07:51,700 ERROR org.apache.zookeeper.ClientCnxn: from ...
Jack Levin
Dec 21, 2010 at 10:39 pm
Dec 22, 2010 at 2:33 am -
We have a 6 node cluster, 5 with region serves. 2 of the region servers have been stable for days, but 3 of them keep crashing. Here are the logs around around when the crash occurs. (btw, we are ...
Lance Riedel
Dec 9, 2010 at 7:28 pm
Dec 21, 2010 at 10:12 pm -
Strange, suddenly shell cannot use! errors: bin/hbase shell ClassLoader.java:-2:in `defineClass1': java.lang.ClassFormatError: Unknown constant tag 26 in class file ...
陈加俊
Dec 18, 2010 at 10:12 am
Dec 21, 2010 at 6:40 am -
Hi why is it generally said that zk should have a separate disk of it's own? Currently in my small 5 node cluster, one of the regionservers itself is also the zk. How beneficial is it to move it to a ...
Hari Sreekumar
Dec 8, 2010 at 6:08 pm
Dec 9, 2010 at 5:13 pm -
Hi, We're currently running into issues with running a MapReduce job over a complete HBase table - we can't seem to find a balance between having dfs.datanode.max.xcievers set too low (and getting ...
Gabriel Reid
Dec 6, 2010 at 8:03 am
Dec 7, 2010 at 7:49 pm -
Hi, I am trying to setup HBase on a single Windows Vista machine by following the instructions mentioned here : http://hbase.apache.org/docs/current/cygwin.html#Introduction I see the HBase server ...
Vijay
Dec 2, 2010 at 2:15 pm
Dec 2, 2010 at 7:47 pm -
Hi, I'm using the HBase Bulk Loader<http://archive.cloudera.com/cdh/3/hbase/bulk-loads.html with 0.89. Very easy to use. I have a few of questions: 1) It seems importtsv will only accept one family ...
Marc Limotte
Dec 23, 2010 at 9:12 pm
Dec 29, 2010 at 7:52 pm -
2010-12-18 18:11:00,333 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction requested for region cjjBeeDocument,\x00\x00\x00\ x00\x00\x0F\xF7x,1292667057185/110111081 because: ...
陈加俊
Dec 19, 2010 at 6:15 am
Dec 21, 2010 at 7:15 am -
Hi, I will go straight to the point, we are purchasing hardwares for going live. Currently we are targeting a data capacity of ~5TB with a view to increase capacity as the load increases. I have ...
Imran M Yousuf
Dec 17, 2010 at 5:04 am
Dec 18, 2010 at 5:40 am -
Hi We are running Hadoop-0.20.2 without append (HDFS-200) on our production environment. Can I run HBase on this cluster? If I can, which version of HBase should I use? Because using HBase is ...
Yifeng Jiang
Dec 10, 2010 at 1:12 am
Dec 10, 2010 at 5:54 am -
Is there a good tool out there for serialization to hbase for a java entity? If I have an Account, and then have a List<Activities in the account, I preferably want to serialize that as all strings ...
Hiller, Dean (Contractor)
Dec 6, 2010 at 9:40 pm
Dec 7, 2010 at 7:31 pm -
Hi I am going to have a process running that will add rows to a table. The row id is just a counter of the number of rows inserted. Is there a quick way to programmatically find out the number of ...
Peter Haidinyak
Dec 3, 2010 at 12:03 am
Dec 3, 2010 at 6:42 am -
Hi, I'm doing a distributed scan of an hbase table using map-reduce by taking all the regions belonging to a regionserver, and then assigning those regions to a mapper (so there's 1 mapper per ...
Albert Shau
Dec 2, 2010 at 10:26 pm
Dec 3, 2010 at 5:36 am -
hadoop 0.21.0 has been released with the stable hdfs append feature.. Should we do anything in hbase(modify / apply some patch) to use this hdfs append feature or hbase takes care of this in-built?? ...
Gokulakannan M
Dec 28, 2010 at 8:43 am
Jan 5, 2011 at 11:31 am -
I'm doing a map reduce job to create the HFileOutputFormat out of CSVs. * The mapreduce job, operates on 75files, each containing 1Million rows. Total comes up to 16GB. [with replication factor as 2, ...
Rajgopalv
Dec 22, 2010 at 7:13 am
Dec 23, 2010 at 9:30 am -
Hi In my Java Client can I reuse a Scan object or should I create a new one for every scan? Thanks -Pete
Peter Haidinyak
Dec 13, 2010 at 7:30 pm
Dec 13, 2010 at 11:36 pm -
Hi What are the differences between using a scan filter and simpli scanning and then filtering using if conditions? Any particular gotchas you need to be careful about while using filters ...
Hari Sreekumar
Dec 5, 2010 at 5:39 pm
Dec 6, 2010 at 11:54 am -
I am running some tests to load data from HDFS into HBase in a MR job. I am pretty new to HBase and I have some questions regarding bulk load performance: I have a small cluster with 4 nodes, I set ...
Nanheng Wu
Dec 27, 2010 at 9:54 am
Dec 29, 2010 at 8:49 pm -
Jeff Hammerbacher stated on Quora [1] that "the Avro gateway is not production quality" and made a reference to the improvements that an upgrade to Avro 1.4 would bring. I would like to understand a ...
Michael Russo
Dec 26, 2010 at 3:16 pm
Dec 29, 2010 at 9:03 am -
Hi, In my DFS home page, display the message below WARNING : There are about 7179 missing blocks. Please check the log or run fsck. who can tell me what this message and how to fix than? bcoz so far ...
SingoWong
Dec 24, 2010 at 10:44 pm
Dec 27, 2010 at 5:15 pm -
I had a question about using a Scan on part of a composite key. Say I have order line item rows, and the ID is order ID + line item ID. Each ID is a random string. I want to get all line items for an ...
Bryan Keller
Dec 14, 2010 at 11:29 pm
Dec 15, 2010 at 4:54 am -
Does anyone have suggestions regarding the best way to modify existing entries in a table? We have our tables set up such that when we create an entry we set its timestamp such that the entry has a ...
Adam Phelps
Dec 13, 2010 at 7:12 pm
Dec 15, 2010 at 4:52 am -
I was looking through the thirft API again and noticed that it said if a transaction - comprised of updates to one or more rows - throws an exception then the whole transaction is aborted. Does this ...
Chris Tarnas
Dec 10, 2010 at 10:58 pm
Dec 13, 2010 at 5:06 am
Group Overview
group | user |
categories | hbase, hadoop |
discussions | 144 |
posts | 755 |
users | 114 |
website | hbase.apache.org |
114 users for December 2010
Archives
- June 2016 (130)
- May 2016 (187)
- April 2016 (267)
- March 2016 (237)
- February 2016 (206)
- January 2016 (173)
- December 2015 (189)
- November 2015 (166)
- October 2015 (238)
- September 2015 (226)
- August 2015 (236)
- July 2015 (259)
- June 2015 (262)
- May 2015 (435)
- April 2015 (391)
- March 2015 (360)
- February 2015 (353)
- January 2015 (313)
- December 2014 (217)
- November 2014 (436)
- October 2014 (434)
- September 2014 (467)
- August 2014 (605)
- July 2014 (504)
- June 2014 (356)
- May 2014 (390)
- April 2014 (509)
- March 2014 (551)
- February 2014 (483)
- January 2014 (554)
- December 2013 (483)
- November 2013 (488)
- October 2013 (534)
- September 2013 (620)
- August 2013 (753)
- July 2013 (694)
- June 2013 (579)
- May 2013 (633)
- April 2013 (722)
- March 2013 (677)
- February 2013 (772)
- January 2013 (761)
- December 2012 (742)
- November 2012 (798)
- October 2012 (785)
- September 2012 (681)
- August 2012 (802)
- July 2012 (803)
- June 2012 (586)
- May 2012 (768)
- April 2012 (522)
- March 2012 (643)
- February 2012 (636)
- January 2012 (655)
- December 2011 (563)
- November 2011 (556)
- October 2011 (540)
- September 2011 (680)
- August 2011 (756)
- July 2011 (778)
- June 2011 (830)
- May 2011 (828)
- April 2011 (1,051)
- March 2011 (1,095)
- February 2011 (753)
- January 2011 (1,000)
- December 2010 (755)
- November 2010 (561)
- October 2010 (529)
- September 2010 (770)
- August 2010 (461)
- July 2010 (634)
- June 2010 (506)
- May 2010 (458)
- April 2010 (518)
- March 2010 (843)
- February 2010 (363)
- January 2010 (578)
- December 2009 (414)
- November 2009 (542)
- October 2009 (578)
- September 2009 (428)
- August 2009 (493)
- July 2009 (610)
- June 2009 (459)
- May 2009 (351)
- April 2009 (357)
- March 2009 (328)
- February 2009 (302)
- January 2009 (341)
- December 2008 (342)
- November 2008 (274)
- October 2008 (362)
- September 2008 (311)
- August 2008 (298)
- July 2008 (326)
- June 2008 (158)
- May 2008 (190)
- April 2008 (168)
- March 2008 (150)
- February 2008 (136)