Search Discussions

144 discussions - 755 posts

  • Hi all! We have been using HBase 0.20.4 (cdh3b1) in production on 2 nodes for a few months now and we are having constant issues with it. We fell over all standard traps (like "Too many open files", ...
    Dec 13, 2010 at 10:42 am
    Dec 20, 2010 at 7:58 am
  • Hi All. After heavy load into hbase (single node, nondistributed test system) I got 4Gb process size of my HBase java process. On 6GB machine there was no room for anything else (disk cache and so ...
    Andrey StepachevAndrey Stepachev
    Dec 30, 2010 at 8:02 am
    Jan 13, 2011 at 4:14 pm
  • We would like some help with cluster sizing estimates. We have 15TB of currently relational data we want to store in hbase. Once that is replicated to a factor of 3 and stored with secondary indexes ...
    Dec 17, 2010 at 5:10 pm
    Feb 19, 2011 at 11:23 pm
  • Dear all, I set up my HBase server in standalone mode. Can HBase Client (from another machine) connect to this HBase server? How can I do that? A lot of people have the same question. But I did not ...
    King JKingKing JKing
    Dec 23, 2010 at 6:57 am
    Dec 23, 2010 at 8:56 pm
  • Hello. We plan to run a set of queries on tables with multiple columns. What is the most efficient method to say, insert 1000 rows, and/or read 1000 rows. We are considering just using REST. But what ...
    Jack LevinJack Levin
    Dec 11, 2010 at 5:59 am
    Dec 18, 2010 at 7:29 pm
  • We are in the process of evaluating hbase in an effort to switch from a different nosql solution. Performance is of course an important part of our evaluation. We are a python shop and we are very ...
    Dec 24, 2010 at 1:09 pm
    Jan 3, 2011 at 5:47 pm
  • I have been testing a couple of different approaches to storing customer orders. One is a tall table, where each order is a row. The other is a wide table where each customer is a row, and orders are ...
    Bryan KellerBryan Keller
    Dec 22, 2010 at 11:41 pm
    Dec 23, 2010 at 10:44 pm
  • Hi all, we are using HBase 0.20.6 on a cluster of about 25 nodes with about 30k regions and are experiencing as issue which causes running M/R jobs to fail. When we restart single RegionServer, then ...
    Jan LukavskýJan Lukavský
    Dec 13, 2010 at 4:36 pm
    Jan 12, 2011 at 7:08 pm
  • Hello HBasers, I had a regionserver crash recently, and in perusing the logs it looks like it simply had a bit too little memory. I'm running with 2200 MB heap on reach regionserver. I plan to shave ...
    Sandy PrattSandy Pratt
    Dec 16, 2010 at 11:08 pm
    Dec 20, 2010 at 8:24 pm
  • Hi, I am facing with some issues when I try to write the results of my Reducer to an HBase table, in pseudo-distributed mode. HBase version: 0.20.6 Hadoop version: 0.20.2 I let HBase manage ...
    Gökhan ÇapanGökhan Çapan
    Dec 6, 2010 at 4:13 pm
    Dec 9, 2010 at 12:57 am
  • Hi , I am using hbase with hadoop 0.20.1 version and I am planning to upgrade to the latest hadoop release 0.21.0 Is there any hbase compatibility issue with hadoop 0.21.0 ? -- Thanks and Regards, ...
    Dec 26, 2010 at 2:04 pm
    Jan 3, 2011 at 10:28 pm
  • Hi all, I wrote a MR job for inserting rows into hbase. I open a CSV file which is present in the hdfs and i use put function in the map() to insert into hbase. This technique worked just for 50% and ...
    Dec 7, 2010 at 1:37 pm
    Dec 16, 2010 at 5:20 am
  • Hi, I am trying to setup replication for my HBase clusters. I have two small clusters for testing each with 4 machines. The setup for the two clusters is identical. Each machine runs a DataNode, and ...
    Nathaniel CookNathaniel Cook
    Dec 13, 2010 at 6:53 pm
    Dec 14, 2010 at 6:35 pm
  • Hi, dumb question again. I have been using a Scan to return a result back to my client which works fine except when I am returning a million rows just to aggregate the results. The next logical step ...
    Peter HaidinyakPeter Haidinyak
    Dec 17, 2010 at 6:56 pm
    Dec 30, 2010 at 12:59 pm
  • The latest CDH3 beta includes security changes that currently HBase 0.90 and trunk don't incorporate. Of course we can help out with clear HBase issues, but for security exceptions or similar, what ...
    Andrew PurtellAndrew Purtell
    Dec 22, 2010 at 2:45 am
    Dec 22, 2010 at 7:15 pm
  • Greetings HBase Homies, I'm running the .89 dev release (though I had this problem in .20.6 as well). Trying to load 10 x 8.5 CSV files from HDFS into an empty HBase table. Getting pretty slow loads ...
    Bradford StephensBradford Stephens
    Dec 21, 2010 at 3:56 am
    Dec 23, 2010 at 5:30 am
  • After 11 hours I give up. I am trying to get a 5 node system up on my ESXi server. OS CentOS 5.5 x64 Hadoop Version 0.20.2+737 HBase Version 0.87.20100924+28 Name Node - Zoo Keeper - HBase Master on ...
    Pete HaidinyakPete Haidinyak
    Dec 21, 2010 at 11:33 pm
    Dec 22, 2010 at 3:13 pm
  • hello, I have written a simple java program to load data and scan table in hbase, but get problems. this is my code snap: HBaseConfiguration config = new HBaseConfiguration(); HTable table = new ...
    Exception qinException qin
    Dec 6, 2010 at 7:55 am
    Dec 8, 2010 at 5:09 am
  • Hi, I have to test hbase as to how long it takes to store 100 Million Records. So i wrote a simple java code which 1 : generates random key and 10 columns per key and random values for the 10 ...
    Dec 1, 2010 at 2:48 pm
    Dec 3, 2010 at 7:37 pm
  • I have a small JAVA system using relational database. Basically, the app have 3 entities: CUSTOMER has many CONTRACTs and each CONTRACT has many INSTALLMENTS Very classic. I am figuring out what is ...
    Valter NogueiraValter Nogueira
    Dec 28, 2010 at 11:27 pm
    Jan 3, 2011 at 1:13 am
  • Hi, I'm using HBase .89 and Hadoop .20.2 I'm trying to create a connection to HBase from a remote Java Client. I am using the following code... final Configuration configuration = ...
    Peter HaidinyakPeter Haidinyak
    Dec 9, 2010 at 7:22 pm
    Dec 10, 2010 at 6:49 am
  • Hi, I set up a small test hbase cluster on ec2. If I want to now store some data in the cluster from outside ec2 using the java client, what should I do? I am very new to hbase and ec2 so any help ...
    Nanheng WuNanheng Wu
    Dec 4, 2010 at 7:29 am
    Dec 6, 2010 at 6:59 am
  • Hi, My cluster was running great till yesterday. Today, I submitted some jobs and I saw that the jobs were taking way too long. On investigation, I saw that the "Child" processes created by previous ...
    Hari SreekumarHari Sreekumar
    Dec 7, 2010 at 12:36 pm
    Nov 17, 2011 at 4:15 pm
  • Hi,i found a problem in my hbase mapreduce case. when first running mapreduce TableMapReduceUtil runs ok. and i use hbase shell to delete some data from the table that mapreduce one . then ran ...
    Dec 1, 2010 at 8:02 am
    Dec 6, 2010 at 11:11 am
  • Are there any hooks in hbase to do data replication? We have to try to move our 12 hour batch jobs down to 3 hours or so and are looking at moving into a noSQL environment, but currently, customers ...
    Hiller, Dean (Contractor)Hiller, Dean (Contractor)
    Dec 21, 2010 at 5:15 pm
    Jan 10, 2011 at 8:25 pm
  • Hi, Is there a way to get the Row Key for the result from a Scanner? I've seen examples where you get the bytes for the row and extract the row key from there but my keys are of random lenght. Thanks ...
    Pete HaidinyakPete Haidinyak
    Dec 28, 2010 at 7:41 am
    Dec 28, 2010 at 6:08 pm
  • Hi, I have a cluster of 8 hdfs datanodes and 8 hbase regionservers. When I shutdown one node(a pc with one datanode and one regionserver running), all hbase regionservers shutdown after a while. ...
    Zhou ShuaifengZhou Shuaifeng
    Dec 20, 2010 at 4:16 am
    Dec 22, 2010 at 5:30 pm
  • We are getting those errors in the logs: 12781689 is mtag2.prod.imageshack.com:60020 2010-12-21 12:07:51,700 ERROR org.apache.zookeeper.ClientCnxn: from ...
    Jack LevinJack Levin
    Dec 21, 2010 at 10:39 pm
    Dec 22, 2010 at 2:33 am
  • We have a 6 node cluster, 5 with region serves. 2 of the region servers have been stable for days, but 3 of them keep crashing. Here are the logs around around when the crash occurs. (btw, we are ...
    Lance RiedelLance Riedel
    Dec 9, 2010 at 7:28 pm
    Dec 21, 2010 at 10:12 pm
  • Strange, suddenly shell cannot use! errors: bin/hbase shell ClassLoader.java:-2:in `defineClass1': java.lang.ClassFormatError: Unknown constant tag 26 in class file ...
    Dec 18, 2010 at 10:12 am
    Dec 21, 2010 at 6:40 am
  • Hi why is it generally said that zk should have a separate disk of it's own? Currently in my small 5 node cluster, one of the regionservers itself is also the zk. How beneficial is it to move it to a ...
    Hari SreekumarHari Sreekumar
    Dec 8, 2010 at 6:08 pm
    Dec 9, 2010 at 5:13 pm
  • Hi, We're currently running into issues with running a MapReduce job over a complete HBase table - we can't seem to find a balance between having dfs.datanode.max.xcievers set too low (and getting ...
    Gabriel ReidGabriel Reid
    Dec 6, 2010 at 8:03 am
    Dec 7, 2010 at 7:49 pm
  • Hi, I am trying to setup HBase on a single Windows Vista machine by following the instructions mentioned here : http://hbase.apache.org/docs/current/cygwin.html#Introduction I see the HBase server ...
    Dec 2, 2010 at 2:15 pm
    Dec 2, 2010 at 7:47 pm
  • Hi, I'm using the HBase Bulk Loader<http://archive.cloudera.com/cdh/3/hbase/bulk-loads.html with 0.89. Very easy to use. I have a few of questions: 1) It seems importtsv will only accept one family ...
    Marc LimotteMarc Limotte
    Dec 23, 2010 at 9:12 pm
    Dec 29, 2010 at 7:52 pm
  • 2010-12-18 18:11:00,333 DEBUG org.apache.hadoop.hbase.regionserver.CompactSplitThread: Compaction requested for region cjjBeeDocument,\x00\x00\x00\ x00\x00\x0F\xF7x,1292667057185/110111081 because: ...
    Dec 19, 2010 at 6:15 am
    Dec 21, 2010 at 7:15 am
  • Hi, I will go straight to the point, we are purchasing hardwares for going live. Currently we are targeting a data capacity of ~5TB with a view to increase capacity as the load increases. I have ...
    Imran M YousufImran M Yousuf
    Dec 17, 2010 at 5:04 am
    Dec 18, 2010 at 5:40 am
  • Hi We are running Hadoop-0.20.2 without append (HDFS-200) on our production environment. Can I run HBase on this cluster? If I can, which version of HBase should I use? Because using HBase is ...
    Yifeng JiangYifeng Jiang
    Dec 10, 2010 at 1:12 am
    Dec 10, 2010 at 5:54 am
  • Is there a good tool out there for serialization to hbase for a java entity? If I have an Account, and then have a List<Activities in the account, I preferably want to serialize that as all strings ...
    Hiller, Dean (Contractor)Hiller, Dean (Contractor)
    Dec 6, 2010 at 9:40 pm
    Dec 7, 2010 at 7:31 pm
  • Hi I am going to have a process running that will add rows to a table. The row id is just a counter of the number of rows inserted. Is there a quick way to programmatically find out the number of ...
    Peter HaidinyakPeter Haidinyak
    Dec 3, 2010 at 12:03 am
    Dec 3, 2010 at 6:42 am
  • Hi, I'm doing a distributed scan of an hbase table using map-reduce by taking all the regions belonging to a regionserver, and then assigning those regions to a mapper (so there's 1 mapper per ...
    Albert ShauAlbert Shau
    Dec 2, 2010 at 10:26 pm
    Dec 3, 2010 at 5:36 am
  • hadoop 0.21.0 has been released with the stable hdfs append feature.. Should we do anything in hbase(modify / apply some patch) to use this hdfs append feature or hbase takes care of this in-built?? ...
    Gokulakannan MGokulakannan M
    Dec 28, 2010 at 8:43 am
    Jan 5, 2011 at 11:31 am
  • I'm doing a map reduce job to create the HFileOutputFormat out of CSVs. * The mapreduce job, operates on 75files, each containing 1Million rows. Total comes up to 16GB. [with replication factor as 2, ...
    Dec 22, 2010 at 7:13 am
    Dec 23, 2010 at 9:30 am
  • Hi In my Java Client can I reuse a Scan object or should I create a new one for every scan? Thanks -Pete
    Peter HaidinyakPeter Haidinyak
    Dec 13, 2010 at 7:30 pm
    Dec 13, 2010 at 11:36 pm
  • Hi What are the differences between using a scan filter and simpli scanning and then filtering using if conditions? Any particular gotchas you need to be careful about while using filters ...
    Hari SreekumarHari Sreekumar
    Dec 5, 2010 at 5:39 pm
    Dec 6, 2010 at 11:54 am
  • I am running some tests to load data from HDFS into HBase in a MR job. I am pretty new to HBase and I have some questions regarding bulk load performance: I have a small cluster with 4 nodes, I set ...
    Nanheng WuNanheng Wu
    Dec 27, 2010 at 9:54 am
    Dec 29, 2010 at 8:49 pm
  • Jeff Hammerbacher stated on Quora [1] that "the Avro gateway is not production quality" and made a reference to the improvements that an upgrade to Avro 1.4 would bring. I would like to understand a ...
    Michael RussoMichael Russo
    Dec 26, 2010 at 3:16 pm
    Dec 29, 2010 at 9:03 am
  • Hi, In my DFS home page, display the message below WARNING : There are about 7179 missing blocks. Please check the log or run fsck. who can tell me what this message and how to fix than? bcoz so far ...
    Dec 24, 2010 at 10:44 pm
    Dec 27, 2010 at 5:15 pm
  • I had a question about using a Scan on part of a composite key. Say I have order line item rows, and the ID is order ID + line item ID. Each ID is a random string. I want to get all line items for an ...
    Bryan KellerBryan Keller
    Dec 14, 2010 at 11:29 pm
    Dec 15, 2010 at 4:54 am
  • Does anyone have suggestions regarding the best way to modify existing entries in a table? We have our tables set up such that when we create an entry we set its timestamp such that the entry has a ...
    Adam PhelpsAdam Phelps
    Dec 13, 2010 at 7:12 pm
    Dec 15, 2010 at 4:52 am
  • I was looking through the thirft API again and noticed that it said if a transaction - comprised of updates to one or more rows - throws an exception then the whole transaction is aborted. Does this ...
    Chris TarnasChris Tarnas
    Dec 10, 2010 at 10:58 pm
    Dec 13, 2010 at 5:06 am
Group Navigation
period‹ prev | Dec 2010 | next ›
Group Overview
groupuser @
categorieshbase, hadoop

114 users for December 2010

Stack: 76 posts Jean-Daniel Cryans: 40 posts Jonathan Gray: 34 posts Peter Haidinyak: 33 posts Hiller, Dean (Contractor): 30 posts Lars George: 29 posts Ryan Rawson: 26 posts 陈加俊: 24 posts Todd Lipcon: 21 posts Ted Dunning: 18 posts Jack Levin: 17 posts Andrew Purtell: 16 posts Hari Sreekumar: 16 posts Rajgopalv: 15 posts King JKing: 14 posts Andrey Stepachev: 13 posts Wayne: 13 posts Mohit: 12 posts Pete Haidinyak: 12 posts Buttler, David: 11 posts
show more