FAQ

HBase > user > January 2011

Search Discussions

173 discussions - 1,000 posts

  • We have very frequent cluster wide pauses that stop all reads and writes for seconds. We are constantly loading data to this cluster of 10 nodes. These pauses can happen as frequently as every minute ...
    WayneWayne
    Jan 11, 2011 at 10:34 pm
    Jan 27, 2011 at 2:54 pm
  • Hi, I am using hbase 0.20.6. Is it possible for the loadtable.rb script to create the table from compressed output? I have a MR job where the reducer outputs Gzip compressed HFiles. When I ran ...
    Nanheng WuNanheng Wu
    Jan 28, 2011 at 4:54 am
    Jan 31, 2011 at 4:45 pm
  • Does HTable.put(List<Put puts) method perform a batch insert with a single RPC call? I am going to insert a lot of values into a column family and would like to increase the write speed. Thank you.
    Weishung ChungWeishung Chung
    Jan 10, 2011 at 4:59 pm
    Feb 1, 2011 at 8:03 am
  • In our HBase test for YCSB benchmark, we want to create table and drop table with script automatically. But I fount that in our script. /bin/Hbase shell; disable 'usertable'; drop 'usertable'. ...
    祝海通祝海通
    Jan 3, 2011 at 9:57 am
    Jan 12, 2011 at 4:50 am
  • Hi Guys, is there a maven repository containing 0.89 SNAPSHOT? I have tried tons of repositories, but to no avail. I also tried building the hbase-0.89.20100924 locally using maven, but then I get a ...
    Peter VeentjerPeter Veentjer
    Jan 3, 2011 at 1:33 pm
    Feb 1, 2011 at 7:52 pm
  • I am using 0.90.0 (8 RS + 1Master) and the HDFS is CDH3b3 During the first hours of running, I puts many (tens of millions entites, each about 200 bytes), it worked well. But then, the client cannot ...
    Schubert ZhangSchubert Zhang
    Jan 26, 2011 at 3:59 pm
    Feb 24, 2011 at 6:05 pm
  • Hello I have problem with running HBase performance tests from org.apache.hadoop.hbase.PerformanceEvaluation package. I'm using version from CDH3, Tests are ok when argument nclients is 1, but in ...
    Wojciech LangiewiczWojciech Langiewicz
    Jan 21, 2011 at 4:13 pm
    Jan 28, 2011 at 1:13 am
  • Is there a way to issue a delete using the server's current timestamp? I see methods using HConstants.LATEST_TIMESTAMP which is extremely expensive since it triggers a Get call. There are also ...
    Matt CorganMatt Corgan
    Jan 21, 2011 at 8:31 pm
    Jan 24, 2011 at 5:29 pm
  • Hello all, I have a scanner question, we have this table: hbase(main):002:0 scan 'mattest' ROW COLUMN+CELL 1 column=generic:, timestamp=1294454057618, value=1 1 column=photo:, ...
    Jack LevinJack Levin
    Jan 8, 2011 at 4:01 am
    Jan 10, 2011 at 10:47 pm
  • We have got .90 up and running well, but again after 24 hours of loading a node went down. Under it all I assume it is a GC issue, but the GC logging rolls every < 60 minutes so I can never see logs ...
    WayneWayne
    Jan 27, 2011 at 2:49 pm
    Jan 28, 2011 at 12:53 am
  • Hi - I am using 0.89 for bulk loading. In my reducer: ImmutableBytesWritable ibw = new ImmutableBytesWritable(key.copyBytes()); KeyValue kv = new KeyValue(key.copyBytes(), ...
    Geoff HendreyGeoff Hendrey
    Jan 17, 2011 at 5:31 pm
    Jan 26, 2011 at 5:06 am
  • After doing many tests (10k serialized scans) we see that on average opening the scanner takes 2/3 of the read time if the read is fresh (scannerOpenWithStop=~35ms, scannerGetList=~10ms). The second ...
    WayneWayne
    Jan 31, 2011 at 9:38 pm
    Mar 30, 2011 at 10:32 am
  • We tried to upgrade to .90 and got 2x the nodes listed and saw none of our old regions showing up in the counts. We assumed the upgrade was not "easy" so we just re-formated the HDFS thinking it ...
    WayneWayne
    Jan 24, 2011 at 8:18 pm
    Jan 25, 2011 at 12:45 am
  • Hi I am not sure whether this was observed before but I have been running into issues with a hung master. This is on a 700 node cluster with Hbase 0.90.0 and Hadoop 0.20.x. Every now and then, the ...
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Jan 28, 2011 at 7:56 am
    Jan 31, 2011 at 7:08 pm
  • Hello, Region servers are dying printing the following exception, under heavy write load. Let me know, if you need any more details. Your help is greatly appreciated. Environment: HBase (0.20.6) ...
    Charan kumarCharan kumar
    Jan 12, 2011 at 8:18 pm
    Jan 26, 2011 at 2:20 am
  • Hi, I am new to hbase and to hadoop as well so forgive me if the following is naive. I am trying to bulk upload large amounts of data (billions of rows with 15-20 columns) into an empty hbase table ...
    Ashish ShindeAshish Shinde
    Jan 19, 2011 at 4:46 am
    Jan 26, 2011 at 1:37 am
  • Hi Consider the following scenario. Row Key Format = DATETIME_VAR1_VAR2 (where var1 and var2 have fixed lengths) and example data could be 20100809041500_abc_xyz 20100809041500_abc_xyw ...
    Shuja RehmanShuja Rehman
    Jan 20, 2011 at 8:22 am
    Jan 23, 2011 at 7:17 pm
  • What is the good way to randomize the primary key which is a timestamp in HBase to avoid hotspotting? Thank you so much :)
    Weishung ChungWeishung Chung
    Jan 10, 2011 at 3:34 pm
    Jan 11, 2011 at 12:19 am
  • final Scan scan = new Scan(); scan.setCaching(scannerCaching); scan.addColumn(family); table.getScanner(scan); For improving the speed of scan . How to adjust the parameters ? Is there any more ...
    陈加俊陈加俊
    Jan 25, 2011 at 10:36 am
    Jan 29, 2011 at 8:23 am
  • I need to delete some tables and I am not sure the best way to do it. The shell does not work. The disable command says it runs ok but every time I run drop or truncate I get an exception that says ...
    WayneWayne
    Jan 21, 2011 at 2:02 am
    Jan 21, 2011 at 8:04 pm
  • Does it seem reasonable that I could get Stargate 20.6 to work with Hbase 20.2? I need some of the improvements made in 20.6, but would rather not have to upgrade my entire cluster if I don't have ...
    Mike andersonMike anderson
    Jan 20, 2011 at 5:57 pm
    Jan 20, 2011 at 10:47 pm
  • I'm trying to use GZIP compression but running into a logging problem. It appears that every time a block is compressed it logs the following: 2011-01-10 12:40:48,407 INFO ...
    Matt CorganMatt Corgan
    Jan 10, 2011 at 5:46 pm
    Jan 19, 2011 at 4:47 am
  • Hi, Running a throughput test with various sample sizes but getting "KeyValue size too large" for 10MB files. Could not remember any setting related to cell max size. Thanks + Srini Sadasivam ...
    Sadasivam, SrinivasanSadasivam, Srinivasan
    Jan 14, 2011 at 6:37 pm
    Jan 18, 2011 at 6:04 am
  • Is load_table.rb deprecated in 0.90? I was trying to use load_table.rb to create a new table and bulk load files into it. It worked partly in the sense that the META table got populated, the files ...
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Jan 13, 2011 at 12:42 am
    Jan 13, 2011 at 7:11 pm
  • Is zookeeper responsible for the backup/replication of -ROOT- and .META. files? It looks like I need multiple HBase masters setup to achieve high availability. In the multiple masters setup, would ...
    Weishung ChungWeishung Chung
    Jan 28, 2011 at 4:11 pm
    Jan 28, 2011 at 11:30 pm
  • Hi, I have been importing data to hbase 0.90.0 using the code from the bulk uploader (ImportTsv.java). The table has LZO compression set, however unless major compaction is run the table it does not ...
    Ashish ShindeAshish Shinde
    Jan 24, 2011 at 5:39 am
    Jan 27, 2011 at 1:10 pm
  • Hello, I just upgraded to hbase 0.90.0. I have configured 30 region servers. After initial restart Master page shows 38 region servers, and some of them are duplicate ofcourse. Problem is HBase ...
    Charan kumarCharan kumar
    Jan 22, 2011 at 1:45 am
    Jan 26, 2011 at 11:56 pm
  • Dear All, We are using the hbase 0.20.4 on a project, and met the following errors while insert/update some data to the table today: org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying ...
    Stanley XuStanley Xu
    Jan 12, 2011 at 11:13 am
    Jan 13, 2011 at 2:27 am
  • Hi everyone! How to rename the table's family name. I created the table and it's families , and insert many data into it, but I want to rename one family name now premise is not lost data .
    陈加俊陈加俊
    Jan 7, 2011 at 12:30 pm
    Jan 10, 2011 at 11:59 pm
  • After heavily loading a 10 node cluster for 3-4 days I got a concurrent mode failure of 53 seconds followed by a NodeIsDeadException which caused the node to be shut down. Is there is a timeout that ...
    WayneWayne
    Jan 3, 2011 at 1:13 pm
    Jan 3, 2011 at 10:44 pm
  • Hi, Currently I am calling table.getScanner each time to reset the cursor to initial row. My code is something like this: while (1) { /* * I need a cursor to first row each time. * Also, I tried ...
    Dani RayanDani Rayan
    Jan 25, 2011 at 3:27 am
    Jan 28, 2011 at 2:45 am
  • One programme scan from regions[0].startKey and stop at regions[0].endKey ,and another programme scan from scan from regions[1].startKey and stop at regions[1].endKey. Every programme get the row by ...
    陈加俊陈加俊
    Jan 25, 2011 at 11:51 am
    Jan 27, 2011 at 7:09 am
  • Hi, I found this construct on the blog here, http://allaboutdata.net/blog/?p=38, and I have no idea what it means. But the documentation supports this and says getMap public ...
    Mark KerznerMark Kerzner
    Jan 27, 2011 at 5:10 am
    Jan 27, 2011 at 6:18 am
  • What is the recommended max node size in terms of data (using lzo compression), region counts, and region sizes? I know there is no hard limit and it should depend on the required load in terms of ...
    WayneWayne
    Jan 12, 2011 at 4:27 pm
    Jan 15, 2011 at 2:16 pm
  • Hi, I am new to HBase and Hadoop and I am trying to find the best way to bulk load a table from HDFS to HBase. I don't mind creating a new table for each batch and what I understand using ...
    Nanheng WuNanheng Wu
    Jan 5, 2011 at 11:55 pm
    Jan 7, 2011 at 6:17 pm
  • I am still struggling with the JVM. We just had a hard OOM crash of a region server after only running for 36 hours. Any help would be greatly appreciated. Do we need to restart nodes every 24 hours ...
    WayneWayne
    Jan 5, 2011 at 4:10 pm
    Jan 5, 2011 at 11:16 pm
  • Hi, What do people think about running HBase / HDFS off of EBS on EC2? That is, having HBase/HDFS keep the data on EBS. I was surprised not to find a lot of discussion around that: ...
    Otis GospodneticOtis Gospodnetic
    Jan 4, 2011 at 5:43 pm
    Jan 5, 2011 at 4:32 pm
  • Hi Guys, I'm currently writing a POC based on hbase and I spend more time on writing a ui than on writing the hbase functionality. So I'm very excited about exploring HBase further and doing some ...
    Peter VeentjerPeter Veentjer
    Jan 5, 2011 at 1:42 pm
    Jan 5, 2011 at 4:23 pm
  • Are there any good tutorials on cluster setup on AWS I'd prefer not to use third-party scripts/frameworks, just a simple sequence of steps/one-liner commands, using the original hadoop/hbase tarballs
    HH
    Jan 3, 2011 at 2:26 pm
    Jan 5, 2011 at 10:55 am
  • Hi everyone, In my company we are experimenting with HBase and I'd like to know the best way to persist a semi-structured complex (3 levels) entity represented as JSON to HBase. I've already done ...
    Pablo MolnarPablo Molnar
    Jan 31, 2011 at 7:31 pm
    Feb 3, 2011 at 8:48 am
  • Apologies for my dumbness. I know it's some property that I am not setting correctly. But every time I stop & start HBase & Hadoop I either lose all my tables or loose rows on tables in HBase. Here's ...
    Something SomethingSomething Something
    Jan 29, 2011 at 1:37 am
    Feb 2, 2011 at 7:58 pm
  • Hi, HBase users, I followed the instruction from hbase.apache.org, I could not launch "start-hbase.sh" from cygwin shell. I gave the descriptions for each step in detail below. Any help is welcome. ...
    Jim XJim X
    Jan 26, 2011 at 4:04 am
    Jan 27, 2011 at 5:13 am
  • Hi folks - is there a recommended way of estimating HBase HDFS usage for a new environment? We have a DEV HBase cluster in place, and from this, I'm trying to estimate the specs of our not-yet-built ...
    Norbert BurgerNorbert Burger
    Jan 24, 2011 at 5:37 pm
    Jan 26, 2011 at 5:00 pm
  • We are migrating from hbase 0.89.20100621+17 (20.4?) to 20.6 and have encountered some type of compatibility problem. To test the migration, we deployed 20.6 on a small cluster and copied a table ...
    Robert GonzalezRobert Gonzalez
    Jan 21, 2011 at 9:30 pm
    Jan 21, 2011 at 9:47 pm
  • Thanks in advance for any help. I've been quite pleased with Hbase for this current project and until this problem it has worked quite well. Test cluster setup is CDH3b3 on a 7 nodes: 5 data nodes ...
    Chris TarnasChris Tarnas
    Jan 8, 2011 at 7:07 am
    Jan 12, 2011 at 11:47 pm
  • He Guys, although it isn't completely related to HBase. Is there support for scheduling map reduce jobs? E.g. I want to do a map reduce job that automatically removes certain elements from hbase and ...
    Peter VeentjerPeter Veentjer
    Jan 5, 2011 at 5:35 pm
    Jan 6, 2011 at 5:38 pm
  • Getting exception after upgrading to 0.90. (from hbase-0.89.20100924) . Did I miss corresponding HDFS upgrade if any? What currently I have DFS version: 0.20.2, r911707 Thanks. 2011-01-21 ...
    Sadasivam, SrinivasanSadasivam, Srinivasan
    Jan 21, 2011 at 12:29 am
    Aug 2, 2011 at 9:12 am
  • I'm wondering what the best way is to store my data in HBase. I'm currently converting everything to a string and then to a bytes array. What are others doing? Plain text to to byte arrays and ...
    EricEric
    Jan 26, 2011 at 9:47 am
    Feb 11, 2011 at 9:13 pm
  • How is the .oldlogs folder cleaned up? My cluster size kept going up and I looked closely and realized that 91% of the space was going to .oldlogs that do not appear to be archived. This adds up to ...
    WayneWayne
    Jan 28, 2011 at 5:41 pm
    Feb 3, 2011 at 9:53 pm
  • Hi folks, I am seeing some unexpected behavior with HBase 0.20.6 when deleting columns. Our cluster has been running for some time however we recently upgraded from Hbase 0.20.3. The family I am ...
    Mike PercyMike Percy
    Jan 29, 2011 at 1:45 am
    Feb 2, 2011 at 2:42 am
Jan 2011
1234
Group Navigation
period‹ prev | Jan 2011 | next ›
Group Overview
groupuser @
categorieshbase, hadoop
discussions173
posts1,000
users133
websitehbase.apache.org

133 users for January 2011

Stack: 158 posts Wayne: 52 posts Jean-Daniel Cryans: 51 posts Ryan Rawson: 47 posts Weishung Chung: 35 posts Friso van Vollenhoven: 34 posts Ted Dunning: 27 posts Todd Lipcon: 22 posts Lars George: 21 posts Peter Haidinyak: 21 posts Charan kumar: 18 posts Ted Yu: 18 posts Bill Graham: 17 posts Andrey Stepachev: 16 posts Jonathan Gray: 15 posts Mark Kerzner: 15 posts 陈加俊: 15 posts Matt Corgan: 14 posts Nanheng Wu: 14 posts Tatsuya Kawano: 14 posts
show more
Archives