Search Discussions

110 discussions - 770 posts

  • Greetings all. My name is Jack and I work for an image hosting company Image Shack, we also have a property thats widely used as a twitter app called yfrog (yfrog.com). Image-Shack gets close to two ...
    Jack LevinJack Levin
    Sep 20, 2010 at 6:01 pm
    Sep 24, 2010 at 12:51 pm
  • Hi folks, Got a problem in basic Hadoop-Hbase communication. My small test program ProteinCounter1.java - shown in full below - reports out this error java.lang.RuntimeException: ...
    Taylor, Ronald CTaylor, Ronald C
    Sep 17, 2010 at 11:20 pm
    Jan 7, 2014 at 2:38 pm
  • Hello all, I am trying to use HBase for a project. The data base will hold billions of rows. I am struggling to understand how filters work. In particular, I want to be able to scan for rows that ...
    Sep 15, 2010 at 1:19 pm
    Sep 19, 2010 at 3:54 pm
  • My regions are 1gb in size and when I cold start the cluster I oversaturate my network links (1000 mbps) and get client dfs timeouts , anyway to slow the m down? -Jack
    Jack LevinJack Levin
    Sep 24, 2010 at 10:08 pm
    Sep 29, 2010 at 3:32 am
  • Hi, I am trying to install a standalone hbase server on Fedora Core 11. I have hadoop running: bash-4.0$ jps 30908 JobTracker 30631 NameNode 30824 SecondaryNameNode 30731 DataNode 30987 TaskTracker ...
    Michael ScottMichael Scott
    Sep 14, 2010 at 5:17 am
    Sep 16, 2010 at 9:25 pm
  • Hey guys, I'm banging my head against some perf issues on EC2. I'm using .20.6 on ASF hadoop .20.2, and tweaked the ec2 hbase scripts to handle the new version. I'm trying to insert about 22G of data ...
    Bradford StephensBradford Stephens
    Sep 1, 2010 at 9:13 am
    Sep 3, 2010 at 8:38 pm
  • Hi folks, I know this question may have been asked many times, but I am wondering if there is any update on the optimized cell size (in megabytes) and row size (in megabytes)? Many thanks. William
    William KangWilliam Kang
    Sep 6, 2010 at 8:57 pm
    Oct 15, 2010 at 9:20 am
  • Hi, I have an indexedtable with index on around 20 columns. The write performance on the original table is around 60 per second. This is just a one node setup. Even with mutiple parallel clients, I ...
    Murali Krishna. PMurali Krishna. P
    Sep 2, 2010 at 5:44 pm
    Sep 6, 2010 at 6:47 pm
  • We're using 0.20.6; we have a non-trivial application using many aspects of hbase; we have a couple of customers in production; we understand this is still pre-release, however we don't want to lose ...
    Mark LaffoonMark Laffoon
    Sep 28, 2010 at 3:00 pm
    Sep 29, 2010 at 10:25 pm
  • Hi All. I get org.apache.hadoop.fs.ChecksumException for a table on heavy write in standalone mode. table tmp.bsn.main created 2010-09-22 10:42:28,860 and then 5 threads writes data to it. At some ...
    Andrey StepachevAndrey Stepachev
    Sep 22, 2010 at 8:38 am
    Sep 22, 2010 at 11:10 am
  • hi, all I use YCSB to measure the insert/read latency of hbase. I found there will be 0 records inserted in up to 10 seconds during the insertion procedure. See the following result at 1514 second. I ...
    Tao XieTao Xie
    Sep 10, 2010 at 2:33 am
    Sep 20, 2010 at 4:25 pm
  • Hi folks. I'd like to run the following data loss scenario by you to see if we are doing something obviously wrong with our setup here. Setup: - Hadoop 0.20.1 - HBase 0.20.3 - 1 Master Node running ...
    George P. StathisGeorge P. Stathis
    Sep 19, 2010 at 1:58 pm
    Sep 23, 2010 at 4:57 pm
  • Is there a way to create a new .META. table if I lost it? For example, I'm getting this exception everywhere: org.apache.hadoop.hbase.TableNotFoundException: .META. (NativeException) The add_table ...
    Matt CorganMatt Corgan
    Sep 21, 2010 at 8:08 pm
    Sep 22, 2010 at 12:44 am
  • Hi all, I'm stuck. I can't insert any valuable peace of data into hbase. Data is something around ~20mil rows (20G). I try to insert them into nondistributed hbase with 4 parallel jobs. MR job run ...
    Andrey StepachevAndrey Stepachev
    Sep 29, 2010 at 11:26 am
    Sep 30, 2010 at 6:02 pm
  • First, I saw: 2010-09-21 11:30:05,122 DEBUG org.apache.hadoop.hbase.master.RegionServerOperationQueue: Put ProcessServerShutdown of,60020,1285042335711 back on queue 2010-09-21 ...
    Jack LevinJack Levin
    Sep 21, 2010 at 10:01 pm
    Sep 22, 2010 at 6:12 pm
  • Hello, We are considering which of HBase or Cassandra to choose for our future projects. I'm recommending HBase to my boss and coworkers, because HBase is good both for analysis (MapReduce) and for ...
    Sep 4, 2010 at 4:32 pm
    Sep 8, 2010 at 10:40 pm
  • Dear All, In my Hadoop 0.20.1/HBase 0.20.3 cluster I’ve got 2 region servers. On each region server, Hadoop DataNode and HBase RegionServer processes are running. Hadoop is set up redundantly (it ...
    Andrey TimerbaevAndrey Timerbaev
    Sep 26, 2010 at 9:22 am
    Sep 29, 2010 at 4:16 pm
  • Strange situation, cold start the cluster, and one of the servers just started getting more and more consuming of RAM, you can see it form the screenshot I am attaching. Here is the log: ...
    Jack LevinJack Levin
    Sep 27, 2010 at 7:30 pm
    Sep 27, 2010 at 10:28 pm
  • Every time we run a map reduce job against data in HBase, we see hundreds of UnknownScannerExceptions in the hbase log at ERROR level. The job seems to complete fine and there are no other errors. ...
    Ken WeinerKen Weiner
    Sep 16, 2010 at 4:30 pm
    Sep 18, 2010 at 12:33 am
  • I cant find any documentation which says you shouldn't write to the same HBase table you're scanning. But it doesnt seem to work... I have a mapper (subclass of TableMapper) which scans a table, and ...
    Curt AllredCurt Allred
    Sep 30, 2010 at 6:12 pm
    Oct 1, 2010 at 12:42 am
  • Hi there, I am very curious about the content of Hbase store file. Try to read it by HDFS java API, but it's hard to understand these data due to alot of invisible codes. Any suggestion? Fleming ...
    Sep 9, 2010 at 1:08 am
    Sep 10, 2010 at 12:48 am
  • hi, all I'm reading the code of RegionManager, I find in the following method there is an situation when nRegionsToAssign <= nregions, the code only assigns 1 region. Is this correct? Hbase version ...
    Tao XieTao Xie
    Sep 7, 2010 at 2:06 am
    Sep 7, 2010 at 7:58 pm
  • Hi All I have used these configuration settings to access hbase server from java client HBaseConfiguration config = new HBaseConfiguration(); config.clear(); config.set("hbase.zookeeper.quorum", ...
    Shuja RehmanShuja Rehman
    Sep 1, 2010 at 10:02 am
    Sep 3, 2010 at 3:21 pm
  • Hi Can someone explain (or refer me to a twiki which explains) which versions of Hbase can be safely rolled back i.e., without any changes to the underlying database and state? Thank you Vidhya
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Sep 16, 2010 at 11:00 pm
    Oct 11, 2010 at 8:58 pm
  • Hi, we are trying to create a hbase table from scratch using map-reduce and HFileOutputFormat. However, we haven't really find examples or tutorials on how to do this, and there is some aspects which ...
    Renaud DelbruRenaud Delbru
    Sep 23, 2010 at 11:17 am
    Sep 24, 2010 at 4:12 pm
  • When HBase cluster shuts down, how is memstore flushing triggered ? Thanks
    Ted YuTed Yu
    Sep 24, 2010 at 11:50 pm
    Sep 25, 2010 at 2:41 pm
  • My HBase cluster just crashed. One of the Region servers stopped (do not yet know why). After restarting it, the cluster seemed a but wobbly, so I decided to shutdown everything, and restart fresh. I ...
    Matthew LeMieuxMatthew LeMieux
    Sep 9, 2010 at 1:01 am
    Sep 9, 2010 at 6:22 pm
  • Hi, I tried to find the info on data migration from 0.20 to 0.89 and so far wasn't successful. I noticed that migrate utility is not in the code base for the 0.89 anymore. is there a way or howto ...
    Dmitriy LyubimovDmitriy Lyubimov
    Sep 30, 2010 at 6:24 pm
    Sep 30, 2010 at 6:34 pm
  • I'm sequentially importing ~1 billion small rows (32 byte keys) into a table called StatAreaModelLink. I realize that sequential insertion isn't efficient by design, but I'm not in a hurry so I let ...
    Matt CorganMatt Corgan
    Sep 27, 2010 at 11:26 pm
    Sep 29, 2010 at 7:23 pm
  • Hi, We have a job that writes many small files (using MultipleOutputFormat) and its exceeding the 4000 xcievers that we have configured. What is the effect on the cluster of increasing this count to ...
    Martin ArnandzeMartin Arnandze
    Sep 23, 2010 at 12:05 pm
    Sep 27, 2010 at 6:44 pm
  • Hi All. I found many hadoop jars floating around (for example http://people.apache.org/~rawson/repo/org/apache/hadoop/hadoop-core/) but can't find distribution and/or source repository used to build ...
    Andrey StepachevAndrey Stepachev
    Sep 22, 2010 at 8:29 am
    Sep 22, 2010 at 5:56 pm
  • Hi, so in our production, we see temporary networking failures (we are not quite 100% sure what they are) but now and then region server's zookeeper session would get expired and in addition some ipc ...
    Dmitriy LyubimovDmitriy Lyubimov
    Sep 22, 2010 at 12:21 am
    Sep 22, 2010 at 12:39 am
  • Hi all, I am not sure why hbase do not have rsync in start-hbase.sh ? In my opinion, this feature is very useful for users, is there any other consideration about this ? -- Best Regards Jeff Zhang
    Jeff ZhangJeff Zhang
    Sep 21, 2010 at 1:25 am
    Sep 21, 2010 at 10:41 pm
  • Now my scenario is running ycsb doing heavy read. I compared the results of setting hfile.block.cache.size to 0.2 with 0. I found with the factor 0 the hbase metric 'get_avg_time' is even smaller. ...
    Tao XieTao Xie
    Sep 19, 2010 at 8:06 am
    Sep 20, 2010 at 1:25 am
  • Hi All, I encounted some problem when doing putting data test on hbase. Please help. Thanks a lot. After putting about millions of rows, the 2 region servers of 3 were stopped. Server 1 stopped when ...
    ZhouShuaifeng 00100568ZhouShuaifeng 00100568
    Sep 14, 2010 at 2:09 am
    Sep 15, 2010 at 1:47 am
  • Hello, I use Netty extensively, and for a long time I wanted to have a fully asynchronous / non-blocking and thread-safe HBase client. So I ended up writing one from scratch, which I just released ...
    Sep 8, 2010 at 9:23 am
    Sep 11, 2010 at 4:02 am
  • Hello folks, We've just installed Hbase 0.89 on a 24-node cluster running Hadoop 0.20.2 here at our government lab. Got a problem. The Hbase interactive shell works fine. I can create a table with a ...
    Taylor, Ronald CTaylor, Ronald C
    Sep 7, 2010 at 10:18 pm
    Sep 8, 2010 at 1:00 am
  • I have been trying to run my scanner jobs and sometimes they fail due to DFS errors in one of the storefiles: I looked at the namenode logs and the file that caused the problem was in the process of ...
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Sep 1, 2010 at 6:59 pm
    Sep 2, 2010 at 6:58 am
  • Right now, most of our boxes have 3 disk in them. We take a small partition on each of those and raid stripe them together to use as the OS partition then allocate the rest of the disks as JBOD for ...
    Daniel EinspanjerDaniel Einspanjer
    Sep 30, 2010 at 11:18 pm
    Sep 30, 2010 at 11:34 pm
  • I'm inserting several million rows of a table that has ~50 columns, 31 of which are days of the month and are often null. For the null ones I issue a delete instead of a put to make sure any previous ...
    Matt CorganMatt Corgan
    Sep 30, 2010 at 7:09 pm
    Sep 30, 2010 at 8:48 pm
  • Apologies if I've missed this information elsewhere but I'm unclear if I can upgrade to Hadoop 0.21 while still running HBase 0.20.6. -- View this message in context: ...
    Pete TylerPete Tyler
    Sep 25, 2010 at 8:35 pm
    Sep 28, 2010 at 3:01 am
  • I've just had another of those region server shutdowns (RegionServerSuicide). * how do I avoid disruption when this sort of thing happens * what is the best procedure for recovering from such a thing ...
    Matthew LeMieuxMatthew LeMieux
    Sep 22, 2010 at 10:42 pm
    Sep 27, 2010 at 6:25 pm
  • Hi All, I am very new to Hadoop and Hbase and here is my first question as I was not able to get definite answer from various sources. Could you help me understand if what I am planning to do is ...
    Sep 19, 2010 at 2:20 am
    Sep 20, 2010 at 6:04 am
  • Hi I am using thrift to get data from remote hbase and using client.get(tableName.getBytes(), rowKey.getBytes(), "ColFamily:colName".getBytes()); method to get the data for particular columns. I am ...
    Shuja RehmanShuja Rehman
    Sep 15, 2010 at 2:57 pm
    Sep 17, 2010 at 9:26 am
  • Here is a log of what I did as a result of which I do not see any tables. TABLE1 is a relatively bigger table for my table sizes, but not by HBase standards. I had loaded 15-20 versions of ~2G files ...
    Sharma, AvaniSharma, Avani
    Sep 13, 2010 at 6:07 pm
    Sep 14, 2010 at 9:46 pm
  • I was trying to bulk increment some files into a HBAse (0.89) table and found this problem.. If a file does not fit into any of the regions in the existing table, then the tool gets into an infinite ...
    Vidhyashankar VenkataramanVidhyashankar Venkataraman
    Sep 10, 2010 at 6:43 pm
    Sep 13, 2010 at 5:01 am
  • After running stargate with no issues for a month or two, I encountered some problems today, and can't quite figure it out. Perhaps someone could give me advice. I start up stargate $ ...
    Mike andersonMike anderson
    Sep 30, 2010 at 5:26 pm
    Sep 30, 2010 at 8:18 pm
  • I am running a little test/poc here. I need to load a few million rows every day into a database. And it's not log file data, I have comma delimited rows (of columns) which would exactly fit a ...
    Sharma, RaghvendraSharma, Raghvendra
    Sep 27, 2010 at 4:28 am
    Sep 27, 2010 at 3:32 pm
  • Hi all - A couple of nights ago I enabled cron jobs to run major compactions against a few of the tables that I use in HBase. This has caused multiple worker machines on the cluster to fail. Based on ...
    Scott WhitecrossScott Whitecross
    Sep 17, 2010 at 4:14 pm
    Sep 23, 2010 at 2:52 pm
  • Hi Guys, Why is this HBase Book 0.89 empty: http://hbase.apache.org/docs/r0.89.20100726/book.html ? Any good books or developer's reference guild? Any info will be highly appreciated! Thanks! Jack.
    Jian LuJian Lu
    Sep 20, 2010 at 11:59 pm
    Sep 21, 2010 at 6:04 pm
Group Navigation
period‹ prev | Sep 2010 | next ›
Group Overview
groupuser @
categorieshbase, hadoop

86 users for September 2010

Ryan Rawson: 81 posts Stack: 76 posts Jean-Daniel Cryans: 55 posts Jack Levin: 41 posts Andrey Stepachev: 39 posts Jinsong Hu: 36 posts Ted Yu: 26 posts Todd Lipcon: 25 posts Andrew Purtell: 22 posts Jonathan Gray: 21 posts Sharma, Avani: 21 posts Matthew LeMieux: 17 posts Taylor, Ronald C: 16 posts Matt Corgan: 15 posts Tao Xie: 15 posts Dmitriy Lyubimov: 14 posts Shuja Rehman: 14 posts Alexey Kovyrin: 11 posts Michael Scott: 11 posts Bradford Stephens: 10 posts
show more