Grokbase Groups HBase user April 2016

Search Discussions

69 discussions - 267 posts

  • Hi, In our large HBase cluster based on CDH 5.5 in AWS, we're constantly seeing the following messages in the region server logs: 2016-04-25 14:02:55,178 INFO ...
    Saad MuftiSaad Mufti
    Apr 25, 2016 at 7:18 pm
    May 10, 2016 at 6:24 pm
  • Hi all, I'm trying to connect my local java client (pentaho) to a remote Hbase but every time I get a TimeOut error telleing me that this connection couldn't be established. herer is the full message ...
    SOUFIANI Mustapha | السفياني مصطفىSOUFIANI Mustapha | السفياني مصطفى
    Apr 21, 2016 at 5:43 pm
    Apr 25, 2016 at 8:32 am
  • Hi, We have a large HBase 1.x cluster in AWS and have disabled automatic major compaction as advised. We were running our own code for compaction daily around midnight which calls ...
    Saad MuftiSaad Mufti
    Apr 19, 2016 at 7:56 pm
    Apr 29, 2016 at 11:40 pm
  • Hi folks, I have a table with TTL enabled. It's been receiving data for a while beyond the TTL and I now have a number of empty regions. I'd like to drop those empty regions to free up heap space on ...
    Nick DimidukNick Dimiduk
    Apr 1, 2016 at 4:56 am
    Apr 26, 2016 at 4:17 pm
  • Hi all, I have a small question regarding the MapReduce jobs behaviour with HBase. I have a HBase test table with only 8 rows. I splitted the table with the hbase shell split command into 2 splits ...
    Ivan Cores gonzalezIvan Cores gonzalez
    Apr 11, 2016 at 12:49 pm
    Apr 21, 2016 at 2:32 pm
  • Hi, I have a project that needs to store large number of image and video files, the file size varies from 10MB to 10GB, the initial number of files will be 0.1 billion and would grow over 1 billion, ...
    Ascot MossAscot Moss
    Apr 17, 2016 at 1:21 am
    Apr 17, 2016 at 12:48 pm
  • Hi , i got this issue in HBase while at peak time handling more requests . can any one pls guide me to resolve the Long GC pauses in hbase . JDK-7 , JVM heap 512m HBase 0.98.13 INFO [JvmPauseMonitor] ...
    Karthi keyanKarthi keyan
    Apr 14, 2016 at 6:01 am
    Apr 22, 2016 at 3:52 pm
  • Dear expert, I have encountered a problem,when I run hbase cmd :status it shows: hbase(main):001:0 status 2016-04-16 13:03:02,333 ERROR [main] client.ConnectionManager$HConnectionImplementation: The ...
    Eric GaoEric Gao
    Apr 16, 2016 at 2:53 pm
    Apr 21, 2016 at 1:31 pm
  • Hi, Guys I just have a question, I am trying to save the data into table in HBase I am using Table table = getConnection().getTable(TableName.valueOf(tableName)); ... ... Table.close My question is ...
    Yi JiangYi Jiang
    Apr 9, 2016 at 2:18 pm
    Apr 11, 2016 at 1:51 pm
  • Hi, Are there major overheads to running major compaction frequently? As much as I know, it produces one Hfile for a region and processes delete markers and version related drops. So, if this process ...
    Sumit NigamSumit Nigam
    Apr 4, 2016 at 3:36 pm
    Apr 5, 2016 at 4:49 pm
  • ​Hi, experts, I'm trying to figure out how fast hbase can scan. I'm setting up the RegionScan in a endpoint coprocessor so that no network overhead will be included. My average key length is 35 and ...
    Hongbin maHongbin ma
    Apr 21, 2016 at 10:04 am
    May 19, 2016 at 10:00 am
  • We sell data. A product can be defined as a permission to access data (at a cell level). Visibility Labels look like a very good candidate for implementing this model. The implementation works well ...
    Benedict WhittamsmithBenedict Whittamsmith
    Apr 13, 2016 at 3:17 pm
    Apr 27, 2016 at 3:16 pm
  • in hbase, I find there is a "drain regionServer" feature if a rs is added to drain regionServer in ZK, then regions will not be move to on these regionServers but, how can a rs be add to drain ...
    Apr 26, 2016 at 3:12 am
    Apr 26, 2016 at 2:21 pm
  • Hi, Is there any way to run hbase shell script from Java. Also mentioned this question earlier in below url earlier. As we are having bunch of scripts and need to change frequently for performance ...
    Saurabh Malviya (samalviy)Saurabh Malviya (samalviy)
    Apr 24, 2016 at 5:18 am
    Apr 26, 2016 at 12:49 am
  • Hi, I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep receiving dependency isues, and I am not sure if any of these connectors are available for Spark 1.3 / Hadoop 2.6 / Hbase 1.0 ...
    Nkechi AcharaNkechi Achara
    Apr 22, 2016 at 7:24 pm
    Apr 23, 2016 at 5:47 am
  • Hello, after several network outages in AWS (never ever run HBase there!), my HBase was seriously damaged. After doing some steps like restarting namenodes, hdfs fsck, restarting all regionservers ...
    Michal MedveckyMichal Medvecky
    Apr 20, 2016 at 3:29 am
    Apr 20, 2016 at 9:33 pm
  • After trying to get help with distcp on hadoop-user and cdh-user mailing lists, I've given up on trying to use distcp and exporttable to migrate my hbase from .92.1 cdh4.1.3 to .98 on cdh5.3.0 I've ...
    Colin Kincaid WilliamsColin Kincaid Williams
    Apr 12, 2016 at 10:26 pm
    Apr 13, 2016 at 6:47 pm
  • Hi, I found this blog post from 2014 on sources of HBase client side latency which I found useful ...
    Saad MuftiSaad Mufti
    Apr 19, 2016 at 9:07 pm
    Apr 20, 2016 at 3:26 pm
  • Hi there, I have a HFile that I copied from HDFS down to my laptop. I am trying to use the HFile.createreader to read in that HFile and play with it. However, it was really hard to figure that out ...
    Bin WangBin Wang
    Apr 15, 2016 at 3:03 am
    Apr 16, 2016 at 11:02 pm
  • i have cloudera cluster, i am exploring spark with HBase, after going through this blog ...
    Yeshwanth kumarYeshwanth kumar
    Apr 5, 2016 at 7:12 pm
    Apr 11, 2016 at 2:54 am
  • Hi, in our Hadoop 2.6.0 cluster, we need to pass some properties to all Hadoop processes so they can be referenced using ${...} syntax in configuration files. This works reasonably well using ...
    Henning BlohmHenning Blohm
    Apr 18, 2016 at 9:57 am
    May 9, 2016 at 6:33 am
  • *1、How can i get hbase table memory used?* *2、Why hdfs size of hbase table double when i use bulkload* bulkload file to qimei_info 101.7 G /user/hbase/data/default/qimei_info bulkload same file to ...
    Jone ZhangJone Zhang
    Apr 29, 2016 at 4:16 am
    May 3, 2016 at 2:36 am
  • Hi, Using OpenTSDB 2.2 with its "appends" feature, I see significant impact on read performance when writes are happening. If a process injects a few hundred thousand points in batch, the call queues ...
    Kevin BowlingKevin Bowling
    Apr 16, 2016 at 11:23 pm
    Apr 25, 2016 at 1:08 pm
  • Adding subject. Adding back [email protected] But the master wouldn't know what next action admin is going to perform, right ?
    Ted YuTed Yu
    Apr 20, 2016 at 1:07 pm
    Apr 20, 2016 at 2:36 pm
  • Hi, I'm running HBase 1.2.0 on FreeBSD via the ports system (, and it is generally working well. However, in an HA setup, the HBase master spins at 200% ...
    Kevin BowlingKevin Bowling
    Apr 11, 2016 at 8:11 am
    Apr 12, 2016 at 9:23 am
  • hi, guys: i upgrade our cluster recently, after upgrade, i found some wired problems: in Master.log, there some a lots of logs like below: 2016-04-07 11:57:00,597 DEBUG [region-location-0] ...
    Heng ChenHeng Chen
    Apr 7, 2016 at 7:50 am
    Apr 8, 2016 at 4:12 am
  • I am stuck on connecting to hbase 1.0.3 via simple java client. The program hangs at: [main] zookeeper.ZooKeeper: Initiating client connection, connectString= sessionTimeout=90000 ...
    Sachin MittalSachin Mittal
    Apr 3, 2016 at 5:07 pm
    Apr 6, 2016 at 4:24 am
  • i have created the cluster with 3 region server and i used YCSB to test the performance of the cluster. Created the table as mentioned in ...
    prabhu Mahendranprabhu Mahendran
    Apr 29, 2016 at 5:03 am
    Apr 29, 2016 at 9:04 am
  • Hi I have my hbase:meta table entries as : SYSTEM.CATALOG,,1461831992343.a6daf63bd column=info:regioninfo, timestamp=1461831993549, value={ENCODED = a6daf63bde1f1456ca4acee228b8f5fe, NAME = 'SYSTEM ...
    Manisha SethiManisha Sethi
    Apr 28, 2016 at 2:44 pm
    Apr 28, 2016 at 8:14 pm
  • Hi, Does anyone have experience with HBase write performance under auto-split conditions? Out keyspace is randomized so all regions roughly start auto-splitting around the same time, although early ...
    Saad MuftiSaad Mufti
    Apr 27, 2016 at 3:27 pm
    Apr 27, 2016 at 7:38 pm
  • Hi James, I spoke to my manager and he is fine with the idea of giving the talk. Now, he is gonna ask higher management for final approval. I am assuming there is still a slot for my talk in use case ...
    Anil GuptaAnil Gupta
    Apr 27, 2016 at 5:07 am
    Apr 27, 2016 at 3:43 pm
  • Hi, Is there any document about what's new in HBase v1.x vs 9.98.x? Regards
    Ascot MossAscot Moss
    Apr 17, 2016 at 1:36 am
    Apr 20, 2016 at 6:11 pm
  • my hbase replication has stopped I am on hbase version 1.0.0-cdh5.4.8 (Cloudera build) I have 2 clusters in 2 different datacenters 1 is master the other is slave I see the following errors in log ...
    Abraham TomAbraham Tom
    Apr 14, 2016 at 1:21 pm
    Apr 19, 2016 at 10:33 pm
  • Hello, I'm in the process of transferring data between Hbase .92 and Hbase .98 . I'd like to write some test comparing my databases to ensure I have not lost content in the transformation process ...
    Colin Kincaid WilliamsColin Kincaid Williams
    Apr 15, 2016 at 9:19 pm
    Apr 18, 2016 at 8:15 pm
  • I would like to insert some data from Spark and or Spark streaming into Hbase, on v .98. I found this section of the book which shows examples of using the apis ...
    Colin Kincaid WilliamsColin Kincaid Williams
    Apr 18, 2016 at 7:45 pm
    Apr 18, 2016 at 7:57 pm
  • Hi, all recently we upgrade our HBase cluster from cdh-0.94 to cdh-1.0. In 0.94 we use Writable) as the map out value. [image: pasted1] but int the newer HBase version ...
    Apr 12, 2016 at 12:29 am
    Apr 12, 2016 at 2:47 am
  • Please take a look at: especially the section titled: Determine the Optimal Number of Pre-Split Regions For writing data evenly across the cluster, ...
    Ted YuTed Yu
    Apr 6, 2016 at 9:57 pm
    Apr 11, 2016 at 1:01 pm
  • Hello, I am trying to understand hbase's memory configuration. I am using hbase version 1.0 through cloudera (version 5.5.2). I need to benchmark query performance (through phoenix 4.6) on hbase with ...
    Amit ShahAmit Shah
    Apr 6, 2016 at 9:54 am
    Apr 6, 2016 at 12:26 pm
  • Hi I have a requirement to scan a hbase table based on insertion timestamp. I need to fetch the keys sorted by insertion timestamp not by key . I can't made timestamp as prefix of key to avoid hot ...
    Shushant AroraShushant Arora
    Apr 5, 2016 at 3:27 am
    Apr 5, 2016 at 4:25 am
  • Hi, I have been informed that compacting (manual) the same hbase table takes same amount of time even when done in quick succession. This seems counter-intuitive because an already compacted table ...
    Sumit NigamSumit Nigam
    Apr 3, 2016 at 11:32 am
    Apr 4, 2016 at 5:10 am
  • Hi, this is my first maven build, thought this should just work :-) after calling: MAVEN_OPTS="-Xmx2g" mvn site install assembly:assembly -DskipTests -Dhadoop-two.version=2.7.2 -Dsnappy I get ...
    Apr 1, 2016 at 7:40 am
    Apr 1, 2016 at 9:56 am
  • Hello, I'd like to write a similar coprocessor to the example RegionObserverExample at : that is, a scan coprocessor which intercepts and ...
    James JohansvilleJames Johansville
    Apr 27, 2016 at 10:36 pm
    Apr 29, 2016 at 5:45 am
  • Hi all, I'm getting a strange error during table creation / disable in HBase 1.1.2: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AlreadyBeingCreatedException): failed to ...
    Apr 25, 2016 at 7:56 pm
    Apr 25, 2016 at 8:01 pm
  • It is well worth the read. It goes deep so is a bit long and I had to cut it up to do Apache Blog sized bits. Start reading here: St.Ack
    Michael StackMichael Stack
    Apr 23, 2016 at 12:25 am
    Apr 25, 2016 at 10:21 am
  • Hi Guys, I need your kind help. Region servers in my cluster crashed several times in a week. I have been tracking this problem for a long time, but do not root the cause. From the region server log, ...
    Apr 22, 2016 at 3:48 pm
    Apr 22, 2016 at 4:50 pm
  • Hello- We just upgraded to HBase 1.2. After the upgrade I see Data Locality is precisely zero for all regions of all regions servers. See screenshot here: This seems unlikely ...
    Ted TuttleTed Tuttle
    Apr 20, 2016 at 2:30 pm
    Apr 20, 2016 at 5:24 pm
  • Hi everyone, I recently joined a project that uses hbase to store large amount of granular material simulation data (e.g. thousands of particles's position and velocity over time). What I need to do ...
    Davide SpataroDavide Spataro
    Apr 12, 2016 at 10:15 am
    Apr 12, 2016 at 3:25 pm
  • Hello - We've started experiencing regular failures of our HBase cluster. For the last week we've had nightly failures about 1hr after a heavy batch process starts. In the logs below we see the ...
    Ted TuttleTed Tuttle
    Apr 12, 2016 at 12:09 am
    Apr 12, 2016 at 2:03 am
  • Hi, I'm wondering which service on HBase service family is responsible for setting timestamp of data when saving it to HBase? Recently I found one of my server (has region server and some HDFS ...
    Zheng ShenZheng Shen
    Apr 11, 2016 at 11:47 am
    Apr 11, 2016 at 4:22 pm
  • Hi, when running as spark shell to connect hive table (hbase integrated) {{{ spark-shell --jars ...
    Ram kumarRam kumar
    Apr 8, 2016 at 9:37 am
    Apr 8, 2016 at 2:47 pm
Group Navigation
period‹ prev | Apr 2016 | next ›
Group Overview
groupuser @
categorieshbase, hadoop

83 users for April 2016

Ted Yu: 47 posts Saad Mufti: 20 posts Michael Stack: 13 posts Colin Kincaid Williams: 10 posts Sachin Mittal: 8 posts SOUFIANI Mustapha | السفياني مصطفى: 8 posts Vladimir Rodionov: 8 posts Ascot Moss: 7 posts Kevin Bowling: 6 posts Ivan Cores gonzalez: 5 posts Sumit Nigam: 5 posts WangYQ: 5 posts Bryan Beaudreault: 4 posts Frank Luo: 4 posts Heng Chen: 4 posts Nick Dimiduk: 4 posts Thakrar, Jayesh: 4 posts Yi Jiang: 4 posts Benedict Whittamsmith: 3 posts Bin Wang: 3 posts
show more