dev@hbase.apache.org discussions for July 2014

13	Fwd: how to do parallel scanning in map reduce using hbase as input?

anyone could help? now I have about 1.1 billion nodes and it takes 2 hours to finish a map reduce job. ---------- Forwarded message ---------- From: Li Li <<span class="m_body_email_addr" ...

Li Li
Jul 22, 2014 at 2:30 am
Jul 25, 2014 at 2:58 am

7	Re: Themis : implements cross-row/corss-table transaction on HBase.

Excellent. Nice work lads! St.Ack

Michael Stack
Jul 13, 2014 at 5:12 am
Nov 12, 2014 at 3:26 am

7	build a hbase client only packge

Hi, folk Is there a HBase mvn build target to build a package for a HBase standalone client, including the hbase-client, hbase-common, and dependencies that are required by a working client? Thanks ...

Jerry He
Jul 15, 2014 at 11:42 pm
Jul 19, 2014 at 3:17 am

7	hadoopQA links to findbugs warning broken

hi, folks, I encountered this problem a couple times already. Basically, hadoopQA cames back with complain about "-1 findbugs. ..", then I tried to following the links in the hadoopQA report to diag, ...

Demai Ni
Jul 2, 2014 at 8:16 pm
Jul 4, 2014 at 3:38 am

6	Incorrect docs in 0.98.3 and 0.98.4

Hi all, Is not a big deal but while doing some internal housekeeping I noticed that in 0.98.3 and and 0.98.4 don't have the latest docs that have been included in previous releases. In previous 0.98 ...

Esteban Gutierrez
Jul 29, 2014 at 8:09 pm
Aug 6, 2014 at 6:29 pm

6	How to validate HBase configuration (for region servers) from HBase admin page?

Hi all, We have set up an HBase cluster with 10 region nodes. We modified the default configurations to handle bucket cache in the hbase-site.xml (for all region servers) as follows: <property <name ...

Gabriela montiel
Jul 28, 2014 at 6:29 pm
Jul 28, 2014 at 10:46 pm

6	Strange log messages during scan operations

I do some performance testing of parallel scanners over the same store file I insert data, than major compact it , make sure that I have only one region with only one store file. Than I run tests ...

Vladimir Rodionov
Jul 15, 2014 at 5:58 pm
Jul 15, 2014 at 7:19 pm

5	hbase project compilation

Hello, I have clone the hbase git repository using command provided in the hbase home page. git clone https://git-wip-us.apache.org/repos/asf/hbase.git While I compile this project using 'mvn clean ...

Abhishek1015
Jul 31, 2014 at 3:18 am
Jul 31, 2014 at 6:42 pm

5	Hadoop-Azure storage

FYI. It looks like the Microsoft folks want to make Azue the definitive cloud on which to run HBase. -n https://issues.apache.org/jira/browse/HADOOP-10809

Nick Dimiduk
Jul 11, 2014 at 4:23 pm
Jul 11, 2014 at 11:58 pm

5	Jenkins Build Slaves

All Yahoo is in the process of retiring all the hadoop jenkins build slaves, *hadoop[1-9]* and replace them with a newer set of beefier hosts. These new machines are configured with *ubuntu-14.04* ...

Giridharan Kesavan
Jul 7, 2014 at 11:13 pm
Jul 10, 2014 at 6:47 pm

4	Thinking about rolling 0.98.5RC0 on August 4

I'm thinking about rolling 0.98.5RC0 on August 4 to return to having 0.98 releases happen in the beginning of a month as was typical up until 0.98.4. There have been 10 issues resolved for 0.98.5 ...

Andrew Purtell
Jul 22, 2014 at 4:00 pm
Jul 31, 2014 at 8:38 pm

4	meaning for AgeOfLastAppliedOp in Replication MetricsSink

hi, A quick question to clarify this AgeOfLastAppliedOp in MetricsSink.java. I assume it is used as an indicator about how long for a Sink OP to be applied; but instead, it is more like to show how ...

Demai Ni
Jul 29, 2014 at 10:49 pm
Jul 30, 2014 at 5:55 pm

4	hadoopqa -p0 patches

Hi, It seems for some time, the hadoopqa script cannot apply the patches generated for -p0. I've emailed Giri about it, who recently moved the jenkins builds nodes in builds.apache.org. We believe ...

Enis Söztutar
Jul 18, 2014 at 12:39 am
Jul 21, 2014 at 3:37 am

4	Re: [VOTE] The 1st HBase 0.98.4 release candidate (RC0) is available, vote closing 7/21/2014

See thread on dev@ titled "Comparing the performance of 0.98.4 RC0 and 0.98.0 using YCSB - 23% perf regression in workload E" -1 on this RC for now, pending reproduction and further analysis on a dev ...

Andrew Purtell
Jul 18, 2014 at 12:13 am
Jul 19, 2014 at 7:08 am

4	Comparing the performance of 0.98.4 RC0 and 0.98.0 using YCSB - 23% perf regression in workload E

Comparing the relative performance of 0.98.4 RC0 and 0.98.0 on Hadoop 2.2.0 using YCSB. This will be the last report of these from me for a while, as I will be losing my current access to EC2 ...

Andrew Purtell
Jul 18, 2014 at 12:09 am
Jul 18, 2014 at 3:23 am

4	Deprecated HTableDescriptor apis for HBase 0.98

Hi All,I have been using Hbase 0.94 with HTableDescriptor apis. Now we are moving to HBase 0.98.These apis have been deprecated in Hbase 0.96+ versions. Any recommendation for HTableDescriptor ...

Vikas Ranjan
Jul 1, 2014 at 2:36 pm
Jul 1, 2014 at 3:00 pm

3	About "dfs.client-write-packet-size" setting

The default dfs.client-write-packet-size value is 64k, at least it's in my Hadoop2 env. I did a benchmark about i via ycsb loading 2 million records(3*200 bytes): 1) dfs.client-write-packet-size=64k ...

谢良
Jul 29, 2014 at 3:04 am
Jul 29, 2014 at 7:22 pm

3	Cutting the 0.98.4 RC 0 at the end of today PST

We are overdue. All blockers have been resolved. Time to pull the trigger. Please flush any pending commits you'd like to see go in. -- Best regards, - Andy Problems worthy of attack prove their ...

Andrew Purtell
Jul 14, 2014 at 7:15 pm
Jul 14, 2014 at 11:58 pm

2	hbase 2.0.0-SNAPSHOT compatibility with hadoop 1.2.1?

Hello, I successfully compiled hbase 2.0.0-SNAPSHOT with maven 3.0.5. After configuring the cluster, when i start the cluster using 'hbase shell' command, all services except HMaster starts. I see ...

Abhishek1015
Jul 31, 2014 at 6:42 pm
Aug 1, 2014 at 5:21 pm

2	Re: adding a profile to build thrift generated classes

+1 on the idea. Currently, there is a profile for generating protobuf files (http://hbase.apache.org/book/build.html), but I couldn't find any analog for thrift. So, this can come handy when needed.

Srikanth Srungarapu
Jul 31, 2014 at 6:13 am
Aug 1, 2014 at 1:31 am

2	HColumnDescriptor.setMaxFileSize not working as expected?

Hi, I just did a quick test and faced this situation. hbase(main):017:0 create 'crc', 'c', { MAX_FILESIZE = '21474836480' } hbase(main):018:0 describe 'crc' DESCRIPTION 'crc', {TABLE_ATTRIBUTES = ...

Jean-Marc Spaggiari
Jul 29, 2014 at 9:55 pm
Jul 29, 2014 at 10:19 pm

2	Encrypting the Kepstore password in hbase configuration file.

Hi, To Configure encryption for Hfile and WAL file the following configuration is used. <property <name hbase.crypto.keyprovider.parameters</name <value ...

Nijel s f
Jul 25, 2014 at 8:20 am
Jul 26, 2014 at 1:04 am

2	HFileLink backreferences

Heya, I see that we maintain backreferences for hfilelinks. This appears to be used by HFileLinkCleaner to determine when an HFile has no HFileLinks and thus whether it can be deleted without ...

Nick Dimiduk
Jul 23, 2014 at 6:57 pm
Jul 23, 2014 at 10:03 pm

2	Planning to roll the 0.98.4 RC on Tuesday 7/8

Looks like we are going to take this week to look into intermittent unit test suite issues and tie the bow on the big item for this release, visibility expression support on delete mutations. I am ...

Andrew Purtell
Jul 1, 2014 at 7:34 pm
Jul 1, 2014 at 10:16 pm

1	[jira] [Created] (HBASE-11612) Remove MetaMigrationConvertingToPB

Virag Kothari created HBASE-11612: ------------------------------------- Summary: Remove MetaMigrationConvertingToPB Key: HBASE-11612 URL: https://issues.apache.org/jira/browse/HBASE-11612 Project ...

Virag Kothari (JIRA)
Jul 30, 2014 at 12:16 am
Jul 30, 2014 at 12:24 am

1	Re: How to build hbase package

Yes, it does (I would prefer uncompressed directory structure with the same content, but tar file is fine too). Thanks!

Dmitry Sivachenko
Jul 23, 2014 at 2:24 pm
Jul 23, 2014 at 6:54 pm

1	How to build hbase package

Hello! What is the correct procedure for producing a complete hbase package? Something similar to what "mvn package" gives for hadoop: I get hadoop-dist/target/hadoop-2.4.1/ directory which contains ...

Dmitry Sivachenko
Jul 22, 2014 at 4:57 pm
Jul 22, 2014 at 6:24 pm

1	HBase With Playing Cards

I created a 7 minute video <https://www.youtube.com/watch?v=9CREwiemvT0 that shows how HBase works with playing cards. You can use this method to quickly show someone how HBase works or send it to ...

Jesse Anderson
Jul 21, 2014 at 4:32 pm
Jul 21, 2014 at 8:36 pm

1	Please add Project Trafodion to HBase supporting projects

Hi, I'd like to add Project Trafodion to the list of projects that use HBase at this link: http://wiki.apache.org/hadoop/SupportingProjects Trafodion is an HP-sponsored Apache-licensed open source ...

Pasha, Rayees
Jul 21, 2014 at 6:22 pm
Jul 21, 2014 at 6:53 pm

1	[jira] [Created] (HBASE-11548) [PE] Add 'cycling' test N times and unit tests for size/zipf/valueSize calculations

stack created HBASE-11548: ----------------------------- Summary: [PE] Add 'cycling' test N times and unit tests for size/zipf/valueSize calculations Key: HBASE-11548 URL ...

stack (JIRA)
Jul 19, 2014 at 6:56 am
Jul 19, 2014 at 6:58 am

1	Re: Comparing the performance of 0.98.4 RC0 and 0.98.0 using YCSB - 23% perf regression in workload E

Workload E tests on a new testbed instance with careful attention to configuration do not produce the same results. We have instead: *Workload E* - 0.98.4RC0 [OVERALL] RunTime(ms)1270229 ...

Andrew Purtell
Jul 18, 2014 at 9:08 pm
Jul 18, 2014 at 9:12 pm

1	Re: Project to help the HBase community

It will be really nice if we could have bugs and feature requests with "low hanging fruit" tags in Jira so that beginners could start off with with them.

Nitish Upreti
Jul 18, 2014 at 8:45 pm
Jul 18, 2014 at 8:50 pm

1	TestCacheConfig fails in frequent pre-commit builds

Hi TestCacheConfig fails in frequent pre-commit builds that I have noticed from the last one/two week(s). I could not get the reports of the older ones, one such incident is this ...

Ramkrishna vasudevan
Jul 18, 2014 at 4:38 am
Jul 18, 2014 at 4:43 am

1	Re: Question about HFile indices

We used to hold the entire HFile index in memory, although you could trade off between the size of the index and amount of IO required to find the desired records. Facebook found the aggregate size ...

Andrew Purtell
Jul 14, 2014 at 8:37 pm
Jul 14, 2014 at 8:41 pm

1	Re: HBase Failover

-dev (bcc) +user Hello Jinal, Can you pastebin the logs from both HBase masters? When this failover occurs, was the HBase master process killed or all services in that node killed? When the HBase ...

Esteban Gutierrez
Jul 14, 2014 at 5:10 am
Jul 14, 2014 at 6:00 pm

1	[jira] [Created] (HBASE-11498) Add documentation around using RPC configs

Jesse Yates created HBASE-11498: ----------------------------------- Summary: Add documentation around using RPC configs Key: HBASE-11498 URL: https://issues.apache.org/jira/browse/HBASE-11498 ...

Jesse Yates (JIRA)
Jul 10, 2014 at 7:43 pm
Jul 10, 2014 at 7:49 pm

1	Re: Themis : implements cross-row/corss-table transaction on HBase.

Jianwei: You may want to update the comment for ThemisScan : //a wrapper class of Put in HBase which not expose timestamp to user public class ThemisScan extends ThemisRead { Is there plan to support ...

Ted Yu
Jul 8, 2014 at 4:10 pm
Jul 9, 2014 at 1:41 pm

1	Java Client API

Hello I set up HBase 0.94.20 in stand-alone mode on my openSuSE, everything's fine with that. Now I am trying to reach it from a java program (running in eclipse) My code crashes at line HTable table ...

Darkchanter
Jul 4, 2014 at 8:49 pm
Jul 4, 2014 at 9:19 pm

1	Trunk may be broke

But I have to leave. Will fix later this evening. FYI. St.Ack

Michael Stack
Jul 3, 2014 at 2:07 am
Jul 3, 2014 at 6:08 am

1	[jira] [Reopened] (HBASE-11432) [AccessController] Remove cell first strategy

[ https://issues.apache.org/jira/browse/HBASE-11432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell reopened HBASE-11432: ------------------------------------ ...

Andrew Purtell (JIRA)
Jul 1, 2014 at 10:25 pm
Jul 1, 2014 at 10:27 pm

0	[jira] [Resolved] (HBASE-11623) mutateRowsWithLocks might require updatesLock.readLock with waitTime=0

[ https://issues.apache.org/jira/browse/HBASE-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-11623. ----------------------------------- ...

Lars Hofhansl (JIRA)
Jul 31, 2014 at 11:57 pm
Jul 31, 2014 at 11:57 pm

0	[jira] [Created] (HBASE-11638) Set default hbase.master.wait.on.regionservers.mintostart to 1

Andrew Purtell created HBASE-11638: -------------------------------------- Summary: Set default hbase.master.wait.on.regionservers.mintostart to 1 Key: HBASE-11638 URL ...

Andrew Purtell (JIRA)
Jul 31, 2014 at 11:24 pm
Jul 31, 2014 at 11:24 pm

0	[jira] [Resolved] (HBASE-11633) [0.94] port HBASE-11217 Race between SplitLogManager task creation + TimeoutMonitor

[ https://issues.apache.org/jira/browse/HBASE-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Hofhansl resolved HBASE-11633. ----------------------------------- ...

Lars Hofhansl (JIRA)
Jul 31, 2014 at 11:04 pm
Jul 31, 2014 at 11:04 pm

0	[jira] [Resolved] (HBASE-11636) [0.89-fb] Bring back test annotations.

[ https://issues.apache.org/jira/browse/HBASE-11636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-11636. ----------------------------------- ...

Elliott Clark (JIRA)
Jul 31, 2014 at 10:15 pm
Jul 31, 2014 at 10:15 pm

0	[jira] [Resolved] (HBASE-11454) [0.89-fb] HBCK shouldn't check meta and root region info against meta

[ https://issues.apache.org/jira/browse/HBASE-11454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-11454. ----------------------------------- ...

Elliott Clark (JIRA)
Jul 31, 2014 at 10:15 pm
Jul 31, 2014 at 10:15 pm

0	[jira] [Resolved] (HBASE-11416) [0.89-fb] Add size aware ThiftHRegionServer

[ https://issues.apache.org/jira/browse/HBASE-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-11416. ----------------------------------- ...

Elliott Clark (JIRA)
Jul 31, 2014 at 10:13 pm
Jul 31, 2014 at 10:13 pm

0	[jira] [Created] (HBASE-11637) Update bin/start-hbase.sh/cmd to do the right thing

Nick Dimiduk created HBASE-11637: ------------------------------------ Summary: Update bin/start-hbase.sh/cmd to do the right thing Key: HBASE-11637 URL ...

Nick Dimiduk (JIRA)
Jul 31, 2014 at 10:05 pm
Jul 31, 2014 at 10:05 pm

0	[jira] [Created] (HBASE-11636) [0.89-fb] Bring back test annotations.

Elliott Clark created HBASE-11636: ------------------------------------- Summary: [0.89-fb] Bring back test annotations. Key: HBASE-11636 URL: https://issues.apache.org/jira/browse/HBASE-11636 ...

Elliott Clark (JIRA)
Jul 31, 2014 at 9:47 pm
Jul 31, 2014 at 9:47 pm

0	[jira] [Reopened] (HBASE-11614) Table create should failed when user provides MAX_FILESIZE lower to minimum

[ https://issues.apache.org/jira/browse/HBASE-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell reopened HBASE-11614: ------------------------------------ ...

Andrew Purtell (JIRA)
Jul 31, 2014 at 8:08 pm
Jul 31, 2014 at 8:08 pm

0	[jira] [Resolved] (HBASE-11624) TestScannerResource hangs in trunk

[ https://issues.apache.org/jira/browse/HBASE-11624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Purtell resolved HBASE-11624. ------------------------------------ ...

Andrew Purtell (JIRA)
Jul 31, 2014 at 7:56 pm
Jul 31, 2014 at 7:56 pm

group	dev @
categories	hbase, hadoop
discussions	477
posts	654
users	45
website	hbase.apache.org

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

HBase > dev > July 2014

Search Discussions

477 discussions - 654 posts

45 users for July 2014

Content

People

Support

Translate