FAQ
Hi,

I know that a new encoding technique, PFOR, is being implemented in the
Lucene project [1]. Have you heard about the "Group Varint" encoding
technique from Google ? There is a technical explanation in the talk of
Jeffrey Dean, "Challenges in Building Large-Scale Information Retrieval
Systems" (44:02). From the talk, this technique seems quite fast in
decoding: 400M numbers/second against 180M numbers/second for normal
Vint encoding; and it seems easy to implement.
It will be maybe interesting to benchmark it against PFOR.

[1] http://issues.apache.org/jira/browse/LUCENE-1410
[2] http://videolectures.net/wsdm09_dean_cblirs/
--
Renaud Delbru

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Search Discussions

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupjava-user @
categorieslucene
postedMay 5, '09 at 1:33p
activeMay 5, '09 at 1:33p
posts1
users1
websitelucene.apache.org

1 user in discussion

Renaud Delbru: 1 post

People

Translate

site design / logo © 2022 Grokbase