Grokbase › Groups › Lucene › dev › July 2009
FAQ

A Comparison of Open Source Search Engines

Sean Owen
Jul 6, 2009 at 5:33 pm
http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/

I imagine many of you already saw this -- Lucene does pretty well in
this "shootout".
The only area it tended to lag, it seems, is memory usage and speed in
some cases.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org
reply

Search Discussions

7 responses

  • John Wang at Jul 6, 2009 at 8:39 pm ⇧
    Vik did a very nice job.One thing the experiment did not mention is that
    Lucene handles incremental updates, whereas many of the other "competitors"
    do not. So the indexing performance comparison is not really fair.

    -John
    On Mon, Jul 6, 2009 at 8:06 AM, Sean Owen wrote:


    http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/

    I imagine many of you already saw this -- Lucene does pretty well in
    this "shootout".
    The only area it tended to lag, it seems, is memory usage and speed in
    some cases.

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org
  • Earwin Burrfoot at Jul 6, 2009 at 9:02 pm ⇧
    I'd say out of these libraries only Lucene and Sphinx are worth mentioning.

    There's also MG4J, which wasn't covered and has a nice algorithmic background.
    Anybody knows other interesting open-source search engines?

    On Tue, Jul 7, 2009 at 00:39, John Wangwrote:
    Vik did a very nice job.
    One thing the experiment did not mention is that Lucene handles incremental
    updates, whereas many of the other "competitors" do not. So the indexing
    performance comparison is not really fair.
    -John
    On Mon, Jul 6, 2009 at 8:06 AM, Sean Owen wrote:


    http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/

    I imagine many of you already saw this -- Lucene does pretty well in
    this "shootout".
    The only area it tended to lag, it seems, is memory usage and speed in
    some cases.

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org

    --
    Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
    Home / Mobile: +7 (495) 683-567-4 / +7 (903) 5-888-423
    ICQ: 104465785

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org
  • Eks dev at Jul 6, 2009 at 9:11 pm ⇧
    Anybody knows other interesting open-source search engines?
    Minion (https://minion.dev.java.net/)


    ----- Original Message ----
    From: Earwin Burrfoot <earwin@gmail.com>
    To: java-dev@lucene.apache.org
    Sent: Monday, 6 July, 2009 23:01:52
    Subject: Re: A Comparison of Open Source Search Engines

    I'd say out of these libraries only Lucene and Sphinx are worth mentioning.

    There's also MG4J, which wasn't covered and has a nice algorithmic background.
    Anybody knows other interesting open-source search engines?

    On Tue, Jul 7, 2009 at 00:39, John Wangwrote:
    Vik did a very nice job.
    One thing the experiment did not mention is that Lucene handles incremental
    updates, whereas many of the other "competitors" do not. So the indexing
    performance comparison is not really fair.
    -John
    On Mon, Jul 6, 2009 at 8:06 AM, Sean Owen wrote:

    http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/
    I imagine many of you already saw this -- Lucene does pretty well in
    this "shootout".
    The only area it tended to lag, it seems, is memory usage and speed in
    some cases.

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org

    --
    Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
    Home / Mobile: +7 (495) 683-567-4 / +7 (903) 5-888-423
    ICQ: 104465785

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org




    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org
  • John Wang at Jul 7, 2009 at 3:35 am ⇧
    mg4j is a nice project. It is missing the incremental aspects as well.The
    "older" paper this experiment mentioned contains lucene-mg4j comparisons.

    -John
    On Mon, Jul 6, 2009 at 2:01 PM, Earwin Burrfoot wrote:

    I'd say out of these libraries only Lucene and Sphinx are worth mentioning.

    There's also MG4J, which wasn't covered and has a nice algorithmic
    background.
    Anybody knows other interesting open-source search engines?

    On Tue, Jul 7, 2009 at 00:39, John Wangwrote:
    Vik did a very nice job.
    One thing the experiment did not mention is that Lucene handles
    incremental
    updates, whereas many of the other "competitors" do not. So the indexing
    performance comparison is not really fair.
    -John
    On Mon, Jul 6, 2009 at 8:06 AM, Sean Owen wrote:

    http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/
    I imagine many of you already saw this -- Lucene does pretty well in
    this "shootout".
    The only area it tended to lag, it seems, is memory usage and speed in
    some cases.

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org

    --
    Kirill Zakharenko/Кирилл Захаренко (earwin@gmail.com)
    Home / Mobile: +7 (495) 683-567-4 / +7 (903) 5-888-423
    ICQ: 104465785

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org
  • Jorge Handl at Jul 9, 2009 at 12:02 am ⇧

    On Mon, Jul 6, 2009 at 6:01 PM, Earwin Burrfoot wrote:

    Anybody knows other interesting open-source search engines?
    http://hounder.org
  • Uwe Schindler at Jul 9, 2009 at 6:12 am ⇧
    From the website of Hounder:


    How does Hounder compare to Lucene?
    Lucene is a full text search library, intended to be a basic building block
    for applications needing text search functionality. Hounder, while it uses
    Lucene, is a search engine, providing all the required components to gather
    and find information with minimum extra coding, and often, no coding at all.



    So it is like Solr or Nutch a "search server"/"framework" (or whatever)
    around Lucene.



    Uwe



    -----
    Uwe Schindler
    H.-H.-Meier-Allee 63, D-28213 Bremen
    http://www.thetaphi.de
    eMail: uwe@thetaphi.de

    _____

    From: Jorge Handl
    Sent: Thursday, July 09, 2009 2:02 AM
    To: java-dev@lucene.apache.org
    Subject: Re: A Comparison of Open Source Search Engines





    On Mon, Jul 6, 2009 at 6:01 PM, Earwin Burrfoot wrote:

    Anybody knows other interesting open-source search engines?



    http://hounder.org
  • Otis Gospodnetic at Jul 8, 2009 at 9:30 pm ⇧
    Interesting, I never realized there was lucene-java-dev@apache.org .

    My thoughts are on http://www.jroller.com/otis/entry/open_source_search_engine_benchmark (and in several comments in the blog itself).

    Otis


    ----- Original Message ----
    From: Sean Owen <srowen@gmail.com>
    To: lucene-java-dev@apache.org
    Sent: Monday, July 6, 2009 11:06:14 AM
    Subject: A Comparison of Open Source Search Engines

    http://zooie.wordpress.com/2009/07/06/a-comparison-of-open-source-search-engines-and-indexing-twitter/

    I imagine many of you already saw this -- Lucene does pretty well in
    this "shootout".
    The only area it tended to lag, it seems, is memory usage and speed in
    some cases.

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org

    ---------------------------------------------------------------------
    To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: java-dev-help@lucene.apache.org

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
Notice: Undefined variable: pl_domain_short in /home/whirl/sites/grokbase/root/www/public_html__www/cc/flow/tpc.php on line 1543
categorieslucene
postedJul 6, '09 at 5:33p
activeJul 9, '09 at 6:12a
posts8
users7
websitelucene.apache.org

7 users in discussion

John Wang: 2 posts Eks dev: 1 post Sean Owen: 1 post Uwe Schindler: 1 post Jorge Handl: 1 post Otis Gospodnetic: 1 post Earwin Burrfoot: 1 post