Search Discussions

107 discussions - 508 posts

  • Hi, I'm the lead engineer for search on a large website using lucene for search. We're indexing about 300M documents in ~ 100 indices. The indices add up to ~ 60G. The indices are sorted into 4 ...
    Todd BengeTodd Benge
    Oct 29, 2008 at 10:04 pm
    Nov 5, 2008 at 1:51 am
  • Hi, I am using lucene 2.3.2 and I encounter the following exception when I try to insert a object into the index. Caused by: java.lang.ClassCastException: java.util.Vector cannot be cast to ...
    Paul ChanPaul Chan
    Oct 3, 2008 at 7:40 pm
    Oct 7, 2008 at 5:35 am
  • Hi, We are trying to index large collection of PDF documents, sizes varying from few KB to few GB. Lucene 2.3.2 with jdk 1.6.0_01 (with PDFBox for text extraction) and on Windows as well as CentOS ...
    Sudarsan, Sithu D.Sudarsan, Sithu D.
    Oct 23, 2008 at 4:17 pm
    Nov 14, 2008 at 4:59 pm
  • All, We have seen the following stacktrace in production with Lucene 2.3.2: java.lang.IllegalStateException: abort() can only be called when IndexWriter was opened with autoCommit=false at ...
    Jed Wesley-SmithJed Wesley-Smith
    Oct 28, 2008 at 6:02 am
    Oct 31, 2008 at 3:27 am
  • Hello, I've read a lot of threads now on memory consumption and sorting, and I think I have a pretty good understanding of how things work, but I could still need some input here.. We currently have ...
    Aleksander M. StensbyAleksander M. Stensby
    Oct 10, 2008 at 12:10 pm
    Oct 15, 2008 at 4:56 pm
  • Hi, I asked this question already on "lucene-general" list but also got advised to ask here too. I'm working on a project that has big database in the background (some tables have about 1500000 ...
    Oct 1, 2008 at 7:44 am
    Oct 2, 2008 at 8:15 pm
  • Hi, I want to search for sets of documents. For instance I index some folders with documents in it and now I do not want to find certain documents but folders. Sample: folder A doc 1, contains X, Y ...
    Oct 12, 2008 at 6:12 pm
    Oct 15, 2008 at 6:56 am
  • I have documents containing multiple words in the the field "word" for example, one of the documents contain in the field "word" the following: homeowners work When searching for single words (i.e. ...
    Semelak ssSemelak ss
    Oct 31, 2008 at 12:46 pm
    Nov 2, 2008 at 8:30 pm
  • Hi all, Is there a mailing-list-appropriate way to hire coders with Lucene experience? I don't want to just spam the list because I don't want to crap where I live. I'm a programmer not a recruiter ...
    Richard MarrRichard Marr
    Oct 19, 2008 at 5:37 pm
    Oct 20, 2008 at 3:21 pm
  • Hi, We're using Lucene 2.4.0 on Linux. Java version is 1.6.0_06. Is there any reason why Lucene would be throwing this error: org.apache.lucene.store.AlreadyClosedException: this Directory is closed ...
    Mindaugas ŽakšauskasMindaugas Žakšauskas
    Oct 29, 2008 at 12:43 pm
    Oct 29, 2008 at 7:20 pm
  • Hello all, I need to maintain multiple db and i don't want to sort on datetime as it is taking huge RAM. I want to sort on indexed order. Using Multisearcher or ParallelMultiSearcher will maintain ...
    Oct 21, 2008 at 1:39 pm
    Oct 24, 2008 at 6:31 am
  • I have field for example say "foo" I need to match exactly foo but there is also another field for exampled called "foo1" What I want is a PhraseQuery so I surround foo with quotes before it gets ...
    Oct 21, 2008 at 2:31 am
    Oct 22, 2008 at 3:20 am
  • Hello all, My indexing is growing by 1 million records per day and the memory consumption of the searcher object is quite high. There are different opinion in the groups. Few suggest to use single ...
    Oct 3, 2008 at 9:32 am
    Oct 13, 2008 at 12:37 pm
  • Hi, I want to use lucene for a simple search engine. If I use the code like this, QueryParser parser = new QueryParser(field, analyzer); Query query = parser.parse(line); searcher.search(query) above ...
    Agrawal, Aashish \(IT\)Agrawal, Aashish \(IT\)
    Oct 23, 2008 at 3:49 am
    Oct 27, 2008 at 5:07 pm
  • Hello All, First of all I’m new to Lucene, and have written code using it to search over 1 to man indexes, using a user defined query. I don't have any code on this system so have to type everything ...
    Oct 24, 2008 at 7:51 pm
    Oct 27, 2008 at 3:01 pm
  • Hi everybody, I need to query for documents not only for search terms but also for numeric values (or other general types). Let me try to explain with a hypothetical example. Assuming there is a ...
    Niels OttNiels Ott
    Oct 23, 2008 at 12:34 pm
    Oct 25, 2008 at 2:05 pm
  • Hi All, i am a beginner to Lucene. and i am trying to use Lucene 2.4. when i have set lucene-core-2.4.0.jar & lucene-demos-2.4.0.jar in my CLASSPATH. and trying to run: java ...
    Prabina pattanayakPrabina pattanayak
    Oct 15, 2008 at 5:14 am
    Oct 20, 2008 at 2:23 pm
  • Hi, Has anyone created a link map over lucene results or know of a link describing the process? If not, I would like to build one to contribute. Also, I read about term frequencies in the book, but ...
    Darren GovoniDarren Govoni
    Oct 16, 2008 at 5:45 pm
    Oct 17, 2008 at 1:37 am
  • Oh, and in case it matters, I'm using Lucene 2.2.0. Ed ----- Original Message ---- I am stumped and have not seen any other reference to this problem. I am getting the following exception on ...
    Edwin SmithEdwin Smith
    Oct 6, 2008 at 6:34 pm
    Oct 7, 2008 at 3:51 pm
  • Hi Everyone, I have an index which I am opening at one time only. I keep adding the documents to it until I reach a limit of 500. After this, I close the index and open it again. (This is done in ...
    Aditi GoyalAditi Goyal
    Oct 3, 2008 at 8:27 am
    Oct 6, 2008 at 3:07 pm
  • Hi, Maybe I have missunderstood the general concept of how search results should be scored in regards to the fieldNorm, but the way i see it it causes an irritating effect of the sort order for me. ...
    Jimi HullegårdJimi Hullegård
    Oct 2, 2008 at 11:39 am
    Oct 3, 2008 at 12:17 am
  • Hi all, Has anyone used the payload functionality in Lucene? I would really appreciate if someone can provide an explain using a code or something. Thanks, Anshul
    Anshul jainAnshul jain
    Oct 23, 2008 at 1:08 pm
    Oct 31, 2008 at 9:49 pm
  • Hi all, Many people ask me when the next version of Luke becomes available. It's almost ready, and the release should happen in about a week, depending on the situation in my daily job. I'd like to ...
    Andrzej BialeckiAndrzej Bialecki
    Oct 30, 2008 at 11:08 am
    Oct 30, 2008 at 4:23 pm
  • Hello, I know I can store multiple values under same field and I can later retrieve all those values. But the problem I have is a bit structure related. When I'm reading those fields (that usually ...
    Oct 24, 2008 at 3:37 pm
    Oct 27, 2008 at 8:01 pm
  • I've a problem witch searching. I need to search not only in file contents, but also in metadata. But I don't know how to do it. My code: Document doc = new Document(); doc.add(new Field("contents", ...
    Oct 20, 2008 at 2:32 pm
    Oct 20, 2008 at 11:33 pm
  • Hello, I am using the reopen method in the IndexReader class. In the case of the IndexReader being updated, I would like to create a new IndexSearcher and close the old IndexReader. When closing an ...
    Khawaja ShamsKhawaja Shams
    Oct 15, 2008 at 2:36 am
    Oct 15, 2008 at 5:48 pm
  • I have indexed multiple documents - each of them have 3 fields ( id, tag , text). Is there an easy way to determine the set of tags for a given query without iterating through all the hits? For ...
    Akanksha BaidAkanksha Baid
    Oct 14, 2008 at 7:27 am
    Oct 15, 2008 at 5:06 am
  • Hi! I'm currently developing a mediabase for 20-100 customers. A Customer can upload a file, folder via ftp and a file grabber searches the file system and adds the new file to a mysql database. It ...
    Mathias P.W NilssonMathias P.W Nilsson
    Oct 2, 2008 at 9:24 pm
    Oct 6, 2008 at 8:36 am
  • Hi, I have an old index that was built a few months ago. The data that I used to build the index has been deleted from the database. I'd like to read all the data from the old index to build a new ...
    Dragon FlyDragon Fly
    Oct 30, 2008 at 7:25 pm
    Nov 3, 2008 at 12:52 pm
  • hi folks, i have great trouble while using lucene to implement search functionality to my application: this way i index: [code] public void indexData() throws CorruptIndexException, ...
    Oct 28, 2008 at 8:36 pm
    Oct 29, 2008 at 12:29 pm
  • Guys, I'm adding multiple fields with the same name to a document as Store.YES, Indexed.TOKENIZED and it seems that only the last field entered is indexed. I read about this somewhere her but now I ...
    John GriffinJohn Griffin
    Oct 7, 2008 at 5:31 pm
    Oct 10, 2008 at 12:48 pm
  • Hi, Is there any Spanish analyzer available for lucene applications? I did not see any in lucene 2.4.0 contribute folders. Thanks very much for helps, Lisheng ...
    Zhang, LishengZhang, Lisheng
    Oct 23, 2008 at 10:15 pm
    Oct 31, 2008 at 3:38 pm
  • Hi All, I have been wanting to do a wildcard search with * as a first letter on an index. Is there a way out except for setAllowLeadingWildcard() of QueryParser to true? Because, i have heard it is ...
    Aditi GoyalAditi Goyal
    Oct 29, 2008 at 11:16 am
    Oct 30, 2008 at 9:24 am
  • Hi, Do you know if a plugin or a third party software allow to read Lucene index using sql statements ? Regards, Blured. Discover the new Windows Vista ...
    Blured bluredBlured blured
    Oct 27, 2008 at 8:55 am
    Oct 27, 2008 at 12:45 pm
  • Hi, I want to index a document that has a field called 'tags' that looks like that : 'foo, foo bar' The comma is the separator for each tag, so I have a tag with the value 'foo' and another one with ...
    Borja MartínBorja Martín
    Oct 24, 2008 at 10:59 am
    Oct 24, 2008 at 12:23 pm
  • Hi, I am a newbie. I just configured lucene using hibernate search. But I find that the sorting doesn't ignore null values. I am searching using one field, say X and want to sort the results using ...
    Reetha HariharanReetha Hariharan
    Oct 14, 2008 at 8:35 am
    Oct 22, 2008 at 11:02 pm
  • Hi, I have requirement of updating search index and it results in creation of lots of index files as well as size is also getting increased. I create index writer with autocommit true and create ...
    Cool The BreezerCool The Breezer
    Oct 20, 2008 at 6:20 am
    Oct 20, 2008 at 10:27 am
  • OK, after googling around for a while, I found this: http://wooga.drbacchus.com/lucene-and-documentation (alas, I agree) and then eventually I realized that the download web-page directory has a link ...
    Oct 1, 2008 at 7:14 pm
    Oct 16, 2008 at 3:48 pm
  • Dear all, Could one of you point me to an example of code for querying without using the deprecated class Hits ? Thank you, David
    David MassartDavid Massart
    Oct 14, 2008 at 6:45 am
    Oct 15, 2008 at 9:48 am
  • Hi, We are trying to modify the positional encoding of a term occurrence for experimentation purposes. One solution we adopt is to use payloads to sotre our own positional information encoding, but ...
    Renaud DelbruRenaud Delbru
    Oct 13, 2008 at 1:55 pm
    Oct 15, 2008 at 9:34 am
  • Guys, I have documents with multiple stored, tokenized fields of the same name but different values in them such as: "codesearch", "B01" "codesearch", "B0105" "codesearch", "Q01" Etc; I receive a new ...
    John GriffinJohn Griffin
    Oct 7, 2008 at 2:40 am
    Oct 7, 2008 at 6:25 pm
  • Hi, I want to make a wizard that can help to find n-grams terms. For example: If i want to search History, after write it the system propose you the following searches: history europe history spain ...
    Albert JuheAlbert Juhe
    Oct 9, 2008 at 2:33 pm
    Oct 31, 2008 at 1:08 pm
  • Hello, We are currently using lucene v2.1 and we are planning to upgrade to lucene v2.4. Can we change the merge factor for an existing index and then add more documents to that index? Is there some ...
    Tom SaulpaughTom Saulpaugh
    Oct 27, 2008 at 5:09 pm
    Oct 29, 2008 at 12:20 pm
  • public class AnalyzerTest { @Test public void test() throws ParseException { QueryParser parser = new MultiFieldQueryParser(new String[]{"title", "body"}, new StandardAnalyzer()); Query query1 = ...
    James liuJames liu
    Oct 23, 2008 at 12:30 pm
    Oct 24, 2008 at 1:00 am
  • Hello, We have implemented a research module for lucene using BM25 and our structured version of BM25 as ranking functions and a couple of state-of-art query expansion algoritms. This implementation ...
    José Ramón Pérez AgüeraJosé Ramón Pérez Agüera
    Oct 21, 2008 at 2:15 pm
    Oct 23, 2008 at 8:56 am
  • I'm working on indexing JSON documents via Lucene and I've run into a bit of a snag. Currently, I'm indexing JSON documents by adding fields that are path/value pairs. For example, given a JSON ...
    Paul DavisPaul Davis
    Oct 14, 2008 at 9:27 pm
    Oct 22, 2008 at 2:25 am
  • Hello all, I am planning to merge two or more indexes. Once merged, will the DB maintain the same index order as before merge? I am doing sorting on Index Order as sorting on date-time takes more ...
    Oct 20, 2008 at 10:10 am
    Oct 20, 2008 at 2:14 pm
  • Hi, I have a large index of documents of fields "id" "name" and few other. while querying i do want to exclude a list of ids i passed in. for this what i use is Query query = new BooleanQuery(); for ...
    Prabin meiteiPrabin meitei
    Oct 16, 2008 at 6:45 pm
    Oct 17, 2008 at 6:32 am
  • hi dears i have a question of Lucene i have on index with 1,000 document with id field(String:UUID) and one indexSearcher for search on it, after that, i start one IndexWriter that writes 1,000,000 ...
    Mahdi yariMahdi yari
    Oct 16, 2008 at 10:13 am
    Oct 17, 2008 at 4:57 am
  • I didn't quite understand the Document documentation so well, the documentation says: "Adds a field to a document. Several fields may be added with the same name. In this case, if the fields are ...
    Rafael AlmeidaRafael Almeida
    Oct 15, 2008 at 5:42 pm
    Oct 15, 2008 at 7:23 pm
Group Navigation
period‹ prev | Oct 2008 | next ›
Group Overview
groupjava-user @

128 users for October 2008

Michael McCandless: 49 posts Erick Erickson: 39 posts Ganesh: 24 posts Chris Hostetter: 18 posts Grant Ingersoll: 16 posts Anshum: 14 posts Mark Harwood: 14 posts Mark Miller: 10 posts Paul Chan: 10 posts Glen Newton: 9 posts Darren Govoni: 8 posts Jed Wesley-Smith: 8 posts Mahdi yari: 8 posts Aleksander M. Stensby: 7 posts Karsten F.: 7 posts Samd: 7 posts Agatone: 6 posts Agrawal, Aashish \(IT\): 6 posts Andrzej Bialecki: 6 posts Edwin Smith: 6 posts
show more