java-user@lucene.apache.org discussions for May 2014

55	NewBie To Lucene \|\| Perfect configuration on a 64 bit server

Hi, We are using Lucene 4.7 on our server application for searching the documents placed on a nasshare. We have 10 million+ documents and have decided not to index all the documents. The strategy ...

Shruthi
May 19, 2014 at 10:41 am
Jun 20, 2014 at 6:45 pm

20	[lucene 4.6] NPE when calling IndexReader#openIfChanged

I am facing the following stacktrace: java.lang.NullPointerException: null at java.io.File.<init (File.java:305) ~[na:1.6.0_26] at ...

Clemens Wyss DEV
May 13, 2014 at 8:27 pm
Jun 16, 2014 at 2:52 pm

13	Never close IndexWriter/Reader?

Hi, We use lucene 4.6, our application receives continuously new documents. Mostly emails. We need the update near real time, so we open the IndexReader with Directory.open and IndexWriter ...

Sascha Janz
May 3, 2014 at 5:25 pm
May 19, 2014 at 5:37 am

10	How to locate a Phrase inside text (like a Browser text searcher)

Hi, someone can help me with it?? I need do a search to locate a phrase inside text, but, I need locate this phrase on texts like that: 'John Mail' <- phrase I want locate ' Good Morning John Mail ...

Teko
May 11, 2014 at 9:36 pm
May 16, 2014 at 10:39 pm

9	How to add machine learning to Apache lucene

Hello All How can I add Maching Learning Part in Apache Lucene . Thanks Priyanka

Priyanka Tufchi
May 7, 2014 at 8:06 pm
May 27, 2014 at 5:33 am

8	Lucene Upgrade from 2.9.x to 4.7.x

Hello, I'm looking for some documents/information on upgrade from Lucene 2.9.x to 4.7.2. This is the first time I'm doing a upgrade. Can someone point me to some help in this? Is there a ...

Buddhavarapu, Suresh
May 29, 2014 at 1:57 pm
Jun 17, 2014 at 6:59 am

8	search time & number of segments

Hello everyone, We have a performance issue ever since we stopped optimizing the index. We are using Lucene 4.8 (jvm 32bits for searching, 64bits for indexing) on Windows 2008R2. Now we are letting ...

De Simone, Alessandro
May 16, 2014 at 10:18 pm
May 21, 2014 at 11:35 am

8	writer.updateDocument() not working (possible bug?)

Greetings I am using Lucene NRT search. After calling writer.updateDocument(term, doc) and then search(), the document is no longer visible in the search results. The program must be restarted to see ...

Jamie
May 13, 2014 at 1:23 pm
May 19, 2014 at 11:31 am

6	fadvise/madvise during segment-merges....

Is it a good idea to use FADVISE_DONTNEED/MADVISE_DONTNEED flags during segment merge reads? Buffer-Cache contains critical data belonging to searches. A segment-merge has the potential to disturb ...

Ravikumar Govindarajan
May 21, 2014 at 8:10 am
May 27, 2014 at 11:14 am

5	Issue with Lucene 3.6.1 and MMapDirectory

Hi, I am encountering the following issue with Lucene 3.6.1 if you could let me know if I am doing something wrong / there is a mistake I am making it would be great. In order to improve the ...

Liviu Matei
May 14, 2014 at 12:54 pm
May 19, 2014 at 9:29 am

5	Re: best choice for ramBufferSizeMB

Generally larger is better, as long as JVM's heap is big enough to allow IW to use that RAM. Large flushed segments means less merging later ... Mike McCandless http://blog.mikemccandless.com On Wed, ...

Michael McCandless
May 14, 2014 at 3:01 pm
May 18, 2014 at 3:25 pm

5	Lucene: Index Writer to write in multiple file instead make one heavy file

HI I am using lucene 3.0.1. I am writing many documents with lucene Indexwriter. But Indexwriter add all documents into file which becomes more than 4GB in my case. so can i distribute files or ...

Yogesh patel
May 13, 2014 at 6:27 am
May 15, 2014 at 3:47 am

4	IndexWriter.addIndexes() multithread correct?

Hi, I was wondering if it's correct to call the method: IndexWriter.addIndexes(...) from different threads concurrently. nicola. --------------------------------------------------------------------- ...

Nicola Buso
May 22, 2014 at 3:13 pm
May 22, 2014 at 4:42 pm

4	Multi-thread indexing, should the commit be called from each thread?

Hi! I have a question about multi-thread indexing. When I perform a Multi-thread indexing, should I commit from each thread that I add documents or the commit should be done only when all the threads ...

Andi rexha
May 21, 2014 at 11:59 am
May 22, 2014 at 8:36 am

3	remapping docIds in a read only offline built index

In a 1-segment (parallel) read-only index, that is built offline once (and then frozen), is it possible to remap the docIds as the last step (i.e... to have the exact same index, except that the ...

Olivier Binda
May 12, 2014 at 4:28 pm
Jun 2, 2014 at 7:37 am

3	ConcurrentModificationException in ICU analyzer

I am using the 4.7.0 ICU analyzer (via elastic search) and noticed this exception in the logs. It's sporadic. Any ideas what is going on or if this is already fixed ...

Feedly team
May 12, 2014 at 4:59 pm
May 15, 2014 at 3:07 am

2	Question about multi-valued fields

Hi, Does anyone know a way of identifying which entry in a multi-value field actually matches during a search? e.g. in this example: String[] entryList = { "entry one", "entry two", "entry three", ...

Chris Bamford
May 20, 2014 at 3:13 pm
May 21, 2014 at 8:28 am

2	Performance issue when using multiple PhraseQueries against a 1+ million entries index

Hi, In order to achieve a somehow "smarter" search that takes into consideration also the context I decided to use PhraseQuery. Now I create ~100 phrase queries from the input text and combine them ...

Liviu Matei
May 19, 2014 at 8:21 pm
May 19, 2014 at 8:49 pm

2	A work around to get matching terms from document - Stemmed and Synonyms

I am looking for a feature in SOLR that will give me all matched terms in the document when I search with a query term, My SOLR field uses Stemming and Synonym filters as a result of this I am unable ...

Venkatesham Gundu
May 17, 2014 at 7:15 am
May 17, 2014 at 7:50 pm

2	Can RAMDirectory work for gigabyte data which needs refreshing of the index all the time?

Hi, I have an index of multiple gigabytes which serves 5-10 threads and needs refreshing very often. I wonder if RAMDirectory is the good candidate for this purpose. If not, what kind of directory is ...

Cheng
May 11, 2014 at 5:01 am
May 16, 2014 at 10:18 pm

2	Merger performance degradation on 3.6.1

Hi, We have about 550M records index (~800GB) and we merge thousands of mini indexes once a week using hadoop - 45 mappers on 2 hadoop nodes. After upgrading to Lucene 3.6.1 we noticed that the merge ...

Danielv
May 14, 2014 at 11:57 pm
May 16, 2014 at 7:24 pm

1	MultiReader docid reliability

Hi, from the javadocs: ---- For efficiency, in this API documents are often referred to via document numbers, non-negative integers which each name a unique document in the index. These document ...

Nicola Buso
May 29, 2014 at 1:29 pm
Jun 2, 2014 at 11:53 am

1	Why does QueryBuilder.createBooleanQuery create something different from input?

Hi, I build a query using QueryBuilder.createBooleanQuery("title","【微信活动】6500盒“健康瘦身减肥”梅免费送"). When I check the query, the toString() of this query looks like: Query: title:而 title:不用 title:下载 ...

Cheng
May 11, 2014 at 5:20 am
May 13, 2014 at 10:34 am

0	Fast bulk explains?

We're attempting to get explains for the top 1000 documents we fetch from Lucene and running into performance problems. Is there a good way to speed these up? In our profiling, we see the advance() ...

Gregg Donovan
May 28, 2014 at 4:26 pm
May 28, 2014 at 4:26 pm

0	[ANNOUNCE] Apache Lucene 4.8.1 released

May 2014, Apache Lucene™ 4.8.1 available The Lucene PMC is pleased to announce the release of Apache Lucene 4.8.1 Apache Lucene is a high-performance, full-featured text search engine library written ...

Robert Muir
May 20, 2014 at 12:06 pm
May 20, 2014 at 12:06 pm

0	Getting payloads for query terms of constantscore query

Hi I can get the payloads for query terms using getPayloadsForQuery from PayloadSpanUtil. However this does not support ConstantScore queries. So how do I get the payloads for queries that get ...

Puneet Pawaia
May 19, 2014 at 5:30 pm
May 19, 2014 at 5:30 pm

0	Call for papers: JTRES 2014

(Apologies if you reveive multiple copies of this CfP.) The 12th International Workshop on Java Technologies for Real-time and Embedded Systems - JTRES 2014 October 13th - 14th Niagara Falls, NY, USA ...

Wopu
May 19, 2014 at 8:24 am
May 19, 2014 at 8:24 am

0	How to use query terms tfidf as a factor in document similarity calculation

Hi, I'm trying to implement Explicit semantic analysis(ESA) via Lucene. How do I take a term TFIDF in a query into consideration when matching documents? For example: Query:"a b c a d a" Doc1:"a b a" ...

Diaa Abdallah
May 18, 2014 at 10:35 pm
May 18, 2014 at 10:35 pm

0	Search at LinkedIn tech talk on Wednesday

I'm giving a talk that may be interesting to you: http://www.meetup.com/SF-Bay-Areas-Big-Data-Think-Tank/events/180573212/ Please share with others that may be interested. Sriram.

Sriram Sankar
May 18, 2014 at 2:10 pm
May 18, 2014 at 2:10 pm

0	Luchess: searching chess games with Lucene

Hello, I've just finished a little side project of mine, and wanted to let you know about it. Basically, it's a Java web application, which lets your search chess games using Lucene - hence its ...

Yann-Erwan Perio
May 17, 2014 at 3:40 pm
May 17, 2014 at 3:40 pm

0	MultiReader scoring

Dear lucene users, we are using lucene(4.6) MultiReader for different indexes and for performance reasons i am going to replace it with normal Reader. But we need to keep the scoring similar with ...

Tamer Gur
May 12, 2014 at 10:08 am
May 12, 2014 at 10:08 am

group	java-user @
categories	lucene
discussions	31
posts	162
users	58
website	lucene.apache.org

summaries	on	Hotkey: s
users list	on	Hotkey: d
user style	avatars	Hotkey: a

Lucene > java-user > May 2014

Search Discussions

31 discussions - 162 posts

NewBie To Lucene || Perfect configuration on a 64 bit server

[lucene 4.6] NPE when calling IndexReader#openIfChanged

Never close IndexWriter/Reader?

How to locate a Phrase inside text (like a Browser text searcher)

How to add machine learning to Apache lucene

Lucene Upgrade from 2.9.x to 4.7.x

search time & number of segments

writer.updateDocument() not working (possible bug?)

fadvise/madvise during segment-merges....

Issue with Lucene 3.6.1 and MMapDirectory

Re: best choice for ramBufferSizeMB

Lucene: Index Writer to write in multiple file instead make one heavy file

IndexWriter.addIndexes() multithread correct?

Multi-thread indexing, should the commit be called from each thread?

remapping docIds in a read only offline built index

ConcurrentModificationException in ICU analyzer

Question about multi-valued fields

Performance issue when using multiple PhraseQueries against a 1+ million entries index

A work around to get matching terms from document - Stemmed and Synonyms

Can RAMDirectory work for gigabyte data which needs refreshing of the index all the time?

Merger performance degradation on 3.6.1

MultiReader docid reliability

Why does QueryBuilder.createBooleanQuery create something different from input?

Fast bulk explains?

[ANNOUNCE] Apache Lucene 4.8.1 released

Getting payloads for query terms of constantscore query

Call for papers: JTRES 2014

How to use query terms tfidf as a factor in document similarity calculation

Search at LinkedIn tech talk on Wednesday

Luchess: searching chess games with Lucene

MultiReader scoring

58 users for May 2014

Content

People

Support

Translate