lucene search options

One way of doing it is while parsing email if it has .gmail.com add it to different field also.
Warm Regards,
Allahbaksh
Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://allahbaksh.blogspot.com


-----Original Message-----
From: Aditi Goyal
Sent: Monday, June 23, 2008 11:51 AM
To: java-user@lucene.apache.org
Subject: lucene search options

Hi All,

I am using Lucene for creating indexes. There is one field as "email" which
stored the email id.
I have few queries regarding searching:
1. I want to search for all the records having domain as "gmail.com" . So,
is there a way by which I can do a partial search on "email" field such that
I get the records matching only the domain name.
I think wildcard (*) cannot be used in the beginning :(

2. If I just want to search for the records which are not matching email as
"abc@xyz.com"
How can I search for it. Here, MUST_NOT cannot be used alone. Is there a way
out?


Please help.

Thanks,
Aditi

**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Thanks Allahbaksh, But this was just an example. I want to search for lot
more fields like this.

Usually if you negate the keyword then that document will be skipped. So what else you want to search. Design of fields is very important.
Warm Regards,
Allahbaksh

Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Aditi Goyal
Sent: Monday, June 23, 2008 12:01 PM
To: java-user@lucene.apache.org
Subject: Re: lucene search options

Thanks Allahbaksh, But this was just an example. I want to search for lot
more fields like this.

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Wrong:

http://lucene.apache.org/java/2_3_0/api/core/org/apache/lucene/queryParser/QueryParser.html#setAllowLeadingWildcard(boolean)

Daniel

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Hi Daniel,
You are right earlier the wild card character were not supported but now they are supported.
Regards,
Allahbaksh


Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Daniel Noll
Sent: Monday, June 23, 2008 12:03 PM
To: java-user@lucene.apache.org
Subject: Re: lucene search options
Wrong:

http://lucene.apache.org/java/2_3_0/api/core/org/apache/lucene/queryParser/QueryParser.html#setAllowLeadingWildcard(boolean)

Daniel

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Thanks a lot Daniel, I will try this option. :)
Is there a way to search for not equal to query alone?

Hi Aditi,
You can search using NOT operator. You can go through below link for Query details http://lucene.apache.org/java/docs/queryparsersyntax.html
Warm Regards,
Allahbaksh

Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Aditi Goyal
Sent: Monday, June 23, 2008 12:06 PM
To: java-user@lucene.apache.org
Subject: Re: lucene search options

Thanks a lot Daniel, I will try this option. :)
Is there a way to search for not equal to query alone?
**************** CAUTION - Disclaimer *****************
This e-mail contains PRIVILEGED AND CONFIDENTIAL INFORMATION intended solely
for the use of the addressee(s). If you are not the intended recipient, please
notify the sender by e-mail and delete the original message. Further, you are not
to copy, disclose, or distribute this e-mail or its contents to any other person and
any such actions are unlawful. This e-mail may contain viruses. Infosys has taken
every reasonable precaution to minimize this risk, but is not liable for any damage
you may sustain as a result of any virus in this e-mail. You should carry out your
own virus checks before opening the e-mail or attachment. Infosys reserves the
right to monitor and review the content of all messages sent to or from this e-mail
address. Messages sent to or from this e-mail address may be stored on the
Infosys e-mail system.
***INFOSYS******** End of Disclaimer ********INFOSYS***

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Thank you Allahbaksh for taking so much pains. The link says it cannot be
used alone.

Note: The NOT operator cannot be used with just one term. For example, the
following search will return no results:

NOT "jakarta apache"
Thanks,
Aditi

Yes Aditi You can use it alone.
Warm regards,
Allahbaksh

Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Aditi Goyal
Sent: Monday, June 23, 2008 1:24 PM
To: java-user@lucene.apache.org
Subject: Re: lucene search options

Thank you Allahbaksh for taking so much pains. The link says it cannot be
used alone.

Note: The NOT operator cannot be used with just one term. For example, the
following search will return no results:

NOT "jakarta apache"
Thanks,
Aditi

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Hi Aditi,
Sorry for typo. You cannot edit it alone.
Warm Regards,
Allahbaksh

Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Allahbaksh Mohammedali Asadullah
Sent: Monday, June 23, 2008 1:25 PM
To: java-user@lucene.apache.org
Subject: RE: lucene search options

Yes Aditi You can use it alone.
Warm regards,
Allahbaksh

Allahbaksh Mohammedali Asadullah,
Software Engineering & Technology Labs,
Infosys Technolgies Limited, Electronics City,
Hosur Road, Bangalore 560 100, India.
*Board: +91-80-28520261 | Extn: 53915 | Direct: 41173915.
Fax: +91-80-28520362 | Mobile: +91-9845505322.
http://setlabs/slim/
http://allahbaksh.blogspot.com


-----Original Message-----
From: Aditi Goyal
Sent: Monday, June 23, 2008 1:24 PM
To: java-user@lucene.apache.org
Subject: Re: lucene search options

Thank you Allahbaksh for taking so much pains. The link says it cannot be
used alone.

Note: The NOT operator cannot be used with just one term. For example, the
following search will return no results:

NOT "jakarta apache"
Thanks,
Aditi

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

Oh. For one moment I was elated to hear the news. :(
Is there any way out?

Thanks,
Aditi

I am using MultiFieldQueryParser. Can I use setAllowLeadingWildCard with
MultiFieldQueryParser?I am doing the following:

parser = lucene.MultiFieldQueryParser(fields, analyzer )
parser.setAllowLeadingWildcard(True)
query = parser.parse(command)

And I am getting this error:

ERROR (<type 'exceptions.TypeError'>, TypeError("descriptor 'parse'
requires a 'QueryParser' object but received a 'str'",), <traceback object
at 0x02DFA800>)

Thanks a lot

Aditi

: I am using MultiFieldQueryParser. Can I use setAllowLeadingWildCard with
: MultiFieldQueryParser?I am doing the following:
:
: parser = lucene.MultiFieldQueryParser(fields, analyzer )
: parser.setAllowLeadingWildcard(True)
: query = parser.parse(command)
:
: And I am getting this error:
:
: ERROR (<type 'exceptions.TypeError'>, TypeError("descriptor 'parse'
: requires a 'QueryParser' object but received a 'str'",), <traceback object
: at 0x02DFA800>)

the sample code you posted doesn't look like java, and this is not an
error message you would get form java, so i'm guessing you are using a
port (.Net maybe?) ... the error message seems langauge specific (related
to the way the "parse" method is dispatched on a "QueryParser" object) so
you should consult the user communityfor the port you are using.


-Hoss


---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

*:* -"jakarta apache"

Or subclass QueryParser and override the getBooleanQuery() method to do this
behind the scenes using MatchAllDocsQuery.

Daniel

---------------------------------------------------------------------
To unsubscribe, e-mail: java-user-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-user-help@lucene.apache.org

We are converting a User Interface query to lucene on the back end. It has
recently come up that users want to do some negative only queries like NOT
"jakarta apache". What is an efficient way to do this? We do know what
field they are specifying, ie -field1:jakarta

We are converting a User Interface query to lucene on the back end. It has
recently come up that users want to do some negative only queries like NOT
"jakarta apache". What is an efficient way to do this? We do know what field
they are specifying, ie -field1:jakarta

Hi,

An easy way to do that would be to index a particular term with all docs
e.g. "dummyword" could be indexed for all documents as a value for a
dummyfield or an existing field.
This way lets assume you want to fetch results for -filed1:jakarta
You could search for dummyfield:"dummyword" AND NOT filed1:jakarta

This is just one of the solution, though I still would not understand if
there's a logical reason for fetching such results.:)

You can also synthesize a clause that matches all documents and then
add the NOT to it. I haven't tried it, but you might be able to combine,
say,
MatchAllDocsQuery with your NOT query as part of a BooleanQuery...

Best
Erick

The reason our users want to do this is because they want to search for
instances where certain negative conditions are true. My client is the news
industry and this is metadata for things like reporter, type, etc.
Sometimes you want -reporter:mark for example and this is the only criteria
to search against the index.

Am I thinking about this wrong?

I did try using the MatchAllDocsQuery class and it expands to something like
this:

summary:matchalldocsquery -reporter:*mark*

but I don't get any results which is not what I expect for my does not
contain query above.

Have you enabled leading wildcards? They are not (or at least weren't
last I knew) enabled by default....

<<<QueryParser.setAllowLeadingWildcard( true )>>>

from


http://wiki.apache.org/jakarta-lucene/LuceneFAQ#head-4d62118417eaef0dcb87f4370583f809848ea695

Best
Erick

Yes that is set. It works if I do a query like this:

status:* -reporter:*mark*

The status field only has a few possible values.

That'll teach me to scan e-mail. You can't use MatchAllDocsQuery
that way.
What you're actually searching for is the word "matchalldocsquery"
in the field "summary". Which returns nothing. Then you're subtracting
any documents with reporter *mark*. That isn't what you're after at all.

If you're doing this programmatically, you want something in the
Lucene code like:

BooleanQuery bq = new BooleanQuery()
bq.add(new MatchAllDocsQuery(), BooleanClause.occur.MUST)
bq.add(<parsed *mark* query here>, BooleanClause.occur.MUST_NOT)


now pass bq to the search method. This will require some work on your
part to detect when it's appropriate and when it's not. But presumably you
have the ability to know that.

I've seen referenced (but haven't used) something like
reporter:(* TO *) -reporter:*mark*

WARNING: I've seen this referenced in, I believe, the SOLR mailing
list. I don't know how it plays in straight Lucene,and I have no idea
what the gotcha's are, nor what version of Lucene supports this syntax
efficiently. Furthermore I'm unclear what the behavior for
a document without the reporter field is......

But I do know that you can't do what your example does....

FWIW
Erick

The way I got that query was doing:

new MatchAllDocsQuery().toString(). I thought the "matchalldocsquery" part
was a bit odd but figured it might be a known keyword with lucene.

Thanks for the help!

Yes I've seen that syntax too used to search for null values. You can do
-(reporter:* AND -reporter:[* to *]) which says all values minus docs with a
value.

Your suggestion did the trick, thanks!

Hi aditi,

U can have a field corresponding to this domain....It will solve ur
problem......

bye

Rohit
Impetus technologies- noida
mob. 09910220475

Hi Aditi,

As Rohit said, the best way to solve this problem is to have two fields for
indexing an email-id, one for the username and another for domain name.

Having two fields and using a Boolean Query with MUST condition should solve
your problem. You can also perform restricted search with the above
architecture, like search for user "x" with in the domain "gmail.com"

--Sai Krishna.