Hello,
When you look at the fields of a document with Luke, there is a norm column.
I have not been able to figure out what that is.
The reason I am asking is that I am trying to build a uniqueness model. My
Index is structured as follows:
classID, textID, K, V
classID is a given class. textID is a document ID. each document is formed
by multiple K,V pairs.
I want to measure uniqueness of V, with both inter classID and inter textID.
In other words, given a document (K,V pair) I would like to know how unique
is the V both inside the classID, and textID.
Any ideas/recomendations/help greatly appreciated.
Best.
-C.B.
