Grokbase › Groups › Lucene › dev › November 2011
FAQ
TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
------------------------------------------------------------

Key: LUCENE-3576
URL: https://issues.apache.org/jira/browse/LUCENE-3576
Project: Lucene - Java
Issue Type: Task
Reporter: Robert Muir
Fix For: 4.0


we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
but we don't test this at all in TestBackwardsCompatibility.

for example, nothing handles this case for term vectors...

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org

Search Discussions

  • Robert Muir (Assigned) (JIRA) at Jan 18, 2012 at 12:00 am ⇧
    [ https://issues.apache.org/jira/browse/LUCENE-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Muir reassigned LUCENE-3576:
    -----------------------------------

    Assignee: Robert Muir
    TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
    ------------------------------------------------------------

    Key: LUCENE-3576
    URL: https://issues.apache.org/jira/browse/LUCENE-3576
    Project: Lucene - Java
    Issue Type: Task
    Reporter: Robert Muir
    Assignee: Robert Muir
    Fix For: 4.0


    we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
    but we don't test this at all in TestBackwardsCompatibility.
    for example, nothing handles this case for term vectors...
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira



    ---------------------------------------------------------------------
    To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: dev-help@lucene.apache.org
  • Robert Muir (Updated) (JIRA) at Jan 18, 2012 at 1:16 am ⇧
    [ https://issues.apache.org/jira/browse/LUCENE-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Muir updated LUCENE-3576:
    --------------------------------

    Attachment: index.36.surrogates.zip
    LUCENE-3576_trunk_test.patch
    LUCENE-3576_3x_createIndex.patch

    Here's the patch to make the index from 3.x's testbackwards, and a simple test for trunk that fails. I also attached the zip.

    I'll work on fixing the preflex codec's termvectorsreader/writer now.
    TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
    ------------------------------------------------------------

    Key: LUCENE-3576
    URL: https://issues.apache.org/jira/browse/LUCENE-3576
    Project: Lucene - Java
    Issue Type: Task
    Reporter: Robert Muir
    Assignee: Robert Muir
    Fix For: 4.0

    Attachments: LUCENE-3576_3x_createIndex.patch, LUCENE-3576_trunk_test.patch, index.36.surrogates.zip


    we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
    but we don't test this at all in TestBackwardsCompatibility.
    for example, nothing handles this case for term vectors...
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira



    ---------------------------------------------------------------------
    To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: dev-help@lucene.apache.org
  • Michael McCandless (Commented) (JIRA) at Jan 18, 2012 at 2:55 pm ⇧
    [ https://issues.apache.org/jira/browse/LUCENE-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13188482#comment-13188482 ]

    Michael McCandless commented on LUCENE-3576:
    --------------------------------------------

    +1, we need to test term vectors w/ surrogates better!
    TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
    ------------------------------------------------------------

    Key: LUCENE-3576
    URL: https://issues.apache.org/jira/browse/LUCENE-3576
    Project: Lucene - Java
    Issue Type: Task
    Reporter: Robert Muir
    Assignee: Robert Muir
    Fix For: 4.0

    Attachments: LUCENE-3576_3x_createIndex.patch, LUCENE-3576_trunk_test.patch, index.36.surrogates.zip


    we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
    but we don't test this at all in TestBackwardsCompatibility.
    for example, nothing handles this case for term vectors...
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira



    ---------------------------------------------------------------------
    To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: dev-help@lucene.apache.org
  • Robert Muir (Updated) (JIRA) at Jan 18, 2012 at 4:05 pm ⇧
    [ https://issues.apache.org/jira/browse/LUCENE-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Muir updated LUCENE-3576:
    --------------------------------

    Attachment: LUCENE-3576.patch

    Here's a patch fixing the bug.

    PreFlexRW now writes term vectors in UTF-16 order.
    TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
    ------------------------------------------------------------

    Key: LUCENE-3576
    URL: https://issues.apache.org/jira/browse/LUCENE-3576
    Project: Lucene - Java
    Issue Type: Task
    Reporter: Robert Muir
    Assignee: Robert Muir
    Fix For: 4.0

    Attachments: LUCENE-3576.patch, LUCENE-3576_3x_createIndex.patch, LUCENE-3576_trunk_test.patch, index.36.surrogates.zip


    we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
    but we don't test this at all in TestBackwardsCompatibility.
    for example, nothing handles this case for term vectors...
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira



    ---------------------------------------------------------------------
    To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: dev-help@lucene.apache.org
  • Robert Muir (Resolved) (JIRA) at Jan 18, 2012 at 5:59 pm ⇧
    [ https://issues.apache.org/jira/browse/LUCENE-3576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

    Robert Muir resolved LUCENE-3576.
    ---------------------------------

    Resolution: Fixed
    TestBackwardsCompatibility needs terms with U+E000 to U+FFFF
    ------------------------------------------------------------

    Key: LUCENE-3576
    URL: https://issues.apache.org/jira/browse/LUCENE-3576
    Project: Lucene - Java
    Issue Type: Task
    Reporter: Robert Muir
    Assignee: Robert Muir
    Fix For: 4.0

    Attachments: LUCENE-3576.patch, LUCENE-3576_3x_createIndex.patch, LUCENE-3576_trunk_test.patch, index.36.surrogates.zip


    we changed sort order in 4.0, and have sophisticated backwards compatibility (e.g. surrogates dance),
    but we don't test this at all in TestBackwardsCompatibility.
    for example, nothing handles this case for term vectors...
    --
    This message is automatically generated by JIRA.
    If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
    For more information on JIRA, see: http://www.atlassian.com/software/jira



    ---------------------------------------------------------------------
    To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
    For additional commands, e-mail: dev-help@lucene.apache.org

Related Discussions

Discussion Navigation
viewthread | post
Discussion Overview
groupdev @
categorieslucene
postedNov 15, '11 at 12:23a
activeJan 18, '12 at 5:59p
posts6
users1
websitelucene.apache.org

1 user in discussion

Robert Muir (Resolved) (JIRA): 6 posts

Content

People

Support

Translate

site design / logo © 2022 Grokbase