Changes

Jump to navigation Jump to search
2 bytes added ,  13:35, 2 July 2020
=Token Processing=
"Fullwidth" and "Halfwidth" (which is defined by[httphttps://unicode.org/Public/UNIDATA/EastAsianWidth.txt East Asian Width Properties])are not distinguished (this is the so-called ZENKAKU/HANKAKU problem). For example, <code>XML</code> and <code>XML</code> will be treatedas the same word. If documents are ''hybrid'', i.e. written in multiple languages​​,this is also helpful for some other options of the XQuery Full Text Specification,such as the [https://www.w3.org/TR/xpath-full-text-10/#ftcaseoption Case] or the[https://www.w3.org/TR/xpath-full-text-10/#ftdiacriticsoption Diacritics] Optionoption.
=Stemming=
Bureaucrats, editor, reviewer, Administrators
13,550

edits

Navigation menu