Full text search with non-Latin scripts
Saturday, 17 September 2022 · 2 messages · last reply 26 Sep 2022
AH
Andreas Hartmann17 Sep 2022 12:33 #
Hi,
I have problems with full text search in 10.1, when non-Latin script is involved. Expressions such as
"βάναυσος" contains text "67644567" using fuzzy
"67644567" contains text "βάναυσος" using fuzzy
"humbug" contains text "βάναυσος" using fuzzy
all yield "true". It's the same with Hebrew strings. It does not matter which Greek/Hebrew word is used, as long as the word-length does not differ too much from the compared string. Is this really the expected behavior or could it be a bug?
Best greetings
Andreas
CG
Christian Grün26 Sep 2022 15:52 #
Hi Andreas,
Sorry for the late reply.
Fuzzy/approximate search is currently limited to the Latin character set.
Best regards,
Christian
Andreas Hartmann <andreas.hartmann at gmx.org> schrieb am Sa., 17. Sept. 2022, 12:33:
Quoted text · Andreas Hartmann · 18 lines
> Hi, > > I have problems with full text search in 10.1, when non-Latin script is > involved. Expressions such as > > "βάναυσος" contains text "67644567" using fuzzy > "67644567" contains text "βάναυσος" using fuzzy > "humbug" contains text "βάναυσος" using fuzzy > > all yield "true". It's the same with Hebrew strings. It does not matter > which Greek/Hebrew word is used, as long as the word-length does not differ > too much from the compared string. Is this really the expected behavior or > could it be a bug? > > Best greetings > Andreas > >
Written for BaseX 10.1. BaseX may have changed since: please check the current documentation.
⚡Generated with XQuery