Using stemming via the BaseX API
Wednesday, 28 March 2012 · 3 messages
CG
Dear Michael,
thanks for your mail. Just to get sure: did you have a look at our Wiki page on Japanese tokenization [1]?
I believe there may be quite different reasons why the files are not found. Could you provide us with a simple, self-contained example that allows us to reproduce the problem?
Christian
[1] http://docs.basex.org/wiki/Full-Text:_Japanese
Quoted text · Michael Wilson · 14 lines
On Wed, Mar 28, 2012 at 1:21 AM, Michael Wilson <wilsonma77 at gmail.com> wrote: > I’m working on a hobbyist project of mine, and am having trouble with > stemming when running queries from a java app (I’m using the BaseX API to > search XML japanese dictionary files via a custom swing/GUI application). > Specifically, I receive the error message: “[FTST0009] No tokenizer > available for language 'Japanese'.” I do have the etc/ja folder present. > > This problem does not occur when I run the same query from the BaseX GUI. I > replicated the same class path I observed in the basexgui.bat file: I added > basex.jar, igo-0.4.3.jar, lucene-stemmers.3.4.0.jar, xml-resolvers-1.2.jar, > tagsoup-1.2.jar to the Path environment variable, but it didn’t help. > > Does anyone have any ideas on how I can make stemming work from my > application? I appreciate any insights or solutions.
MW
Michael Wilson28 Mar 2012 03:21 #
I’m working on a hobbyist project of mine, and am having trouble with stemming when running queries from a java app (I’m using the BaseX API to search XML japanese dictionary files via a custom swing/GUI application). Specifically, I receive the error message: “[FTST0009] No tokenizer available for language 'Japanese'.” I do have the etc/ja folder present.
This problem does not occur when I run the same query from the BaseX GUI. I replicated the same class path I observed in the basexgui.bat file: I added basex.jar, igo-0.4.3.jar, lucene-stemmers.3.4.0.jar, xml-resolvers-1.2.jar, tagsoup-1.2.jar to the Path environment variable, but it didn’t help.
Does anyone have any ideas on how I can make stemming work from my application? I appreciate any insights or solutions.
TH
Hi Christian,
I've tried a Japanese full text on the GUI of current version(7.2). However, the index was created actually seems like the English instead of Japanese.
At the time of version 7.0.x, it was working well.
Hope this helps,
Toshio HIRAI
2012/3/28 Christian Grün <christian.gruen at gmail.com>
Quoted text · Christian Grün · 37 lines
> Dear Michael, > > thanks for your mail. Just to get sure: did you have a look at our > Wiki page on Japanese tokenization [1]? > > I believe there may be quite different reasons why the files are not > found. Could you provide us with a simple, self-contained example that > allows us to reproduce the problem? > > Christian > > [1] http://docs.basex.org/wiki/Full-Text:_Japanese > ___________________________ > > On Wed, Mar 28, 2012 at 1:21 AM, Michael Wilson <wilsonma77 at gmail.com> > wrote: > > I’m working on a hobbyist project of mine, and am having trouble with > > stemming when running queries from a java app (I’m using the BaseX API to > > search XML japanese dictionary files via a custom swing/GUI application). > > Specifically, I receive the error message: “[FTST0009] No tokenizer > > available for language 'Japanese'.” I do have the etc/ja folder present. > > > > This problem does not occur when I run the same query from the BaseX > GUI. I > > replicated the same class path I observed in the basexgui.bat file: I > added > > basex.jar, igo-0.4.3.jar, lucene-stemmers.3.4.0.jar, > xml-resolvers-1.2.jar, > > tagsoup-1.2.jar to the Path environment variable, but it didn’t help. > > > > Does anyone have any ideas on how I can make stemming work from my > > application? I appreciate any insights or solutions. > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >
Written for BaseX 7.2. BaseX may have changed since: please check the current documentation.
⚡Generated with XQuery