Dagger et al. being replaced by char refs in returned XML
Thursday, 19 April 2018 · 5 messages · last reply 20 Apr 2018
BD
Hi Chuck,
Did you see the email from earlier today [1] regarding a Unicode bug? The latest development snapshot might address your issue (maybe! I'm not sure!).
HTH.
Best,
Bridger
[1]
https://mailman.uni-konstanz.de/pipermail/basex-talk/2018-April/013071.html
Quoted text · Chuck Bearden · 72 lines
On Wed, Apr 18, 2018, 9:18 PM Chuck Bearden <cfbearden at gmail.com> wrote: > Hi all, > > I have loaded a large XML document (a dictionary of New Testament > Greek) into its own database in BaseX 9.0. I'm using OpenJDK 1.8.0_162 > under Ubuntu 16.04.4. I used the default Java parser, and I enabled > the token & full text indices, but otherwise the database settings > were the defaults. > > When I execute a particular query, I'm getting a sequence of the > character reference for the carriage return ('
') instead of some > characters like the single & double daggers. > > Here is some typical output: > > <!--Page: 4 ; Entry: ἄγε|G33 --> > <entry n="ἄγε|G33"> > <note type="occurrencesNT">2</note> > <form> > <orth>ἄγε</orth>,</form> > <seg type="derivation">prop. imperat. of<ref> > <foreign xml:lang="grc">ἄγω</foreign> > </ref>,</seg> > <sense> > <gloss>come!</gloss>used as<gramGrp> > <pos>adv.</pos> > </gramGrp>and addressed, like<ref> > <foreign xml:lang="grc">φέρε</foreign> > </ref>, to one or more persons:<ref osisRef="Jas.4.13">Ja > 4:13</ref>,<ref > > osisRef="Jas.5.1">5:1</ref>











 > </sense> > </entry> > > The sequence of '
' char refs replace a dagger '†' (U+2020). I > wonder if I'm doing something wrong, or if I've happened on a bug. > > Here is my XQuery: > > declare namespace tei = "http://www.crosswire.org/2013/TEIOSIS/namespace > "; > declare namespace xsi = "http://www.w3.org/2001/XMLSchema-instance"; > > let $coll := collection('abbott-smith.tei'), > $elems := $coll//tei:seg[parent::tei:entry] > > return <div > xmlns="http://www.crosswire.org/2013/TEIOSIS/namespace" > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">{ > for $elem in $elems > let $entry := $elem/parent::tei:entry, > $entry_lemma := $entry/@n/data(), > $page_num := $elem/preceding::tei:pb[1]/@n/data(), > $comment_text := concat('Page: ', $page_num, ' ; Entry: ', > $entry_lemma, ' ') > return ( > comment {$comment_text}, > $entry > ) > }</div> > > > The source XML document is here: > > https://github.com/translatable-exegetical-tools/Abbott-Smith/blob/master/abbott-smith.tei.xml > > Thanks in advance for your guidance. > > All the best, > Charles Bearden >
CB
Chuck Bearden19 Apr 2018 05:18 #
Hi all,
I have loaded a large XML document (a dictionary of New Testament Greek) into its own database in BaseX 9.0. I'm using OpenJDK 1.8.0_162 under Ubuntu 16.04.4. I used the default Java parser, and I enabled the token & full text indices, but otherwise the database settings were the defaults.
When I execute a particular query, I'm getting a sequence of the character reference for the carriage return ('
') instead of some characters like the single & double daggers.
Here is some typical output:
<!--Page: 4 ; Entry: ἄγε|G33 -->
<entry n="ἄγε|G33">
<note type="occurrencesNT">2</note>
<form>
<orth>ἄγε</orth>,</form>
<seg type="derivation">prop. imperat. of<ref>
<foreign xml:lang="grc">ἄγω</foreign>
</ref>,</seg>
<sense>
<gloss>come!</gloss>used as<gramGrp>
<pos>adv.</pos>
</gramGrp>and addressed, like<ref>
<foreign xml:lang="grc">φέρε</foreign>
</ref>, to one or more persons:<ref osisRef="Jas.4.13">Ja
4:13</ref>,<ref
osisRef="Jas.5.1">5:1</ref>











</sense>
</entry>The sequence of '
' char refs replace a dagger '†' (U+2020). I wonder if I'm doing something wrong, or if I've happened on a bug.
Here is my XQuery:
declare namespace tei = "http://www.crosswire.org/2013/TEIOSIS/namespace";
declare namespace xsi = "http://www.w3.org/2001/XMLSchema-instance";
let $coll := collection('abbott-smith.tei'),
$elems := $coll//tei:seg[parent::tei:entry]
return <div
xmlns="http://www.crosswire.org/2013/TEIOSIS/namespace"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">{
for $elem in $elems
let $entry := $elem/parent::tei:entry,
$entry_lemma := $entry/@n/data(),
$page_num := $elem/preceding::tei:pb[1]/@n/data(),
$comment_text := concat('Page: ', $page_num, ' ; Entry: ',
$entry_lemma, ' ')
return (
comment {$comment_text},
$entry
)
}</div>The source XML document is here:
https://github.com/translatable-exegetical-tools/Abbott-Smith/blob/master/abbott-smith.tei.xml
Thanks in advance for your guidance.
All the best,
Charles Bearden
CB
Oh man, I overlooked that email. Thanks! I will give the latest snapshots a try. Chuck
Quoted text · Bridger Dyson-Smith · 85 lines
On Wed, Apr 18, 2018 at 9:36 PM, Bridger Dyson-Smith <bdysonsmith at gmail.com> wrote: > Hi Chuck, > Did you see the email from earlier today [1] regarding a Unicode bug? The > latest development snapshot might address your issue (maybe! I'm not sure!). > > HTH. > Best, > Bridger > > [1] > https://mailman.uni-konstanz.de/pipermail/basex-talk/2018-April/013071.html > > On Wed, Apr 18, 2018, 9:18 PM Chuck Bearden <cfbearden at gmail.com> wrote: >> >> Hi all, >> >> I have loaded a large XML document (a dictionary of New Testament >> Greek) into its own database in BaseX 9.0. I'm using OpenJDK 1.8.0_162 >> under Ubuntu 16.04.4. I used the default Java parser, and I enabled >> the token & full text indices, but otherwise the database settings >> were the defaults. >> >> When I execute a particular query, I'm getting a sequence of the >> character reference for the carriage return ('
') instead of some >> characters like the single & double daggers. >> >> Here is some typical output: >> >> <!--Page: 4 ; Entry: ἄγε|G33 --> >> <entry n="ἄγε|G33"> >> <note type="occurrencesNT">2</note> >> <form> >> <orth>ἄγε</orth>,</form> >> <seg type="derivation">prop. imperat. of<ref> >> <foreign xml:lang="grc">ἄγω</foreign> >> </ref>,</seg> >> <sense> >> <gloss>come!</gloss>used as<gramGrp> >> <pos>adv.</pos> >> </gramGrp>and addressed, like<ref> >> <foreign xml:lang="grc">φέρε</foreign> >> </ref>, to one or more persons:<ref osisRef="Jas.4.13">Ja >> 4:13</ref>,<ref >> >> osisRef="Jas.5.1">5:1</ref>











 >> </sense> >> </entry> >> >> The sequence of '
' char refs replace a dagger '†' (U+2020). I >> wonder if I'm doing something wrong, or if I've happened on a bug. >> >> Here is my XQuery: >> >> declare namespace tei = >> "http://www.crosswire.org/2013/TEIOSIS/namespace"; >> declare namespace xsi = "http://www.w3.org/2001/XMLSchema-instance"; >> >> let $coll := collection('abbott-smith.tei'), >> $elems := $coll//tei:seg[parent::tei:entry] >> >> return <div >> xmlns="http://www.crosswire.org/2013/TEIOSIS/namespace" >> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">{ >> for $elem in $elems >> let $entry := $elem/parent::tei:entry, >> $entry_lemma := $entry/@n/data(), >> $page_num := $elem/preceding::tei:pb[1]/@n/data(), >> $comment_text := concat('Page: ', $page_num, ' ; Entry: ', >> $entry_lemma, ' ') >> return ( >> comment {$comment_text}, >> $entry >> ) >> }</div> >> >> >> The source XML document is here: >> >> https://github.com/translatable-exegetical-tools/Abbott-Smith/blob/master/abbott-smith.tei.xml >> >> Thanks in advance for your guidance. >> >> All the best, >> Charles Bearden
CG
Christian Grün19 Apr 2018 10:33 #
One more reason to get 9.0.1 released soon ;)
Quoted text · Chuck Bearden · 89 lines
On Thu, Apr 19, 2018 at 5:04 AM, Chuck Bearden <cfbearden at gmail.com> wrote: > Oh man, I overlooked that email. Thanks! I will give the latest snapshots a try. > Chuck > > On Wed, Apr 18, 2018 at 9:36 PM, Bridger Dyson-Smith > <bdysonsmith at gmail.com> wrote: >> Hi Chuck, >> Did you see the email from earlier today [1] regarding a Unicode bug? The >> latest development snapshot might address your issue (maybe! I'm not sure!). >> >> HTH. >> Best, >> Bridger >> >> [1] >> https://mailman.uni-konstanz.de/pipermail/basex-talk/2018-April/013071.html >> >> On Wed, Apr 18, 2018, 9:18 PM Chuck Bearden <cfbearden at gmail.com> wrote: >>> >>> Hi all, >>> >>> I have loaded a large XML document (a dictionary of New Testament >>> Greek) into its own database in BaseX 9.0. I'm using OpenJDK 1.8.0_162 >>> under Ubuntu 16.04.4. I used the default Java parser, and I enabled >>> the token & full text indices, but otherwise the database settings >>> were the defaults. >>> >>> When I execute a particular query, I'm getting a sequence of the >>> character reference for the carriage return ('
') instead of some >>> characters like the single & double daggers. >>> >>> Here is some typical output: >>> >>> <!--Page: 4 ; Entry: ἄγε|G33 --> >>> <entry n="ἄγε|G33"> >>> <note type="occurrencesNT">2</note> >>> <form> >>> <orth>ἄγε</orth>,</form> >>> <seg type="derivation">prop. imperat. of<ref> >>> <foreign xml:lang="grc">ἄγω</foreign> >>> </ref>,</seg> >>> <sense> >>> <gloss>come!</gloss>used as<gramGrp> >>> <pos>adv.</pos> >>> </gramGrp>and addressed, like<ref> >>> <foreign xml:lang="grc">φέρε</foreign> >>> </ref>, to one or more persons:<ref osisRef="Jas.4.13">Ja >>> 4:13</ref>,<ref >>> >>> osisRef="Jas.5.1">5:1</ref>











 >>> </sense> >>> </entry> >>> >>> The sequence of '
' char refs replace a dagger '†' (U+2020). I >>> wonder if I'm doing something wrong, or if I've happened on a bug. >>> >>> Here is my XQuery: >>> >>> declare namespace tei = >>> "http://www.crosswire.org/2013/TEIOSIS/namespace"; >>> declare namespace xsi = "http://www.w3.org/2001/XMLSchema-instance"; >>> >>> let $coll := collection('abbott-smith.tei'), >>> $elems := $coll//tei:seg[parent::tei:entry] >>> >>> return <div >>> xmlns="http://www.crosswire.org/2013/TEIOSIS/namespace" >>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">{ >>> for $elem in $elems >>> let $entry := $elem/parent::tei:entry, >>> $entry_lemma := $entry/@n/data(), >>> $page_num := $elem/preceding::tei:pb[1]/@n/data(), >>> $comment_text := concat('Page: ', $page_num, ' ; Entry: ', >>> $entry_lemma, ' ') >>> return ( >>> comment {$comment_text}, >>> $entry >>> ) >>> }</div> >>> >>> >>> The source XML document is here: >>> >>> https://github.com/translatable-exegetical-tools/Abbott-Smith/blob/master/abbott-smith.tei.xml >>> >>> Thanks in advance for your guidance. >>> >>> All the best, >>> Charles Bearden
CB
Chuck Bearden20 Apr 2018 03:09 #
Hi Christian & Bridger,
The latest snapshot (BaseX901-20180418.185856) fixed the problem. Thanks!
All the best,
Chuck
Quoted text · Christian Grün · 94 lines
On Thu, Apr 19, 2018 at 3:33 AM, Christian Grün <christian.gruen at gmail.com> wrote: > One more reason to get 9.0.1 released soon ;) > > > On Thu, Apr 19, 2018 at 5:04 AM, Chuck Bearden <cfbearden at gmail.com> wrote: >> Oh man, I overlooked that email. Thanks! I will give the latest snapshots a try. >> Chuck >> >> On Wed, Apr 18, 2018 at 9:36 PM, Bridger Dyson-Smith >> <bdysonsmith at gmail.com> wrote: >>> Hi Chuck, >>> Did you see the email from earlier today [1] regarding a Unicode bug? The >>> latest development snapshot might address your issue (maybe! I'm not sure!). >>> >>> HTH. >>> Best, >>> Bridger >>> >>> [1] >>> https://mailman.uni-konstanz.de/pipermail/basex-talk/2018-April/013071.html >>> >>> On Wed, Apr 18, 2018, 9:18 PM Chuck Bearden <cfbearden at gmail.com> wrote: >>>> >>>> Hi all, >>>> >>>> I have loaded a large XML document (a dictionary of New Testament >>>> Greek) into its own database in BaseX 9.0. I'm using OpenJDK 1.8.0_162 >>>> under Ubuntu 16.04.4. I used the default Java parser, and I enabled >>>> the token & full text indices, but otherwise the database settings >>>> were the defaults. >>>> >>>> When I execute a particular query, I'm getting a sequence of the >>>> character reference for the carriage return ('
') instead of some >>>> characters like the single & double daggers. >>>> >>>> Here is some typical output: >>>> >>>> <!--Page: 4 ; Entry: ἄγε|G33 --> >>>> <entry n="ἄγε|G33"> >>>> <note type="occurrencesNT">2</note> >>>> <form> >>>> <orth>ἄγε</orth>,</form> >>>> <seg type="derivation">prop. imperat. of<ref> >>>> <foreign xml:lang="grc">ἄγω</foreign> >>>> </ref>,</seg> >>>> <sense> >>>> <gloss>come!</gloss>used as<gramGrp> >>>> <pos>adv.</pos> >>>> </gramGrp>and addressed, like<ref> >>>> <foreign xml:lang="grc">φέρε</foreign> >>>> </ref>, to one or more persons:<ref osisRef="Jas.4.13">Ja >>>> 4:13</ref>,<ref >>>> >>>> osisRef="Jas.5.1">5:1</ref>











 >>>> </sense> >>>> </entry> >>>> >>>> The sequence of '
' char refs replace a dagger '†' (U+2020). I >>>> wonder if I'm doing something wrong, or if I've happened on a bug. >>>> >>>> Here is my XQuery: >>>> >>>> declare namespace tei = >>>> "http://www.crosswire.org/2013/TEIOSIS/namespace"; >>>> declare namespace xsi = "http://www.w3.org/2001/XMLSchema-instance"; >>>> >>>> let $coll := collection('abbott-smith.tei'), >>>> $elems := $coll//tei:seg[parent::tei:entry] >>>> >>>> return <div >>>> xmlns="http://www.crosswire.org/2013/TEIOSIS/namespace" >>>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">{ >>>> for $elem in $elems >>>> let $entry := $elem/parent::tei:entry, >>>> $entry_lemma := $entry/@n/data(), >>>> $page_num := $elem/preceding::tei:pb[1]/@n/data(), >>>> $comment_text := concat('Page: ', $page_num, ' ; Entry: ', >>>> $entry_lemma, ' ') >>>> return ( >>>> comment {$comment_text}, >>>> $entry >>>> ) >>>> }</div> >>>> >>>> >>>> The source XML document is here: >>>> >>>> https://github.com/translatable-exegetical-tools/Abbott-Smith/blob/master/abbott-smith.tei.xml >>>> >>>> Thanks in advance for your guidance. >>>> >>>> All the best, >>>> Charles Bearden
Written for BaseX 9.0. BaseX may have changed since: please check the current documentation.
⚡Generated with XQuery