Options for creating database...

De : basex-talk-bounces at mailman.uni-konstanz.de [mailto:basex-talk-bounces at mailman.uni-konstanz.de] De la part de France Baril Envoyé : vendredi 20 octobre 2017 10:44 À : BaseX Objet : [basex-talk] Options for creating database... Hi, I usually create dbs using the gui. I'm now trying to create asb without it to be able to set the updindex and autooptimize options, which I can't find in the GUI. I couldn't figure how to set them out using db:create either, so I switch to command line. Now I'm feeling dumb, I can't find how to set up parsing/indexing options for the command line. I'm looking at: http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and -wchop only. What am I missing? Here are all the options that I'd want to set: let $options := map:merge(( map:entry("CHOP", false()), map:entry('INDENT', false()), map:entry('STRIPNS', false()), map:entry('INTPARSE', true()), map:entry('DTD', false()), map:entry('XINCLUDE', false()), map:entry('UPDINDEX', true()), map:entry('AUTOOPTIMIZE', true()) )) ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only want them to be true() on one of my DBs. Other DBs should remain as is. ​ -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com>

On Fri, Oct 20, 2017 at 11:29 AM, Fabrice ETANCHAUD < fetanchaud at pch.cerfrance.fr> wrote: > Bonjour France, > > > > Didn’t you find Updindex and autooptimize options in the ‘Options’ panel > of the db creation window ? > > > > Db:create last parameter is the place to put all your options : > > > > http://docs.basex.org/wiki/Database_Module#db:create > > > > But the Pending update list may overflow memory during db creation/update. > > > > You should definitively have a look at the BaseX Scripts (BXS). > > You can declare a batch of commands in XML, and ask BaseX to run it : > > > > http://docs.basex.org/wiki/Commands#Command_Scripts > > > > This is the way to set options before invoking the CREATE-DB command : > > > > http://docs.basex.org/wiki/Commands#SET > > > > I usually write XQuery to generate a BXS that will do the job. > > > > Cordialement, > > > > Fabrice > > CERFrance Poitou-Charentes > > > > *De :* basex-talk-bounces at mailman.uni-konstanz.de [mailto: > basex-talk-bounces at mailman.uni-konstanz.de] *De la part de* France Baril > *Envoyé :* vendredi 20 octobre 2017 10:44 > *À :* BaseX > *Objet :* [basex-talk] Options for creating database... > > > > Hi, I usually create dbs using the gui. I'm now trying to create asb > without it to be able to set the updindex and autooptimize options, which I > can't find in the GUI. > > > > I couldn't figure how to set them out using db:create either, so I switch > to command line. Now I'm feeling dumb, I can't find how to set up > parsing/indexing options for the command line. I'm looking at: > http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and > -wchop only. > > > > What am I missing? > > > > Here are all the options that I'd want to set: > > > > *let **$options* := *map:merge*(( > *map:entry*("CHOP", *false*()), > *map:entry*('INDENT', *false*()), > *map:entry*('STRIPNS', *false*()), > *map:entry*('INTPARSE', *true*()), > *map:entry*('DTD', *false*()), > *map:entry*('XINCLUDE', *false*()), > *map:entry*('UPDINDEX', *true*()), > *map:entry*('AUTOOPTIMIZE', *true*()) > )) > > > > ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only > want them to be true() on one of my DBs. Other DBs should remain as is. ​ > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com >

De : Fabrice ETANCHAUD Envoyé : vendredi 20 octobre 2017 11:46 À : 'France Baril' Objet : RE: [basex-talk] Options for creating database... The XQuery will succeed if you remove the INDENT option (serialization), and lower case all your option names. You are right, you may not have a memory overflow issue on creation. But I had the problem with db:add with several huge files, before I switched to BXS. Best regards, Fabrice De : France Baril [mailto:france.baril at architextus.com] Envoyé : vendredi 20 octobre 2017 11:36 À : Fabrice ETANCHAUD Cc : BaseX Objet : Re: [basex-talk] Options for creating database... In db:create I don't think the issue is memory. I get: [bxerr:BASX0002] Unknown database option 'UPDINDEX'. My function is: let $options := map:merge(( map:entry("CHOP", false()), map:entry('INDENT', false()), map:entry('STRIPNS', false()), map:entry('INTPARSE', true()), map:entry('DTD', false()), map:entry('XINCLUDE', false()), map:entry('UPDINDEX', true()), map:entry('AUTOOPTIMIZE', true()) )) return ( db:create($db-name, $src-folder, (), $options), db:output(<div>done</div>) ) On Fri, Oct 20, 2017 at 11:29 AM, Fabrice ETANCHAUD <fetanchaud at pch.cerfrance.fr<mailto:fetanchaud at pch.cerfrance.fr>> wrote: Bonjour France, Didn’t you find Updindex and autooptimize options in the ‘Options’ panel of the db creation window ? Db:create last parameter is the place to put all your options : http://docs.basex.org/wiki/Database_Module#db:create But the Pending update list may overflow memory during db creation/update. You should definitively have a look at the BaseX Scripts (BXS). You can declare a batch of commands in XML, and ask BaseX to run it : http://docs.basex.org/wiki/Commands#Command_Scripts This is the way to set options before invoking the CREATE-DB command : http://docs.basex.org/wiki/Commands#SET I usually write XQuery to generate a BXS that will do the job. Cordialement, Fabrice CERFrance Poitou-Charentes De : basex-talk-bounces at mailman.uni-konstanz.de<mailto:basex-talk-bounces at mailman.uni-konstanz.de> [mailto:basex-talk-bounces at mailman.uni-konstanz.de<mailto:basex-talk-bounces at mailman.uni-konstanz.de>] De la part de France Baril Envoyé : vendredi 20 octobre 2017 10:44 À : BaseX Objet : [basex-talk] Options for creating database... Hi, I usually create dbs using the gui. I'm now trying to create asb without it to be able to set the updindex and autooptimize options, which I can't find in the GUI. I couldn't figure how to set them out using db:create either, so I switch to command line. Now I'm feeling dumb, I can't find how to set up parsing/indexing options for the command line. I'm looking at: http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and -wchop only. What am I missing? Here are all the options that I'd want to set: let $options := map:merge(( map:entry("CHOP", false()), map:entry('INDENT', false()), map:entry('STRIPNS', false()), map:entry('INTPARSE', true()), map:entry('DTD', false()), map:entry('XINCLUDE', false()), map:entry('UPDINDEX', true()), map:entry('AUTOOPTIMIZE', true()) )) ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only want them to be true() on one of my DBs. Other DBs should remain as is. ​ -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com> -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com>

On Fri, Oct 20, 2017 at 11:47 AM, Fabrice ETANCHAUD < fetanchaud at pch.cerfrance.fr> wrote: > > > > > *De :* Fabrice ETANCHAUD > *Envoyé :* vendredi 20 octobre 2017 11:46 > *À :* 'France Baril' > *Objet :* RE: [basex-talk] Options for creating database... > > > > The XQuery will succeed if you remove the INDENT option (serialization), > and lower case all your option names. > > > > You are right, you may not have a memory overflow issue on creation. > > But I had the problem with db:add with several huge files, before I > switched to BXS. > > > > Best regards, > > Fabrice > > > > *De :* France Baril [mailto:france.baril at architextus.com > <france.baril at architextus.com>] > *Envoyé :* vendredi 20 octobre 2017 11:36 > *À :* Fabrice ETANCHAUD > *Cc :* BaseX > *Objet :* Re: [basex-talk] Options for creating database... > > > > In db:create I don't think the issue is memory. I get: [bxerr:BASX0002] > Unknown database option 'UPDINDEX'. > > > > My function is: > > > > *let **$options* := *map:merge*(( > *map:entry*("CHOP", *false*()), > *map:entry*('INDENT', *false*()), > *map:entry*('STRIPNS', *false*()), > *map:entry*('INTPARSE', *true*()), > *map:entry*('DTD', *false*()), > *map:entry*('XINCLUDE', *false*()), > *map:entry*('UPDINDEX', *true*()), > *map:entry*('AUTOOPTIMIZE', *true*()) > )) > *return *( > *db:create*(*$db-name*, *$src-folder*, (), *$options*), > *db:output*(<div>done</div>) > > ) > > > > > > > > On Fri, Oct 20, 2017 at 11:29 AM, Fabrice ETANCHAUD < > fetanchaud at pch.cerfrance.fr> wrote: > > Bonjour France, > > > > Didn’t you find Updindex and autooptimize options in the ‘Options’ panel > of the db creation window ? > > > > Db:create last parameter is the place to put all your options : > > > > http://docs.basex.org/wiki/Database_Module#db:create > > > > But the Pending update list may overflow memory during db creation/update. > > > > You should definitively have a look at the BaseX Scripts (BXS). > > You can declare a batch of commands in XML, and ask BaseX to run it : > > > > http://docs.basex.org/wiki/Commands#Command_Scripts > > > > This is the way to set options before invoking the CREATE-DB command : > > > > http://docs.basex.org/wiki/Commands#SET > > > > I usually write XQuery to generate a BXS that will do the job. > > > > Cordialement, > > > > Fabrice > > CERFrance Poitou-Charentes > > > > *De :* basex-talk-bounces at mailman.uni-konstanz.de [mailto: > basex-talk-bounces at mailman.uni-konstanz.de] *De la part de* France Baril > *Envoyé :* vendredi 20 octobre 2017 10:44 > *À :* BaseX > *Objet :* [basex-talk] Options for creating database... > > > > Hi, I usually create dbs using the gui. I'm now trying to create asb > without it to be able to set the updindex and autooptimize options, which I > can't find in the GUI. > > > > I couldn't figure how to set them out using db:create either, so I switch > to command line. Now I'm feeling dumb, I can't find how to set up > parsing/indexing options for the command line. I'm looking at: > http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and > -wchop only. > > > > What am I missing? > > > > Here are all the options that I'd want to set: > > > > *let **$options* := *map:merge*(( > *map:entry*("CHOP", *false*()), > *map:entry*('INDENT', *false*()), > *map:entry*('STRIPNS', *false*()), > *map:entry*('INTPARSE', *true*()), > *map:entry*('DTD', *false*()), > *map:entry*('XINCLUDE', *false*()), > *map:entry*('UPDINDEX', *true*()), > *map:entry*('AUTOOPTIMIZE', *true*()) > )) > > > > ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only > want them to be true() on one of my DBs. Other DBs should remain as is. ​ > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com > > > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com >

De : France Baril [mailto:france.baril at architextus.com] Envoyé : vendredi 20 octobre 2017 13:30 À : Fabrice ETANCHAUD Cc : basex-talk at mailman.uni-konstanz.de Objet : Re: [basex-talk] TR: Options for creating database... Ok so the DB gets created. I don't expect to run into issue with large documents since our project is many small snippets. However, I run into another issue: I go into the GUI, I see in Manage database > Information that autooptimize is set to true. I modify a document through a webdav connection. I look in the GUI. My Autooptimize is set to false. I thought that autooptimize would be a persistent value. If I open the db and force optimization, then the autooptimize is set back to true. The 'auto' part of the expression seems to not apply to real life. On Fri, Oct 20, 2017 at 11:47 AM, Fabrice ETANCHAUD <fetanchaud at pch.cerfrance.fr<mailto:fetanchaud at pch.cerfrance.fr>> wrote: De : Fabrice ETANCHAUD Envoyé : vendredi 20 octobre 2017 11:46 À : 'France Baril' Objet : RE: [basex-talk] Options for creating database... The XQuery will succeed if you remove the INDENT option (serialization), and lower case all your option names. You are right, you may not have a memory overflow issue on creation. But I had the problem with db:add with several huge files, before I switched to BXS. Best regards, Fabrice De : France Baril [mailto:france.baril at architextus.com] Envoyé : vendredi 20 octobre 2017 11:36 À : Fabrice ETANCHAUD Cc : BaseX Objet : Re: [basex-talk] Options for creating database... In db:create I don't think the issue is memory. I get: [bxerr:BASX0002] Unknown database option 'UPDINDEX'. My function is: let $options := map:merge(( map:entry("CHOP", false()), map:entry('INDENT', false()), map:entry('STRIPNS', false()), map:entry('INTPARSE', true()), map:entry('DTD', false()), map:entry('XINCLUDE', false()), map:entry('UPDINDEX', true()), map:entry('AUTOOPTIMIZE', true()) )) return ( db:create($db-name, $src-folder, (), $options), db:output(<div>done</div>) ) On Fri, Oct 20, 2017 at 11:29 AM, Fabrice ETANCHAUD <fetanchaud at pch.cerfrance.fr<mailto:fetanchaud at pch.cerfrance.fr>> wrote: Bonjour France, Didn’t you find Updindex and autooptimize options in the ‘Options’ panel of the db creation window ? Db:create last parameter is the place to put all your options : http://docs.basex.org/wiki/Database_Module#db:create But the Pending update list may overflow memory during db creation/update. You should definitively have a look at the BaseX Scripts (BXS). You can declare a batch of commands in XML, and ask BaseX to run it : http://docs.basex.org/wiki/Commands#Command_Scripts This is the way to set options before invoking the CREATE-DB command : http://docs.basex.org/wiki/Commands#SET I usually write XQuery to generate a BXS that will do the job. Cordialement, Fabrice CERFrance Poitou-Charentes De : basex-talk-bounces at mailman.uni-konstanz.de<mailto:basex-talk-bounces at mailman.uni-konstanz.de> [mailto:basex-talk-bounces at mailman.uni-konstanz.de<mailto:basex-talk-bounces at mailman.uni-konstanz.de>] De la part de France Baril Envoyé : vendredi 20 octobre 2017 10:44 À : BaseX Objet : [basex-talk] Options for creating database... Hi, I usually create dbs using the gui. I'm now trying to create asb without it to be able to set the updindex and autooptimize options, which I can't find in the GUI. I couldn't figure how to set them out using db:create either, so I switch to command line. Now I'm feeling dumb, I can't find how to set up parsing/indexing options for the command line. I'm looking at: http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and -wchop only. What am I missing? Here are all the options that I'd want to set: let $options := map:merge(( map:entry("CHOP", false()), map:entry('INDENT', false()), map:entry('STRIPNS', false()), map:entry('INTPARSE', true()), map:entry('DTD', false()), map:entry('XINCLUDE', false()), map:entry('UPDINDEX', true()), map:entry('AUTOOPTIMIZE', true()) )) ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only want them to be true() on one of my DBs. Other DBs should remain as is. ​ -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com> -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com> -- France Baril Architecte documentaire / Documentation architect france.baril at architextus.com<mailto:france.baril at architextus.com>

On Fri, Oct 20, 2017 at 1:33 PM, Fabrice ETANCHAUD < fetanchaud at pch.cerfrance.fr> wrote: > Which version do you use ? > > It seems to me we already heard about that issue, and it was a display > issue in a previous version. > > But I can be wrong. > > > > Best regards, > > > > *De :* France Baril [mailto:france.baril at architextus.com] > *Envoyé :* vendredi 20 octobre 2017 13:30 > *À :* Fabrice ETANCHAUD > *Cc :* basex-talk at mailman.uni-konstanz.de > *Objet :* Re: [basex-talk] TR: Options for creating database... > > > > Ok so the DB gets created. I don't expect to run into issue with large > documents since our project is many small snippets. > > > > However, I run into another issue: I go into the GUI, I see in Manage > database > Information that autooptimize is set to true. I modify a > document through a webdav connection. I look in the GUI. My Autooptimize is > set to false. I thought that autooptimize would be a persistent value. If I > open the db and force optimization, then the autooptimize is set back to > true. The 'auto' part of the expression seems to not apply to real life. > > > > On Fri, Oct 20, 2017 at 11:47 AM, Fabrice ETANCHAUD < > fetanchaud at pch.cerfrance.fr> wrote: > > > > > > *De :* Fabrice ETANCHAUD > *Envoyé :* vendredi 20 octobre 2017 11:46 > *À :* 'France Baril' > *Objet :* RE: [basex-talk] Options for creating database... > > > > The XQuery will succeed if you remove the INDENT option (serialization), > and lower case all your option names. > > > > You are right, you may not have a memory overflow issue on creation. > > But I had the problem with db:add with several huge files, before I > switched to BXS. > > > > Best regards, > > Fabrice > > > > *De :* France Baril [mailto:france.baril at architextus.com > <france.baril at architextus.com>] > *Envoyé :* vendredi 20 octobre 2017 11:36 > *À :* Fabrice ETANCHAUD > *Cc :* BaseX > *Objet :* Re: [basex-talk] Options for creating database... > > > > In db:create I don't think the issue is memory. I get: [bxerr:BASX0002] > Unknown database option 'UPDINDEX'. > > > > My function is: > > > > *let **$options* := *map:merge*(( > *map:entry*("CHOP", *false*()), > *map:entry*('INDENT', *false*()), > *map:entry*('STRIPNS', *false*()), > *map:entry*('INTPARSE', *true*()), > *map:entry*('DTD', *false*()), > *map:entry*('XINCLUDE', *false*()), > *map:entry*('UPDINDEX', *true*()), > *map:entry*('AUTOOPTIMIZE', *true*()) > )) > *return *( > *db:create*(*$db-name*, *$src-folder*, (), *$options*), > *db:output*(<div>done</div>) > > ) > > > > > > > > On Fri, Oct 20, 2017 at 11:29 AM, Fabrice ETANCHAUD < > fetanchaud at pch.cerfrance.fr> wrote: > > Bonjour France, > > > > Didn’t you find Updindex and autooptimize options in the ‘Options’ panel > of the db creation window ? > > > > Db:create last parameter is the place to put all your options : > > > > http://docs.basex.org/wiki/Database_Module#db:create > > > > But the Pending update list may overflow memory during db creation/update. > > > > You should definitively have a look at the BaseX Scripts (BXS). > > You can declare a batch of commands in XML, and ask BaseX to run it : > > > > http://docs.basex.org/wiki/Commands#Command_Scripts > > > > This is the way to set options before invoking the CREATE-DB command : > > > > http://docs.basex.org/wiki/Commands#SET > > > > I usually write XQuery to generate a BXS that will do the job. > > > > Cordialement, > > > > Fabrice > > CERFrance Poitou-Charentes > > > > *De :* basex-talk-bounces at mailman.uni-konstanz.de [mailto: > basex-talk-bounces at mailman.uni-konstanz.de] *De la part de* France Baril > *Envoyé :* vendredi 20 octobre 2017 10:44 > *À :* BaseX > *Objet :* [basex-talk] Options for creating database... > > > > Hi, I usually create dbs using the gui. I'm now trying to create asb > without it to be able to set the updindex and autooptimize options, which I > can't find in the GUI. > > > > I couldn't figure how to set them out using db:create either, so I switch > to command line. Now I'm feeling dumb, I can't find how to set up > parsing/indexing options for the command line. I'm looking at: > http://docs.basex.org/wiki/Command-Line_Options. I found -sindent and > -wchop only. > > > > What am I missing? > > > > Here are all the options that I'd want to set: > > > > *let **$options* := *map:merge*(( > *map:entry*("CHOP", *false*()), > *map:entry*('INDENT', *false*()), > *map:entry*('STRIPNS', *false*()), > *map:entry*('INTPARSE', *true*()), > *map:entry*('DTD', *false*()), > *map:entry*('XINCLUDE', *false*()), > *map:entry*('UPDINDEX', *true*()), > *map:entry*('AUTOOPTIMIZE', *true*()) > )) > > > > ​I don't want to set UPDINDEX and AUTOOPTIMIZE in .basex because I only > want them to be true() on one of my DBs. Other DBs should remain as is. ​ > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com > > > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com > > > > > > -- > > France Baril > Architecte documentaire / Documentation architect > france.baril at architextus.com >