archive
Hi!
Because of the size, is there a way to store xml-data as archive (with possibility to search) ?
Quoted text · Ветошкин Владимир · 1 line
> Because of the size, is there a way to store xml-data as archive
If you want to compress your XML documents with XQuery, you can have a look at the Archive or ZIP Module of BaseX. I am not sure, however, if this is what you are looking for?
Quoted text · Ветошкин Владимир · 1 line
> (with possibility to search) ?
The BaseX implementation of fn:doc() and fn:collection() supports zipped files as arguments. The contents will be unzipped automatically:
collection('my-xml-files.zip')If you create databases, you can specify ZIP files as input, too.
I can compress xml-data and store it in db. But then how can I search inside that db using index? Is it possible?
Quoted text · Christian Grün · 17 lines
22.08.2018, 17:28, "Christian Grün" <christian.gruen at gmail.com>: > > Because of the size, is there a way to store xml-data as archive > > If you want to compress your XML documents with XQuery, you can have a > look at the Archive or ZIP Module of BaseX. I am not sure, however, if > this is what you are looking for? > > > > (with possibility to search) ? > > The BaseX implementation of fn:doc() and fn:collection() supports > zipped files as arguments. The contents will be unzipped > automatically: > > collection('my-xml-files.zip') > > If you create databases, you can specify ZIP files as input, too.
Quoted text · Ветошкин Владимир · 2 lines
> I can compress xml-data and store it in db. > But then how can I search inside that db using index? Is it possible?
I am not sure if I understand. How do you proceed? Could you possibly give us a step-by-step explanation?
Hi Vladimir,
If your question is : is there a compression option to reduce database files and use built-in index features ? the answer is no. I can remember that BaseX use custom compression for text nodes. [1]
Christian, I hope you are doing well ? Did I loose my mind or Did BaseX have a long time ago a compressed database option ?
Best regards,
[1] http://basex.org/2018/03/23/basex-9.0--the-spring-edition/
BaseX
-----Message d'origine-----
Quoted text · Christian Grün · 9 lines
De : BaseX-Talk [mailto:basex-talk-bounces at mailman.uni-konstanz.de] De la part de Christian Grün Envoyé : mercredi 22 août 2018 17:08 À : Ветошкин Владимир Cc : BaseX Objet : Re: [basex-talk] archive > I can compress xml-data and store it in db. > But then how can I search inside that db using index? Is it possible? I am not sure if I understand. How do you proceed? Could you possibly give us a step-by-step explanation?
Hi Fabrice,
Thanks for your response to Vladimir.
You are completely right, BaseX has its own compression algorithms (without compression, databases would be much larger). Due to the query update facilities and additional index structures, a database will always cosume more space than zipped XML documents.
Cheers Christian
Quoted text · Fabrice ETANCHAUD · 31 lines
On Wed, Aug 22, 2018 at 5:24 PM Fabrice ETANCHAUD <fetanchaud at pch.cerfrance.fr> wrote: > > Hi Vladimir, > > If your question is : is there a compression option to reduce database files and use built-in index features ? the answer is no. > I can remember that BaseX use custom compression for text nodes. [1] > > Christian, I hope you are doing well ? > Did I loose my mind or Did BaseX have a long time ago a compressed database option ? > > Best regards, > > [1] http://basex.org/2018/03/23/basex-9.0--the-spring-edition/ > > > BaseX > > > -----Message d'origine----- > De : BaseX-Talk [mailto:basex-talk-bounces at mailman.uni-konstanz.de] De la part de Christian Grün > Envoyé : mercredi 22 août 2018 17:08 > À : Ветошкин Владимир > Cc : BaseX > Objet : Re: [basex-talk] archive > > > I can compress xml-data and store it in db. > > But then how can I search inside that db using index? Is it possible? > > I am not sure if I understand. How do you proceed? Could you possibly > give us a step-by-step explanation?
Fabrice, Christian, I hope you are all doing well! :)Thank you for your answers! And I work on my english)
Quoted text · Christian Grün · 46 lines
22.08.2018, 18:31, "Christian Grün" <christian.gruen at gmail.com>: > Hi Fabrice, > > Thanks for your response to Vladimir. > > You are completely right, BaseX has its own compression algorithms > (without compression, databases would be much larger). Due to the > query update facilities and additional index structures, a database > will always cosume more space than zipped XML documents. > > Cheers > Christian > > > On Wed, Aug 22, 2018 at 5:24 PM Fabrice ETANCHAUD > <fetanchaud at pch.cerfrance.fr> wrote: > > > > Hi Vladimir, > > > > If your question is : is there a compression option to reduce database files and use built-in index features ? the answer is no. > > I can remember that BaseX use custom compression for text nodes. [1] > > > > Christian, I hope you are doing well ? > > Did I loose my mind or Did BaseX have a long time ago a compressed database option ? > > > > Best regards, > > > > [1] http://basex.org/2018/03/23/basex-9.0--the-spring-edition/ > > > > > > BaseX > > > > > > -----Message d'origine----- > > De : BaseX-Talk [mailto:basex-talk-bounces at mailman.uni-konstanz.de] De la part de Christian Grün > > Envoyé : mercredi 22 août 2018 17:08 > > À : Ветошкин Владимир > > Cc : BaseX > > Objet : Re: [basex-talk] archive > > > > > I can compress xml-data and store it in db. > > > But then how can I search inside that db using index? Is it possible? > > > > I am not sure if I understand. How do you proceed? Could you possibly > > give us a step-by-step explanation?
This possibility to open zipped XMLs via doc() is awesome.
Universität Leipzig Institute of Computer Science, NLP Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano at informatik.uni-leipzig.de E-mail: giuseppegacelano at gmail.com Web site 1: http://asv.informatik.uni-leipzig.de/en/staff/Giuseppe_Celano Web site 2: https://sites.google.com/site/giuseppegacelano/
Quoted text · Christian Grün · 17 lines
> On Aug 22, 2018, at 4:28 PM, Christian Grün <christian.gruen at gmail.com> wrote: > >> Because of the size, is there a way to store xml-data as archive > > If you want to compress your XML documents with XQuery, you can have a > look at the Archive or ZIP Module of BaseX. I am not sure, however, if > this is what you are looking for? > >> (with possibility to search) ? > > The BaseX implementation of fn:doc() and fn:collection() supports > zipped files as arguments. The contents will be unzipped > automatically: > > collection('my-xml-files.zip') > > If you create databases, you can specify ZIP files as input, too.
Written for BaseX 9.0. BaseX may have changed since: please check the current documentation.