Spatial XQuery?

> Hi, > > > > Our company evaluates BaseX for our project. > > A new requirement is to show spatial data with a geographic information > system. > > Are there any plans for a spatial xquery module for querying GML like the > (experimental) module in eXist? > > http://exist-db.org/extensions.html#module_spatial > > > > Regards, Ingo > > > > Dr. Karb Informationstechnologien > Im Wolfer 10 > 70599 Stuttgart > Tel.: 0711 - 4 51 24 – 70 > Fax: 0711 - 4 51 24 – 55 > Web: http://www.karb.de > Mail: schildmann at karb.de > Skype: ischildmann > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

> That is a great question. > > I tried to import a sub set of the OpenStreetMap planet file (just > germany) which is about 2 GB (bz2 compressed) in size into a basex database. > Unfortunately, after 5% or the like, and this took almost over an hour (I > am using an i7/4GB machine, I aborted the procedure. > I am sure with spatial data types support, this procedure can be > simplified/optimized a lot... > Having said this, I would be interested in using basex as a backend for > GIS data, too :-) > > > [Forgot to "reply to all", i.e. this message was already sent to Ingo] > > 2012/1/2 Schildmann, Ingo <Schildmann at karb.de> > >> Hi, >> >> >> >> Our company evaluates BaseX for our project. >> >> A new requirement is to show spatial data with a geographic information >> system. >> >> Are there any plans for a spatial xquery module for querying GML like the >> (experimental) module in eXist? >> >> http://exist-db.org/extensions.html#module_spatial >> >> >> >> Regards, Ingo >> >> >> >> Dr. Karb Informationstechnologien >> Im Wolfer 10 >> 70599 Stuttgart >> Tel.: 0711 - 4 51 24 – 70 >> Fax: 0711 - 4 51 24 – 55 >> Web: http://www.karb.de >> Mail: schildmann at karb.de >> Skype: ischildmann >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk at mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> > > > -- > 1 + 1 = 10 > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

On Tue, Jan 3, 2012 at 6:04 AM, Jan Vlčinský (CAD) < jan.vlcinsky at cad-programs.com> wrote: > Hi all > I would be too interested in this type of feature (geospacial indexes). > This leads to more general feature: schema aware processing. Currently (as > far as I know) the dateTime values are indexed as strings, what is in many > cases quite inefficient. Knowing the type of the value and using related > type of index could lead to much more efficient queries. > > On the other hand we must accept, that this type of feature brings quite > some complexity - e.g. one has to provide schemas for the data, what to do, > if some xml file is not following the schema etc. > > It reminds me my old CAD programming times - my client told me, "stay in > 2D as long as you can, 3D is not adding but multiplexing the complexity of > the work". > > This said I would completely understand BaseX team sticking with current > "easy" way of doing things. > > With best regards > > Jan > > *Ing. Jan Vlčinský* > CAD programy > Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic > tel: +420-597 602 024; mob: +420-608 979 040 > skype: janvlcinsky; GoogleTalk: jan.vlcinsky at gmail.com > http://cz.linkedin.com/in/vlcinsky > > > > On 3 January 2012 10:45, Erdal Karaca <erdal.karaca.de at googlemail.com>wrote: > >> That is a great question. >> >> I tried to import a sub set of the OpenStreetMap planet file (just >> germany) which is about 2 GB (bz2 compressed) in size into a basex database. >> Unfortunately, after 5% or the like, and this took almost over an hour (I >> am using an i7/4GB machine, I aborted the procedure. >> I am sure with spatial data types support, this procedure can be >> simplified/optimized a lot... >> Having said this, I would be interested in using basex as a backend for >> GIS data, too :-) >> >> >> [Forgot to "reply to all", i.e. this message was already sent to Ingo] >> >> 2012/1/2 Schildmann, Ingo <Schildmann at karb.de> >> >>> Hi, >>> >>> >>> >>> Our company evaluates BaseX for our project. >>> >>> A new requirement is to show spatial data with a geographic information >>> system. >>> >>> Are there any plans for a spatial xquery module for querying GML like >>> the (experimental) module in eXist? >>> >>> http://exist-db.org/extensions.html#module_spatial >>> >>> >>> >>> Regards, Ingo >>> >>> >>> >>> Dr. Karb Informationstechnologien >>> Im Wolfer 10 >>> 70599 Stuttgart >>> Tel.: 0711 - 4 51 24 - 70 >>> Fax: 0711 - 4 51 24 - 55 >>> Web: http://www.karb.de >>> Mail: schildmann at karb.de >>> Skype: ischildmann >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk at mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>> >>> >> >> >> -- >> 1 + 1 = 10 >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk at mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann at karb.de> wrote: > Hi, > > > Our company evaluates BaseX for our project. > > A new requirement is to show spatial data with a geographic information > system. > > Are there any plans for a spatial xquery module for querying GML like > the (experimental) module in eXist? > > http://exist-db.org/extensions.html#module_spatial > > > Regards, Ingo > > > Dr. Karb Informationstechnologien > Im Wolfer 10 > 70599 Stuttgart > Tel.: 0711 - 4 51 24 - 70 > Fax: 0711 - 4 51 24 - 55 > Web: http://www.karb.de <http://www.karb.de/> > Mail: schildmann at karb.de <mailto:schildmann at karb.de> > Skype: ischildmann > > > > > > > > > > > > > > > > > > >

On Fri, Jan 6, 2012 at 10:55 AM, Rositsa Shadura < rositsa.shadura at uni-konstanz.de> wrote: > Hi Ingo, hi all, > > until now we at BaseX have not discussed the implementation of a > geospatial API. However, I would like to ask you what is actually your > requirement: a module which provides functions for querying spatial data or > a feature for indexing such data or both? :) > I ask because the replies from Jan and Erdal referred to indexes, while > this from Eric was more about a module for querying such data. > Currently there is a specification provided by EXPath[1] which defines an > extensive geospatial API. The only implementation of this specification is, > as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] > and MarkLogic[4] do not follow it or provide just a subset of the functions > in it. Do you think that an implementation of the EXPath geospatial API > would be useful for you? > > Regards, > Rositsa > > [1] http://expath.org/spec/geo > [2] http://zorba-xquery.com/site2/**doc/latest/zorba/xqdoc/xhtml/** > expath.org_ns_geo.html<http://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo.html> > [3] http://demo.exist-db.org/**exist/functions/spatial<http://demo.exist-db.org/exist/functions/spatial> > [4] http://developer.marklogic.**com/pubs/4.0/apidocs/GEO.html<http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html> > > > > On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann at karb.de> > wrote: > > Hi, >> >> >> Our company evaluates BaseX for our project. >> >> A new requirement is to show spatial data with a geographic information >> system. >> >> Are there any plans for a spatial xquery module for querying GML like >> the (experimental) module in eXist? >> >> http://exist-db.org/**extensions.html#module_spatial<http://exist-db.org/extensions.html#module_spatial> >> >> >> Regards, Ingo >> >> >> Dr. Karb Informationstechnologien >> Im Wolfer 10 >> 70599 Stuttgart >> Tel.: 0711 - 4 51 24 - 70 >> Fax: 0711 - 4 51 24 - 55 >> Web: http://www.karb.de <http://www.karb.de/> >> Mail: schildmann at karb.de <mailto:schildmann at karb.de> >> Skype: ischildmann >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > > -- > Using Opera's revolutionary email client: http://www.opera.com/mail/ > > ______________________________**_________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-**konstanz.de <BaseX-Talk at mailman.uni-konstanz.de> > https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talk<https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> >

On Mon, Jan 2, 2012 at 6:07 PM, Schildmann, Ingo <Schildmann at karb.de> wrote: > Hi, **** > > ** ** > > Our company evaluates BaseX for our project. **** > > A new requirement is to show spatial data with a geographic information > system.**** > > Are there any plans for a spatial xquery module for querying GML like the > (experimental) module in eXist?**** > > http://exist-db.org/extensions.html#module_spatial**** > > ** ** > > Regards, Ingo**** > > ** ** > > Dr. Karb Informationstechnologien > Im Wolfer 10 > 70599 Stuttgart > Tel.: 0711 - 4 51 24 – 70 > Fax: 0711 - 4 51 24 – 55 > Web: http://www.karb.de > Mail: schildmann at karb.de > Skype: ischildmann**** > > **** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > ** ** > > **** > > ** ** > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

On Tue, Jan 3, 2012 at 10:45 AM, Erdal Karaca < erdal.karaca.de at googlemail.com> wrote: > That is a great question. > > I tried to import a sub set of the OpenStreetMap planet file (just > germany) which is about 2 GB (bz2 compressed) in size into a basex database. > Unfortunately, after 5% or the like, and this took almost over an hour (I > am using an i7/4GB machine, I aborted the procedure. > I am sure with spatial data types support, this procedure can be > simplified/optimized a lot... > Having said this, I would be interested in using basex as a backend for > GIS data, too :-) > > > [Forgot to "reply to all", i.e. this message was already sent to Ingo] > > 2012/1/2 Schildmann, Ingo <Schildmann at karb.de> > >> Hi, >> >> >> >> Our company evaluates BaseX for our project. >> >> A new requirement is to show spatial data with a geographic information >> system. >> >> Are there any plans for a spatial xquery module for querying GML like the >> (experimental) module in eXist? >> >> http://exist-db.org/extensions.html#module_spatial >> >> >> >> Regards, Ingo >> >> >> >> Dr. Karb Informationstechnologien >> Im Wolfer 10 >> 70599 Stuttgart >> Tel.: 0711 - 4 51 24 – 70 >> Fax: 0711 - 4 51 24 – 55 >> Web: http://www.karb.de >> Mail: schildmann at karb.de >> Skype: ischildmann >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk at mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> > > > -- > 1 + 1 = 10 > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >

> This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries.

> Erdal, > > thanks for your report. How large was the total, uncompressed size of the > file you were reading in? > > Christian > ___________________________ > > > On Tue, Jan 3, 2012 at 10:45 AM, Erdal Karaca < > erdal.karaca.de at googlemail.com> wrote: > >> That is a great question. >> >> I tried to import a sub set of the OpenStreetMap planet file (just >> germany) which is about 2 GB (bz2 compressed) in size into a basex database. >> Unfortunately, after 5% or the like, and this took almost over an hour (I >> am using an i7/4GB machine, I aborted the procedure. >> I am sure with spatial data types support, this procedure can be >> simplified/optimized a lot... >> Having said this, I would be interested in using basex as a backend for >> GIS data, too :-) >> >> >> [Forgot to "reply to all", i.e. this message was already sent to Ingo] >> >> 2012/1/2 Schildmann, Ingo <Schildmann at karb.de> >> >>> Hi, >>> >>> >>> >>> Our company evaluates BaseX for our project. >>> >>> A new requirement is to show spatial data with a geographic information >>> system. >>> >>> Are there any plans for a spatial xquery module for querying GML like >>> the (experimental) module in eXist? >>> >>> http://exist-db.org/extensions.html#module_spatial >>> >>> >>> >>> Regards, Ingo >>> >>> >>> >>> Dr. Karb Informationstechnologien >>> Im Wolfer 10 >>> 70599 Stuttgart >>> Tel.: 0711 - 4 51 24 – 70 >>> Fax: 0711 - 4 51 24 – 55 >>> Web: http://www.karb.de >>> Mail: schildmann at karb.de >>> Skype: ischildmann >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk at mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>> >>> >> >> >> -- >> 1 + 1 = 10 >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk at mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >

> 20 GB uncompressed. > FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD

Am Samstag, 7. Januar 2012, 17:03:40 schrieb Christian Grün: > > 20 GB uncompressed. > > FYI/Hint: Here is a mapping of the OSM xml structure: > > http://wiki.openstreetmap.org/wiki/API_v0.6/XSD > Thanks. Out of interest: at what stage did BaseX stop the import? Do > you have a link to the original file?

> _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

> Hi Ingo, hi all, > > until now we at BaseX have not discussed the implementation of a > geospatial API. However, I would like to ask you what is actually your > requirement: a module which provides functions for querying spatial data or > a feature for indexing such data or both? :) > I ask because the replies from Jan and Erdal referred to indexes, while > this from Eric was more about a module for querying such data. > Currently there is a specification provided by EXPath[1] which defines an > extensive geospatial API. The only implementation of this specification is, > as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] > and MarkLogic[4] do not follow it or provide just a subset of the functions > in it. Do you think that an implementation of the EXPath geospatial API > would be useful for you? > > Regards, > Rositsa > > [1] http://expath.org/spec/geo > [2] http://zorba-xquery.com/site2/**doc/latest/zorba/xqdoc/xhtml/** > expath.org_ns_geo.html<http://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo.html> > [3] http://demo.exist-db.org/**exist/functions/spatial<http://demo.exist-db.org/exist/functions/spatial> > [4] http://developer.marklogic.**com/pubs/4.0/apidocs/GEO.html<http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html> > > > > On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann at karb.de> > wrote: > > Hi, >> >> >> Our company evaluates BaseX for our project. >> >> A new requirement is to show spatial data with a geographic information >> system. >> >> Are there any plans for a spatial xquery module for querying GML like >> the (experimental) module in eXist? >> >> http://exist-db.org/**extensions.html#module_spatial<http://exist-db.org/extensions.html#module_spatial> >> >> >> Regards, Ingo >> >> >> Dr. Karb Informationstechnologien >> Im Wolfer 10 >> 70599 Stuttgart >> Tel.: 0711 - 4 51 24 - 70 >> Fax: 0711 - 4 51 24 - 55 >> Web: http://www.karb.de <http://www.karb.de/> >> Mail: schildmann at karb.de <mailto:schildmann at karb.de> >> Skype: ischildmann >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> > > -- > Using Opera's revolutionary email client: http://www.opera.com/mail/ > > ______________________________**_________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-**konstanz.de <BaseX-Talk at mailman.uni-konstanz.de> > https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talk<https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk> >