Hi, Our company evaluates BaseX for our project. A new requirement is to show spatial data with a geographic information system. Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist? http://exist-db.org/extensions.html#module_spatial Regards, Ingo Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de <http://www.karb.de/> Mail: schildmann@karb.de <mailto:schildmann@karb.de> Skype: ischildmann
That is a great question. I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-) [Forgot to "reply to all", i.e. this message was already sent to Ingo] 2012/1/2 Schildmann, Ingo <Schildmann@karb.de>
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
Hi all I would be too interested in this type of feature (geospacial indexes). This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries. On the other hand we must accept, that this type of feature brings quite some complexity - e.g. one has to provide schemas for the data, what to do, if some xml file is not following the schema etc. It reminds me my old CAD programming times - my client told me, "stay in 2D as long as you can, 3D is not adding but multiplexing the complexity of the work". This said I would completely understand BaseX team sticking with current "easy" way of doing things. With best regards Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky@gmail.com http://cz.linkedin.com/in/vlcinsky On 3 January 2012 10:45, Erdal Karaca <erdal.karaca.de@googlemail.com>wrote:
That is a great question.
I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)
[Forgot to "reply to all", i.e. this message was already sent to Ingo]
2012/1/2 Schildmann, Ingo <Schildmann@karb.de>
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
FYI, MarkLogic has very good geospatial support: http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html Maybe these APIs could be used as a model for an implementation in BaseX. Eric On Tue, Jan 3, 2012 at 6:04 AM, Jan Vlčinský (CAD) < jan.vlcinsky@cad-programs.com> wrote:
Hi all I would be too interested in this type of feature (geospacial indexes). This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries.
On the other hand we must accept, that this type of feature brings quite some complexity - e.g. one has to provide schemas for the data, what to do, if some xml file is not following the schema etc.
It reminds me my old CAD programming times - my client told me, "stay in 2D as long as you can, 3D is not adding but multiplexing the complexity of the work".
This said I would completely understand BaseX team sticking with current "easy" way of doing things.
With best regards
Jan
*Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky@gmail.com http://cz.linkedin.com/in/vlcinsky
On 3 January 2012 10:45, Erdal Karaca <erdal.karaca.de@googlemail.com>wrote:
That is a great question.
I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)
[Forgot to "reply to all", i.e. this message was already sent to Ingo]
2012/1/2 Schildmann, Ingo <Schildmann@karb.de>
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Hi Jan,
This leads to more general feature: schema aware processing. Currently (as far as I know) the dateTime values are indexed as strings, what is in many cases quite inefficient. Knowing the type of the value and using related type of index could lead to much more efficient queries.
this is something we may want to tackle with the next major update of the database layout (BaseX 8.0). We can't promise, though, if we'll introduce schema aware processing. Instead, we'll rather improve our runtime analysis of incoming data, and store it the most efficient way, and the optimizations will also work for documents without schema information. What kind of geospatial queries (EXPath vs MarkLogic vs eXist) would you like to see introduced? Christian
Erdal, thanks for your report. How large was the total, uncompressed size of the file you were reading in? Christian ___________________________ On Tue, Jan 3, 2012 at 10:45 AM, Erdal Karaca < erdal.karaca.de@googlemail.com> wrote:
That is a great question.
I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)
[Forgot to "reply to all", i.e. this message was already sent to Ingo]
2012/1/2 Schildmann, Ingo <Schildmann@karb.de>
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
20 GB uncompressed. FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD 2012/1/7 Christian Grün <christian.gruen@gmail.com>
Erdal,
thanks for your report. How large was the total, uncompressed size of the file you were reading in?
Christian ___________________________
On Tue, Jan 3, 2012 at 10:45 AM, Erdal Karaca < erdal.karaca.de@googlemail.com> wrote:
That is a great question.
I tried to import a sub set of the OpenStreetMap planet file (just germany) which is about 2 GB (bz2 compressed) in size into a basex database. Unfortunately, after 5% or the like, and this took almost over an hour (I am using an i7/4GB machine, I aborted the procedure. I am sure with spatial data types support, this procedure can be simplified/optimized a lot... Having said this, I would be interested in using basex as a backend for GIS data, too :-)
[Forgot to "reply to all", i.e. this message was already sent to Ingo]
2012/1/2 Schildmann, Ingo <Schildmann@karb.de>
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- 1 + 1 = 10
20 GB uncompressed. FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD
Thanks. Out of interest: at what stage did BaseX stop the import? Do you have a link to the original file?
Am Samstag, 7. Januar 2012, 17:03:40 schrieb Christian Grün:
20 GB uncompressed. FYI/Hint: Here is a mapping of the OSM xml structure: http://wiki.openstreetmap.org/wiki/API_v0.6/XSD Thanks. Out of interest: at what stage did BaseX stop the import? Do you have a link to the original file?
I found this: http://download.geofabrik.de/osm/europe/germany.osm.bz2
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Hi Ingo, hi all, until now we at BaseX have not discussed the implementation of a geospatial API. However, I would like to ask you what is actually your requirement: a module which provides functions for querying spatial data or a feature for indexing such data or both? :) I ask because the replies from Jan and Erdal referred to indexes, while this from Eric was more about a module for querying such data. Currently there is a specification provided by EXPath[1] which defines an extensive geospatial API. The only implementation of this specification is, as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] and MarkLogic[4] do not follow it or provide just a subset of the functions in it. Do you think that an implementation of the EXPath geospatial API would be useful for you? Regards, Rositsa [1] http://expath.org/spec/geo [2] http://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo... [3] http://demo.exist-db.org/exist/functions/spatial [4] http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann@karb.de> wrote:
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
http://exist-db.org/extensions.html#module_spatial
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de <http://www.karb.de/> Mail: schildmann@karb.de <mailto:schildmann@karb.de> Skype: ischildmann
-- Using Opera's revolutionary email client: http://www.opera.com/mail/
Would be nice to have KML support in addition to GML, but I suppose there are tools to support GML use with Google Maps, for example: http://www.dyasdesigns.com/geoxml/ MarkLogic supports multiple formats: The Geo module provides support for geospatial queries using GML, KML, GeoRSS/Simple, or Metacarta Geospatial markup. Sure would be exciting to have geospatial in BaseX! Eric On Fri, Jan 6, 2012 at 10:55 AM, Rositsa Shadura < rositsa.shadura@uni-konstanz.de> wrote:
Hi Ingo, hi all,
until now we at BaseX have not discussed the implementation of a geospatial API. However, I would like to ask you what is actually your requirement: a module which provides functions for querying spatial data or a feature for indexing such data or both? :) I ask because the replies from Jan and Erdal referred to indexes, while this from Eric was more about a module for querying such data. Currently there is a specification provided by EXPath[1] which defines an extensive geospatial API. The only implementation of this specification is, as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] and MarkLogic[4] do not follow it or provide just a subset of the functions in it. Do you think that an implementation of the EXPath geospatial API would be useful for you?
Regards, Rositsa
[1] http://expath.org/spec/geo [2] http://zorba-xquery.com/site2/**doc/latest/zorba/xqdoc/xhtml/** expath.org_ns_geo.html<http://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo.html> [3] http://demo.exist-db.org/**exist/functions/spatial<http://demo.exist-db.org/exist/functions/spatial> [4] http://developer.marklogic.**com/pubs/4.0/apidocs/GEO.html<http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html>
On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann@karb.de> wrote:
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de <http://www.karb.de/> Mail: schildmann@karb.de <mailto:schildmann@karb.de> Skype: ischildmann
-- Using Opera's revolutionary email client: http://www.opera.com/mail/
______________________________**_________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-**konstanz.de <BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talk<https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk>
Hi all All my talks about indexing were based on (my) assumption, that efficient querying (what is the core case I am looking forward) requires existence of an index. Frankly speaking - I am mostly interested in querying - if it goes fast enough without any index, I do not mind the difference. My geo - interest is rather general one - we sometime produce and analyse GeoRSS files, sometime KML files - so far without any direct use of the spacial information by BaseX XQuery. Thinks I would think of are: - selecting elements in some region, inside of a buffer etc. - calculating distance of a point to some line segment - converting coordinates between different systems (like S-JTSK and WGS84 - converting linear geometries between GeoRSS and KML Checking http://expath.org/spec/geo shows, there are many features, which would be great for most of my wishes (if not all) With best regards Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky@gmail.com http://cz.linkedin.com/in/vlcinsky On 6 January 2012 16:55, Rositsa Shadura <rositsa.shadura@uni-konstanz.de>wrote:
Hi Ingo, hi all,
until now we at BaseX have not discussed the implementation of a geospatial API. However, I would like to ask you what is actually your requirement: a module which provides functions for querying spatial data or a feature for indexing such data or both? :) I ask because the replies from Jan and Erdal referred to indexes, while this from Eric was more about a module for querying such data. Currently there is a specification provided by EXPath[1] which defines an extensive geospatial API. The only implementation of this specification is, as far as I know, this provided by Zorba[2]. The ones offerred by eXist[3] and MarkLogic[4] do not follow it or provide just a subset of the functions in it. Do you think that an implementation of the EXPath geospatial API would be useful for you?
Regards, Rositsa
[1] http://expath.org/spec/geo [2] http://zorba-xquery.com/site2/**doc/latest/zorba/xqdoc/xhtml/** expath.org_ns_geo.html<http://zorba-xquery.com/site2/doc/latest/zorba/xqdoc/xhtml/expath.org_ns_geo.html> [3] http://demo.exist-db.org/**exist/functions/spatial<http://demo.exist-db.org/exist/functions/spatial> [4] http://developer.marklogic.**com/pubs/4.0/apidocs/GEO.html<http://developer.marklogic.com/pubs/4.0/apidocs/GEO.html>
On Mon, 02 Jan 2012 18:07:17 +0100, Schildmann, Ingo <Schildmann@karb.de> wrote:
Hi,
Our company evaluates BaseX for our project.
A new requirement is to show spatial data with a geographic information system.
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?
Regards, Ingo
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 - 70 Fax: 0711 - 4 51 24 - 55 Web: http://www.karb.de <http://www.karb.de/> Mail: schildmann@karb.de <mailto:schildmann@karb.de> Skype: ischildmann
-- Using Opera's revolutionary email client: http://www.opera.com/mail/
______________________________**_________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-**konstanz.de <BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.**de/mailman/listinfo/basex-talk<https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk>
Dear Ingo, Rosi has already summarized the main challenge: there are lots of different approaches that revolve around spatial querying. Did you already have a quick look at the EXPath module, and do you think it might be helpful in your scenario? I cannot give details when we will actually be able to tackle the issue. However, you are invited to offer financial support for this feature, which will give it a higher priority. Feel free to ask for more. Christian ___________________________ On Mon, Jan 2, 2012 at 6:07 PM, Schildmann, Ingo <Schildmann@karb.de> wrote:
Hi, ****
** **
Our company evaluates BaseX for our project. ****
A new requirement is to show spatial data with a geographic information system.****
Are there any plans for a spatial xquery module for querying GML like the (experimental) module in eXist?****
http://exist-db.org/extensions.html#module_spatial****
** **
Regards, Ingo****
** **
Dr. Karb Informationstechnologien Im Wolfer 10 70599 Stuttgart Tel.: 0711 - 4 51 24 – 70 Fax: 0711 - 4 51 24 – 55 Web: http://www.karb.de Mail: schildmann@karb.de Skype: ischildmann****
****
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
** **
****
** **
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
participants (7)
-
Christian Grün -
Dimitar Popov -
Erdal Karaca -
Eric Murphy -
Jan Vlčinský (CAD) -
Rositsa Shadura -
Schildmann, Ingo