BaseX-Talk June 2016

basex-talk@mailman.uni-konstanz.de

35 participants
40 discussions

Geo Module Help
by George Sofianos 18 Jun '16

18 Jun '16

I have some XML files with geographical data. I can see they are using "http://www.opengis.net/gml/3.2" for the gml namespace. If I try to run some geo functions I get the error: [experr:GEO0001] Unrecognized Geo type: Point If I change the gml namespace to "http://www.opengis.net/gml" it runs fine. I don't know if it has to be fixed on the data level or it is something that BaseX needs to take care of. It's my first time I have to deal with XML geo data, so I'm clueless at the moment. Any thoughts? Thanks

2 1

Extracting namespace from xml
by Henning Phan 18 Jun '16

18 Jun '16

Hello, When using basexgui, after opening a database and go to properties and then information one can see all the namespaces in the document. When not using the gui how does one extract the same information? Been reading the wiki but I have not been able to find a module or a function that accomplish exactly that. Also Im trying to use the information from index:facets("db") to create a simple visual interface so users, without xquery knowledge, can click on nodes and add filters and those choices are then translated into xquery commands. Any information in this area would greatly appreciated. - Henning Virusfritt. www.avast.com

2 1

REPO INSTALL fails without error
by Felix Wolf 18 Jun '16

18 Jun '16

Hello everybody, i am trying to install the javamail's jar into the repo: -- terminal snip -- basex [gaia] [~/basex] > basexclient BaseX 8.4.1 [Client] Try 'help' to get more information. > repo install /home/basex/install/javamail-1.4.2/mail.jar Package '/home/basex/install/javamail-1.4.2/mail.jar' installed in 0.43 ms. > repo list Name Version Type Path -------------------------------------------------------------------- ij.ImageJ - Internal ij/ImageJ.jar -- terminal snap -- It looks like it succeeds but does not do anything!? Is there a good way to debug this issue? Are there plans to develope/release an office mail module? Thanks and regards Felix

2 1

Long time to execute XQuery
by Sam Eklund 18 Jun '16

18 Jun '16

I have a database where a couple of clients perform querys with a fairly rapid response, however sometimes the querys take EXTREMLY long time to execute, and I wonder why. Do you have any pointers for me on where to look, what to do? In this excercept from the log you'll see that the first query in the log was executed with a normal response time, however, when the same query is made later (at about 00.28.03 by Mediacollection) it times out. At around 00.28.03 there is also another query made by another machine(VentuzTV4A), and its response time ends up just below 10s. To me it seems the queryprocessor is not queuing up the querys in a good fashion, or do any of you have another view of the problem? Best regards, Sam Log below: ----------------------------------------------------------------------- 00:18:01.388 0:0:0:0:0:0:0:1:58557 MediaCollection REQUEST OPEN tv4 0.27 ms 00:18:01.388 0:0:0:0:0:0:0:1:58557 MediaCollection OK Database 'tv4' was opened in 0.05 ms. 0.4 ms 00:18:01.388 0:0:0:0:0:0:0:1:58557 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139482"]) [last()] 0.19 ms 00:18:01.575 0:0:0:0:0:0:0:1:58557 MediaCollection OK Query executed in 191.63 ms. 192.0 ms 00:18:01.575 0:0:0:0:0:0:0:1:58557 MediaCollection REQUEST EXIT 0.15 ms 00:18:01.575 0:0:0:0:0:0:0:1:58557 MediaCollection OK 0.36 ms 00:27:41.538 0:0:0:0:0:0:0:1:58625 MediaCollection OK Database 'tv4' was opened in 0.05 ms. 0.41 ms 00:27:41.538 0:0:0:0:0:0:0:1:58625 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139699"]) [last()] 0.19 ms 00:27:41.725 0:0:0:0:0:0:0:1:58625 MediaCollection OK Query executed in 193.58 ms. 193.94 ms 00:27:41.725 0:0:0:0:0:0:0:1:58625 MediaCollection REQUEST EXIT 0.15 ms 00:27:41.725 0:0:0:0:0:0:0:1:58625 MediaCollection OK 0.33 ms 00:27:49.026 0:0:0:0:0:0:0:1:58626 MediaCollection REQUEST OPEN tv4 0.29 ms 00:27:49.026 0:0:0:0:0:0:0:1:58626 MediaCollection OK Database 'tv4' was opened in 0.06 ms. 0.45 ms 00:27:49.026 0:0:0:0:0:0:0:1:58626 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139480"]) [last()] 0.22 ms 00:27:49.213 0:0:0:0:0:0:0:1:58626 MediaCollection OK Query executed in 188.08 ms. 188.45 ms 00:27:49.213 0:0:0:0:0:0:0:1:58626 MediaCollection REQUEST EXIT 0.38 ms 00:27:49.213 0:0:0:0:0:0:0:1:58626 MediaCollection OK 4.13 ms 00:28:03.721 10.0.29.134:55434 VentuzTV4A REQUEST OPEN tv4 203.11 ms 00:28:03.721 10.0.29.134:55434 VentuzTV4A OK Database 'tv4' was opened in 0.06 ms. 0.4 ms 00:28:03.861 0:0:0:0:0:0:0:1:58627 MediaCollection REQUEST OPEN tv4 0.23 ms 00:28:03.861 0:0:0:0:0:0:0:1:58627 MediaCollection OK Database 'tv4' was opened in 0.04 ms. 0.36 ms 00:28:03.861 0:0:0:0:0:0:0:1:58627 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139482"]) [last()] 0.19 ms 00:28:03.924 10.0.29.134:55434 VentuzTV4A REQUEST XQUERY (/DEKOEVENTS/EVENT[@IDdeko="106139846"]) [last()] 202.22 ms 00:28:13.876 0:0:0:0:0:0:0:1:58627 MediaCollection ERROR Timeout exceeded. 10008.52 ms 00:28:13.892 10.0.29.134:55434 VentuzTV4A OK Query executed in 9975.78 ms. 9976.17 ms 00:28:13.892 10.0.29.134:55434 VentuzTV4A REQUEST EXIT 0.14 ms 00:28:13.892 10.0.29.134:55434 VentuzTV4A OK 0.26 ms 00:28:14.922 0:0:0:0:0:0:0:1:58628 MediaCollection REQUEST OPEN tv4 0.23 ms 00:28:14.922 0:0:0:0:0:0:0:1:58628 MediaCollection OK Database 'tv4' was opened in 0.05 ms. 0.39 ms 00:28:14.922 0:0:0:0:0:0:0:1:58628 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139840"]) [last()] 0.19 ms 00:28:15.093 0:0:0:0:0:0:0:1:58628 MediaCollection OK Query executed in 171.06 ms. 171.41 ms 00:28:15.093 0:0:0:0:0:0:0:1:58628 MediaCollection REQUEST EXIT 0.14 ms 00:28:15.093 0:0:0:0:0:0:0:1:58628 MediaCollection OK 0.4 ms 00:28:22.332 0:0:0:0:0:0:0:1:58629 MediaCollection REQUEST OPEN tv4 0.27 ms 00:28:22.332 0:0:0:0:0:0:0:1:58629 MediaCollection OK Database 'tv4' was opened in 0.05 ms. 0.4 ms 00:28:22.332 0:0:0:0:0:0:0:1:58629 MediaCollection REQUEST XQUERY (//EVENT[@IDdeko="106139698"]) [last()] 0.19 ms

2 1

BaseX GUI doesn't show combining glyphs properly
by Kristian Kankainen 18 Jun '16

18 Jun '16

Hello I don't know if the problem is local on my computer or in BaseX's GUI code. It doesn't show Unicode Combining glyphs correctly in the Results window. The combining characters are somehow strangely spaced away together with their base character. If I copy and paste the text from the window, it is correctly formatted. In the attached picture the 12th row should show "iguumeń/ńa:" instead. Best regards Kristian K

2 2

Sorry…
by Christian Grün 16 Jun '16

16 Jun '16

…everyone for the delayed replies. I'll give some more feedback end of this week.

1 0

Geo Module Help
by George Sofianos 16 Jun '16

16 Jun '16

Sorry for the second email, I'm not familiar with BaseX, but it looks like the gml namespace is hardcoded in /basex-api/src/main/java/org/expath/ns/Geo.java I don't know if it is intentional for compatibility reasons or not.

1 0

How to make an email database
by Finney, Tim 16 Jun '16

16 Jun '16

Hi Everyone, I'm thinking about what might be involved in making a BaseX email database that would allow large numbers of emails to be searched on things like sender, recipient, subject, date, contents, as well as an existing hierarchical structure for organizing emails. (E.g. all emails relating to a particular project are placed in a corresponding project folder.) The emails would have to be periodically exported from an existing email archive, presumable going by way of a (very big) PST file. Has anyone here already tried to do this kind of thing using BaseX? Any tips would be much appreciated. Does anyone know of a good open source program for converting PST files to an XML structure? (I don't care about attachments at the moment, though it would be good to eventually include non-binary attachments in the search facility.) Best, Tim Finney

2 1

climbing around in maps
by Graydon Saunders 15 Jun '16

15 Jun '16

Hi -- I'm using 8.4.4. So I'm got a 15 MiB XML file . It consists of a bunch of definitions, which reference other definitions in the same file. It's not guaranteed to not be circular in the general case but I expect it isn't in my particular use case. (And I've stuck a "don't get too deep" check in anyway, which is currently sitting at 1 in the hopes that wouldn't blow up.) The idea is to find the paths to some particular values by started at those values and climbing up the references until a magic "this is the top of a chain of references" point is reached. (Which can be detected via a pattern in the name of the definition.) I stuffed the things I expect to care about into maps, since that way I process it once, and can hopefully reference it thereafter. The downside is that the stack dies instantly when I attempt to recurse up the (virtual, rather than XML-document-actual) tree. (I've never seen BaseX run the query plan along the bottom bar in lieu of an error message before.) I've attached the full query info. I can't attach the data because it's somebody else's. (entry has relationship children; an entry describes an XSD schema, and a relationship element describes (possibly through reference to another entry element than its ancestor) either a complex type or a simple type that goes in that schema. There's only one entry with a given @name but many relationship elements may reference it. As a result, the scope of what's being climbed expands rapidly; this first test "do one name" turns into 20 names on the first pass. ) The query looks like: declare function local:climb($relByType as map(*), $built as xs:string*, $name as xs:string) { for $path in $relByType($name) return if (matches($path,'^\p{Lu}{4}_IN') or count($path) gt 1) then ($name,$built) else local:climb($relByType,($name,$built),$path) }; let $relationships as element(relationship)+ := //relationship[@type] let $relByType as map(*) := map:merge(for $x in $relationships let $key := $x/@type group by $key return map:entry($key,$x/ancestor::entry[1]/@name)) let $fixedRelationships as element(relationship)+ := //relationship[@type][@fixedValue] let $fixed := map:merge(for $x in $fixedRelationships let $key := $x/string-join((@name,@type,@fixedValue),'|') group by $key return map:entry($key,$x/ancestor::entry[1])) (:trying a single fixed value as the start of the climb for testing:) let $eventNames := map:get($fixed,'moodCode|CS|EVN.CRT')/@name (: so we can get the relationship element, but we want its event ancestor's name :) return for $x in $eventNames return local:climb($relByType,'',$x) My suspicion is that passing a big map to the function is causing the problem. But I don't know, and I don't think there's a way to declare a function with an external variable. ("take this value from the function declaration's context and put it in scope for the function"). Any suggestions? -- Graydon

1 1

group explicitly for performance improvements
by Graydon Saunders 15 Jun '16

15 Jun '16

I'm wading about in several tens of megabytes of health care data, trying to figure out what connects to which, as it were. There are a few thousand relationship elements that define some of the connections, and often more than one such element per @type, so it's not enough to just group them by _this_ relationship elements type, I need all the relationship elements which have a particular type value. let $relationships as element(relationship)+ := //relationship[@type] let $relTypes as xs:string+ := distinct-values($relationships/@type/string()) let $relByType := map:merge(for $x in $relTypes return map:entry($x,$relationships[@type eq $x])) return $relByType 82895.5 ms let $relationships as element(relationship)+ := //relationship[@type] let $relByType := map:merge(for $x in $relationships let $key := $x/@type group by $key return map:entry($key,$x)) return $relByType 170.79ms Holy Wow. Offered just in case anyone else is wondering why their query is so slow. -- Graydon

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk June 2016