February 2018 - BaseX-Talk - mailman.uni-konstanz.de

Preparing BaseX 8.5.4 (please don't forget Issue #1341)
by Jan Dölle 20 Feb '18

20 Feb '18

Hi, we noticed you prepare release 8.5.4. Please don't forget to fix issue: SQL with BaseX 8.5.3 #1341 Thx Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

4 5

General XQuery Help: identity transform best practices
by Bridger Dyson-Smith 19 Feb '18

19 Feb '18

Hi list -- apologies if you've seen this message in other mailing lists or IRC. This isn't BaseX-specific, and so I hope that's not troublesome. I'm trying to develop a better understanding of how to leverage the identity transform pattern (or whatever the best term would be) in XQuery. Based on some web searching, typeswitch seemed to be the recommended method; e.g. [1]. But I would run into problems with using `case element($node[@name='first') return local:do-something-specific-with-this($node)`. After some chat with Liam on IRC yesterday, he gave me the idea of trying a plain(er) `switch` but I couldn't quite work out the comparison of a local-name($node) to the atomized value, especially when I needed to evaluted an XPath expression as part of the `case`. Eventually I settled on if-then-else; e.g. [2]. It feels a little unwieldy. Note that in my (typical) usecases I'm transforming entire documents, see [3] for example output. I can't help but wonder though: it there a better way to handle this? Am I missing something obvious with the typeswitch method? I started with XSLT and I feel like maybe I'm doing something wrong :). Thanks for any suggestions or pointers you can offer. Best, Bridger PS Again, hopefully this isn't too off-topic for the list. (: [1] identity transform with typeswitch :) declare variable $input := <docs> <doc> <title>ABC: The Alphabet</title> <author>Some Person</author> <fields> <field name="first">First Field</field> <field name="second">Second Field</field> </fields> </doc> </docs>; declare function local:passthru( $node as node()* ){ local:dispatch($node/node()) }; declare function local:dispatch( $nodes as node()* ) as item()* { for $node in $nodes return typeswitch($node) case text() return $node case element(docs) return local:passthru($node) case element(doc) return local:docf($node) case element(title) return local:title($node) case element(author) return local:author($node) case element(fields) return local:passthru($node) case element(field) return () (:return empty sequence:) default return local:passthru($node) }; declare function local:docf($node) { <new>{local:dispatch($node/node())}</new> }; declare function local:title($node) { <new-title>{local:dispatch($node/node())}</new-title> }; declare function local:author($node) { <new-author>{local:dispatch($node/node())}</new-author> }; local:dispatch($input) (: [2] identity transform with if-then-else :) declare function local:dispatch( $nodes as node()* ) as item()* { for $node in $nodes return( if ($node instance of text()) then $node/data() else (), if (fn:local-name($node) = 'docs') then local:passthru($node) else (), if (fn:local-name($node) = 'doc') then local:docf($node) else (), if (fn:local-name($node) = 'title') then local:title($node) else (), if (fn:local-name($node) = 'author') then local:author($node) else (), if (fn:local-name($node) = 'fields') then local:passthru($node) else (), if (fn:local-name($node) = 'field' and $node/@name='first') then local:field-1($node) else (), if (fn:local-name($node) = 'field' and $node/@name='second') then local:field-2($node) else () ) }; (: [3] sample output :) <new> <new-title>ABC: The Alphabet</new-title> <new-author>Some Person</new-author> <new-subject>First Field</new-subject> <new-section> <new-entry>Second Field</new-entry> </new-section> </new>

3 4

JSON input files
by Jonathan Robie 08 Feb '18

08 Feb '18

I would like to add a JSON file to a collection that is otherwise composed of XML files. I'm hitting two issues: 1. Is there any way to import both JSON and XML files at the same time when creating a database? 2. I would like to import the JSON as an XQuery/XPath map, without mapping it to XML. Any way to do that? Thanks! Jonathan P.S. the input JSON looks like this: { "ααρων": { "gk": 2, "strongs": [ 2 ], "lemma": "Ἀαρών", "transliteration": "Aarōn", "frequencyCount": 5, "definition": "Aaron, pr. name, indecl., the brother of Moses (Exod. 4:14), Lk. 1:15; Acts 7:40; Heb. 5:4; 7:11; 9:4*" }, When I import it, I get this: <json type="object"> <ααρων type="object"> <gk type="number">2</gk> <strongs type="array"> <_ type="number">2</_> </strongs> <lemma>Ἀαρών</lemma> <transliteration>Aarōn</transliteration> <frequencyCount type="number">5</frequencyCount> <definition>Aaron, pr. name, indecl., the brother of Moses (Exod. 4:14), Lk. 1:15; Acts 7:40; Heb. 5:4; 7:11; 9:4*</definition> </ααρων> <αβαδδων type="object"> <gk type="number">3</gk> etc.

2 1

Performance of Query joining two documents
by wd＠creativosdigitales.co 07 Feb '18

07 Feb '18

Hi, Im using BaseX to compare two XML documents with a list of items <asset> identified by an element <assetid> and with a Now I need to consolidate them in only one document with the value of the <category> element in both documents (one of them renamed to <prev-category>). Attached are samples of these documents., and the quey Im using is this: declare function local:compare( $actual, $prev ){ for $c in $actual/asset return <asset> { $c/*} <prev-category> { $prev/asset[assetid = $c/assetid]/category/text() } </prev-category> </asset> }; declare variable $act external := "2017-07"; declare variable $prv external := "2016-07"; return local:compare(/portfolio[projectid=$act], /portfolio[projectid=$prv] ) The query takes 42 seconds when run over the files. If I load the files to a database and activate the text index, it takes 125 seconds. This is a very common query in relational databases that takes only few seconds to run joining two tables or two subqueries. Is there a way to make it run faster in BaseX? Thanks for your advice, William David Velásquez Creativo de Software Creativos Digitales S.A.S. Calle 30A # 83 - 53 Local 1033 Tel: 322 1730 - 311 709 8421 Medellín, Colombia <http://creativosdigitales.co/> http://creativosdigitales.co

3 2

One document per database or multiple?
by Jonathan Robie 06 Feb '18

06 Feb '18

If I have a set of related documents (a text, a lexicon, frequency counts, a discourse analysis, etc), how should I decide when to put more than one document in a single database at different paths, as opposed to putting one document in each database? When I create a database from the GUI, it seems to prefer one document per database. Should I take that as a hint? Jonathan

3 3

how to declare an updating function parameter in a high-order function signature ?
by Fabrice ETANCHAUD 06 Feb '18

06 Feb '18

Dear all, I cannot find a way to tell the xquey engine that a function parameter of my high-order function is updating : declare %updating function etebac:build-updating($file as xs:string, $builder as %updating function(*) ) { for tumbling window $line in (file:read-text-lines($file)) start $start-item when etebac:record-header($start-item) = '01' end $end-item when etebac:record-header($end-item) = '07' let $doc := etebac:build-json($line) let $start := format-date(xs:date($doc/date-ancien-solde), '[Y0001][M01][D01]') let $stop := format-date(xs:date($doc/date), '[Y0001][M01][D01]') let $doc-id := string-join(($doc/rib, $start, $stop), '-') let $doc-path := string-join( ($doc/(banque, guichet, compte), $start || '-' || $stop), '/') let $out-file := concat($doc-path, '.json') where count($doc/operations/_) > 0 return $builder( $doc-path, element json { attribute type { 'object' }, element meta { attribute type { 'object' }, element type { 'releve-operations' }, element id { $doc-id } }, element data { $doc/(*|@*) } } ) }; I have a [XPTY0004] Function must not be updating: %updating function($path,$doc) a... error. The outer call is : import module namespace etebac = 'http://pch.cerfrance.fr/basex/modules/etebac' at 'etebac.xqm'; etebac:build-updating('D:\edi\banque\input\10278\10278_CMLACO_20160701.183', db:replace('test', ?, ?) ) What have I to do to tag my $builder function reference as updating in the main body ? Best regards from the snowy french atlantic coast, Fabrice

2 2

How to send Mails
by Navin Rawat 05 Feb '18

05 Feb '18

Hi Team, Is there any way to send mails through BaseX to the users? Regards, Navin

2 1

Dynamic xpath
by France Baril 05 Feb '18

05 Feb '18

I'm trying to do something similar to this because I'll have to deal with xpaths provided by end users as parameters to a rest query: var xpath='div/p' for $i in db:open('en-us'){$xpath} return $i I saw that it's possible to do it with other tools, but I didn't find if it's possible with xquery and BaseX. How SQL dbs do it: SET @XML1=' <Root> <Device> <Inspection> <Status>OK</Status> </Inspection> </Device> </Root>' SET @PATH = '/Root[1]/Device[1]/Inspection[1]/Status[1]' SELECT @XML1.query(@PATH) Any suggestion that doesn't involve analyzing the query string and trying to rebuild it in some way? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

3 2

Big Surprise from outputs in version 7.3.1 and 8.6.7 ?
by Bang Pham Huu 02 Feb '18

02 Feb '18

Hello, I've been using BaseX to query an XML file in version 7.3.1 and it worked well. However, because of this problem https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg10241.ht… and I was suggested to use version 8.6.7 then I changed to use this version in a Java Web application which queries the old BaseX files from version 7.3.1. However, I didn't know that this version changes created a very surprise result between version 7.3.1 and 8.6.7 (i.e: data is missing in version 8.6.7 from output result !!!). Could someone tell me why it happens and how to use BaseX version 8.6.7 on BaseX database from version 7.3.1. Here is the difference between 2 outputs on same old BaseX database version 7.3.1 (left: 8.6.7, right: 7.3.1) with same XQuery: https://www.diffchecker.com/iCgLhRUx The XQuery is: declare namespace gml = "http://www.opengis.net/gml/3.2"; declare function local:get-children() { let $x := collection('userdb')//gml:identifier/text() return if (exists($x)) then for $i in $x return $i else <empty/> }; let $x := distinct-values(local:get-children()) for $i in $x return $i Thanks,

4 13

SqlExecutePrepared, Oracle and getParameterCount again
by Jan Dölle 01 Feb '18

01 Feb '18

Hi, I found any other issue on using Oracle SQL in BaseX by SqlExecutePrepared. It caused by stmt.getParameterMetaData().getParameterCount(). The current workaround ignores the thrown Exception and will continue the statement execution. But produce may open cursors on in the Database. So finally it will run into ora-1000 "Maximum open cursors exceeded." By totally avoiding the call of getParameterCount this issue will avoid. So I will provide an other fix. What do you prefer: a) check for "Oracle" in stmt.getConnection().getMetaData().getDatabaseProductName() and skip the parameter test at all or b) add an other option "checkParameters" (default true) like "timeout" and skip getParameterCount if it is set to false. I personal prefer a). Cheers, Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

2 3