February 2014 - BaseX-Talk - mailman.uni-konstanz.de

Updating Functions and Custom Types
by Stefan Sechelmann 19 Feb '14

19 Feb '14

Hello BaseX Team, we are currently using BaseX with great success in a WebApp/Database environment. Firstly I want to thank you for the great work on version 7.8, we like the new new features very much. Here are two feature requests that we would love to see being included in the future: - We have a test suite that invokes various updating functions using the standalone client. On the other hand non-updating functions are tested by a query test suite using the unit module. It would be great to include the tests for updating functions into the xquery test suite thus removing the condition that a test function must not be updating. - Inside our restxq backend we have a lot of functions that pass complex data structures to other functions or receive them via http. In order for these functions to be correctly typed we would need custom type support via XML-schema includes. This would greatly improve the quality of our code. Greetings and best regards Stefan -- Stefan Sechelmann DFG-Forschungszentrum Matheon Mathematik für Schlüsseltechnologien Technische Universität Berlin Sekretariat MA 8-3 Tel. 030/314 29 486 Straße des 17. Juni 136 Fax 030/314 79 282 10623 Berlin sechel(a)math.tu-berlin.de http://www.math.tu-berlin.de/~sechel

1 0

Revisiting XMLPrague
by Christian Grün 18 Feb '14

18 Feb '14

Dear subscribers, it was great to meet some of you live in Prague! And once again I would like to thank all our speakers (Lars Johnsen, Gerrit Imsieke, Yoann Maingon, Jean-Marc Mercier and Michael Sperberg-McQueen) for making the user meeting to a memorable event! Have fun with BaseX 7.8, and we are looking to your feedback, Christian PS: Maybe we'll see each other in London or Amsterdam, or at the Balisage? We'll tell you in time if we will be participating as well.

2 1

issue with HTML:parse
by Sophie Petit 18 Feb '14

18 Feb '14

Dear BaseX team, I'm using BaseX for my studies with Xavier-Laurent Salvador from Paris13. I've got a puzzling issue with html:parse. I'm trying the request below using html:parse in order to get a list of the urls from a webpage and I'm getting this message error: "Ligne 19: Invalid character found: '"' " for $x in (html:parse(http:send-request( <http:request method='get' override-media-type=' application/octet-stream' href= 'http://www.crealscience.fr/'/ >) [2])//@href[matches(.,"http")]) return $x The same request gives this kind of output errors with any url. Html:parse stops at any error in the page's HTML code. A header with "declare option output:method "text";" was added to the request but it didn't solve the problem. If I insert the same request in a RestXQ file, it works perfectly. Do you have any suggestions to solve that problem? Best, Sophie Petit (basex 7.8 on debian)

2 1

Sought: a pattern of file:list usage
by Hans-Juergen Rennau 18 Feb '14

18 Feb '14

Dear BaseX team, perhaps you have a recommendation concerning the use of the file module. The issue at hand is this. The function file:list (like any function in the file module, per EXPath specification) resolves relative paths against the current working directory. But the fn:doc function, on the other hand, resolves (per default) relative URIs against the static base URI of the containing XQuery module. If an application receives relative directories as external parameters and then obtains file names via file:list - how can one access the listed files, not knowing what the current working is, thus not knowing how to resolve those relative paths? As far as I can see, neither XQuery nor the file module offer a way how to learn the current working directory. One way out would be this pattern: avoid passing to file:list relative paths as supplied from without; but pass to the function always the result of resolving any relative paths against the static base URI of the tool. And, of course, specify your application to resolve relative paths against the tool URI, rather than against the working directory. It is a bit awkward to ask the user to specify relative paths against the tool location, but the only alternative which I now see would be to ask the user to supply the working directory explicitly. But perhaps I overlook something? Do you have a better solution to the general problem? Kind regards, Hans-Juergen

2 7

Using BaseX as a standalone xquery library in Java
by Johan Mörén 18 Feb '14

18 Feb '14

Anything special to think about when using BaseX outside the database-context? I have built some solutions using the QueryProcessor for generating filesystem reports using the supplied modules for calculating file-sizes and checksums. I hava also built a number of wrappers for calling and aggregating results from web-services. All these queries are embedded and run in our normal java-processes. Everything has worked out really well. And BaseX gives you access to a lot of good functionality like XQuery 3.0 and a rich set of modules. But I'm a bit curious if there are any drawback or special things to think about with using Basex as a general xquery-library like you would use Saxon for example? Regards, Johan Mörén

3 2

BaseX 7.8: The XMLPrague Edition
by Christian Grün 17 Feb '14

17 Feb '14

Dear subscribers, thanks for your continuing support! We are very pleased to announce BaseX 7.8 (the XMLPrague Edition). The new version was designed to further increase your productivity, no matter if you develop feature-rich XQuery applications or use BaseX as a light-weight XMLDB. You can expect the following great features: * A new project view allows you to open, edit and manage your project files directly in the GUI and search files and contents in realtime. * The integrated editor provides many new short cuts and code completions for writing XQuery modules. * Delete and insert operations are executed faster than ever before, values are updated in-place whenever possible, and a new convenience operator has been added for transform expressions * XQuery functions are now inlined and further optimized. Tail call detection and static typing has been improved, and (sub)sequences are processed much faster. * Various XQuery Modules have been enhanced (JSON, CSV, Unit, Map, XQuery, Full-Text, EXPath File), and the EXPath Binary Module has been added * BaseX is now available in Russian and Spanish. Thank you to Oleksandr Shpak and Carlos Marcos! More details can be found in our documentation (http://docs.basex.org) We are looking forward to your feedback, and we hope to see many of you in Prague this Friday (http://lanyrd.com/2014/basex) Have fun, Christian BaseX Team

4 9

lazy evaluation for variables?
by Wiemer, Sebastian 17 Feb '14

17 Feb '14

Hi, given the following example let $result := doc(‚myDataBase‘)/result return $result will $result be evaluated lazily, or will it be stored in memory? kind regards, Sebastian

2 2

transform before update query
by Imsieke, Gerrit, le-tex 16 Feb '14

16 Feb '14

This XQuery update related question might be not the most BaseX-specific question that has ever been asked on the list, but anyway: I’m currently improving the performance of sxedit (that I presented at XML Prague yesterday). One nasty workaround that I have to do in the browser is escaping the names of the TEI elements body and head when I generate TEI XML from HTML despite the fact that these elemens are in a different namespace (because browsers…). So I have TEI XML with the elements _____head and _____body. I serialize this XML and use regex replacement on the string when I submit the TEI XML for download or for storage in BaseX. (Yes, it seems silly to serialize the XML before POSTing it to RESTXQ and then using parse-xml(), but don’t mind that for the moment.) The function that does the storage is at https://github.com/gimsieke/sxedit/blob/master/lib/basex/restxq/sxedit.xqm#… Now I thought that I might do without the performance-killing string replacement in the browser if I let BaseX transform the posted data prior to replacing the stored subtree with what was posted. So I tried the following for the function body: copy $doc := parse-xml($wrapper) modify ( for $n in $doc/descendant-or-self::*[starts-with(local-name(), '_____')] let $repl := replace(local-name($n), '^_____', ''), $uri := namespace-uri($n) return rename node $n as QName($uri, $repl) ) return replace node db:open($doc/*:frag/@db, $doc/*:frag/@doc)//*[path() eq $doc/*:frag/@xpath] with $doc/*:frag/* upon which I get: [XUST0001] Transform expression: no updating expression allowed. How would I achieve the transform and then update operation? Gerrit

2 2

Re: [basex-talk] How do I create UNIX/Linux shell scripts that connect to BASEXCLIENT
by DAIANE ROBERTA CANDIDA 15 Feb '14

15 Feb '14

Hello, Thank you all for help me. My problems is solved by the code below: basexclient -U admin -P admin -L -V -v -o result.xml -c consultas.bsx >> detail.txt Regards, Daiane From: dairc_8(a)hotmail.com To: alexander.holupirek(a)uni-konstanz.de Subject: RE: [basex-talk] How do I create UNIX/Linux shell scripts that connect to BASEXCLIENT Date: Sat, 15 Feb 2014 16:41:11 -0200 Hello Alexander, Those tips were very helpfull, thank you. I was wondering if the content from V parameter could be saved into the result file instead just be in the screen. It is fine like this but could be better if I have the execution time also into the result.xml basexclient -U admin -P admin -L -V -o result.xml -c consultas.bsx Regards, Daiane > Subject: Re: [basex-talk] How do I create UNIX/Linux shell scripts that connect to BASEXCLIENT > From: alexander.holupirek(a)uni-konstanz.de > Date: Sat, 15 Feb 2014 18:40:13 +0100 > To: dairc_8(a)hotmail.com > > % cat test.xml > <test> > <a/> > <b/> > <c/> > </test> > > % cat query.xq > db:create('test', '/Users/holu/Desktop/test.xml') > > % basexserver& > > % basexclient -U admin -P admin -L -V query.xq > > Query: > db:create('test', '/Users/holu/Desktop/test.xml') > > Parsing: 0.94 ms > Compiling: 0.04 ms > Evaluating: 16.31 ms > Printing: 0.87 ms > Total Time: 18.16 ms > > Hit(s): 0 Items > Updated: 1 Item > Printed: 0 Bytes > Read Locking: none > Write Locking: local [test] > > Query "query.xq" executed in 18.16 ms. > > % cat query-1.xq > doc('test')//b > > % basexclient -U admin -P admin -L -V -o result.xml query-1.xq > > Query: > doc('test')//b > > Compiling: > - pre-evaluating fn:doc("test") > - simplifying descendant-or-self step(s) > - converting descendant::*:b to child steps > > Optimized Query: > db:open-pre("test",0)/*:test/*:b > > Parsing: 0.37 ms > Compiling: 43.1 ms > Evaluating: 0.1 ms > Printing: 7.48 ms > Total Time: 51.04 ms > > Hit(s): 1 Item > Updated: 0 Items > Printed: 4 Bytes > Read Locking: local [test] > Write Locking: none > > Query "query-1.xq" executed in 51.04 ms. > > % cat result.xml > <b/> > > On 15.02.2014, at 18:29, DAIANE ROBERTA CANDIDA <dairc_8(a)hotmail.com> wrote: > > > Hello Alexander, > > > > Thanks for answering. > > > > I have to get the execution time from some queries. > > It will take too much time because the dataset is very large so i need to automatize those task. > > > > I tried get from the commands below: > > > > arwen@arwen:~/daiane_oracle/BasexQuery$ basexclient -U admin -P admin consultas.bsx -o result.tx 1+1 > > Stopped at /home/arwen/daiane_oracle/BasexQuery/consultas.bsx, 1/14: > > [XPST0003] Unexpected end of query: 'db_teste; > > XQUER...'. > > Dumping Java heap ... done. > > > > The problem is that if i execute the query from the command line it is ok and when I execute from a file it returns error. > > > > File: consultas.bsk > > --------------------------------------------------------------------------------------------------------- > > OPEN db_teste; > > XQUERY db:open('db_teste')/books/book/metadata/title [. contains text "usability"] > > -------------------------------------------------------------------------------------------------------- > > > > What should I do? > > > > Regards, > > > > Daiane > > > > > > > > > Subject: Re: [basex-talk] How do I create UNIX/Linux shell scripts that connect to BASEXCLIENT > > > From: alexander.holupirek(a)uni-konstanz.de > > > Date: Sat, 15 Feb 2014 18:02:53 +0100 > > > CC: basex-talk(a)mailman.uni-konstanz.de > > > To: dairc_8(a)hotmail.com > > > > > > Hi Daiane, > > > > > > Start server: > > > > > > $ basexserver & > > > > > > Use client to connect, execute query and store result in file: > > > > > > $ basexclient -U admin -P admin -o result.tx 1+1 > > > $ cat result.txt > > > 2 > > > > > > Doing stuff like that from within a shell script should be no problem. > > > Are there any specific issues you are facing? > > > > > > Alex > > > > > > On 15.02.2014, at 17:57, DAIANE ROBERTA CANDIDA <dairc_8(a)hotmail.com> wrote: > > > > > > > Hello, > > > > > > > > I want to create a Shell script to connect basexclient, running queries and put the output into a file. > > > > > > > > How can I do that? > > > > > > > > > > > > Regards, > > > > > > > > Daiane > > > > > -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- > Dr. Alexander Holupirek > |-- Room E 221, 0049 7531 88 2188 (phone) 3577 (fax) > |-- Database & Information Systems Group, U Konstanz > `-- https://scikon.uni-konstanz.de/personen/alexander.holupirek/ > > >

1 0

How do I create UNIX/Linux shell scripts that connect to BASEXCLIENT
by DAIANE ROBERTA CANDIDA 15 Feb '14

15 Feb '14

Hello, I want to create a Shell script to connect basexclient, running queries and put the output into a file. How can I do that? Regards, Daiane

3 2