January 2019 - BaseX-Talk - mailman.uni-konstanz.de

Slow WebDAV operation
by Andreas Jung 10 Jan '19

10 Jan '19

I have an optimized database with 25K objects, 8 GB of data running on 9.1.1. WebDAV operations are very slow (client running and connecting locally). The response times are by a magnitude slower compared to exist-db. Is there some something missing in the configuration in order to speed this up significantly? Andreas 11:28:16.899 127.0.0.1:45822 admin OK Database 'onkopedia' was optimized in 29379.65 ms. 29380.24 ms 11:28:24.689 0:0:0:0:0:0:0:1:34258 admin REQUEST [HEAD] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:25.382 0:0:0:0:0:0:0:1:34258 admin 200 694.07 ms 11:28:25.389 0:0:0:0:0:0:0:1:34260 admin REQUEST [PROPFIND] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:26.065 0:0:0:0:0:0:0:1:34260 admin 200 675.31 ms 11:28:26.078 0:0:0:0:0:0:0:1:34262 admin REQUEST [HEAD] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:26.770 0:0:0:0:0:0:0:1:34262 admin 200 691.53 ms 11:28:26.789 0:0:0:0:0:0:0:1:34264 admin REQUEST [PROPFIND] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:29.231 0:0:0:0:0:0:0:1:34264 admin 200 2444.93 ms 11:28:29.240 0:0:0:0:0:0:0:1:34266 admin REQUEST [HEAD] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:29.856 0:0:0:0:0:0:0:1:34266 admin 200 616.41 ms 11:28:29.864 0:0:0:0:0:0:0:1:34268 admin REQUEST [PROPFIND] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:32.310 0:0:0:0:0:0:0:1:34268 admin 200 2445.99 ms 11:28:32.317 0:0:0:0:0:0:0:1:34270 admin REQUEST [HEAD] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:33.083 0:0:0:0:0:0:0:1:34270 admin 200 766.14 ms 11:28:33.103 0:0:0:0:0:0:0:1:34272 admin REQUEST [GET] http://localhost:8984/webdav/onkopedia/onkopedia/de/onkopedia/guidelines/ma… 11:28:33.719 0:0:0:0:0:0:0:1:34272 admin 200 615.38 ms

2 8

web:response-header()
by Johannes Bauer 10 Jan '19

10 Jan '19

Hello, I've a question to the response-header() function of the web module. In my RESTXQ function I try to return a response with HTTP Status 404: module namespace basex ='basex'; declare %rest:GET %rest:path("/db/{$db}/doc/{$doc}") %rest:produces("application/xml") %output:method("xml") function basex:doc($dbas xs:string, $docas xs:string)as item()* { web:response-header(map {},map {},map {"status" :404}),<notfound/> }; When I call this function I get the error: [basex:restxq] Unexpected node: status="404". If I call the function outside of the RESTXQ context the following response is generated: <rest:response xmlns:rest="http://exquery.org/ns/restxq" *status="404"*> <http:response xmlns:http="http://expath.org/ns/http-client"/> <output:serialization-parameters xmlns:output="http://www.w3.org/2010/xslt-xquery-serialization"/> </rest:response> <notfound/> Shouldn't the status attribute be put on the http:response element instead? Best regards Johannes

2 1

replacing text nodes
by Graydon Saunders 09 Jan '19

09 Jan '19

Hello! I'm using BaseX 9.1.1 on Linux. So I need to go through a whole bunch of documents and emit them in an obfusticated form so the folks doing publication development can have them without the client's security people becoming upset. I don't want to obfusticate the db contents; I just want to be able to write out an obfusticated version. Minimal example: declare function local:gib($in as text()) as text() { text { 'ABCD' } }; declare function local:obfusc($in as document-node()) as document-node() { copy $c := $in modify ( for $x in $c/descendant::text()[normalize-space] return replace node $x with local:gib($x) ) return $c }; for $doc in db:open('out')[contains(document-uri(),'/scr_')][1] let $blurred := local:obfusc($doc) return $blurred If I run this, I get $doc back unaltered. If I look at the optimized query, it looks like it ought to be changing things. What am I doing wrong? Thanks! Graydon

2 2

[DELIVER]JETTY SSL & Cheeky Reload
by Adam Law 07 Jan '19

07 Jan '19

Is it possible to configure BASEX's jetty to respond over HTTPS using a keystore (eg port 8985). I have tried editing jetty.xml to no avail and have read https://stackoverflow.com/questions/32734920/using-jetty-9-and-jetty-xml-w ith-basex. Ideally it would be great if the keystore could be uploaded without having to restart baseX - (possibly with a script) I know this is cheeky. Adam

2 1

Java XQuery
by thufir 07 Jan '19

07 Jan '19

After creating and populating a database: try { new DropDB(databaseName).execute(context); } catch (BaseXException ex) { Logger.getLogger(Database.class.getName()).log(Level.SEVERE, null, ex); LOG.fine("no databases to drop"); } how would I query it? The query: db:open("note")//note thanks, Thufir

2 4

console versus gui
by thufir 03 Jan '19

03 Jan '19

Are the console and GUI in "sync"? By which I mean, can a database in the GUI not list from the console, and vice versa? I'm wondering if this perhaps relates to using BaseX as db server. I notice that my Java application can create and delete databases fine, but, it seems that that only the GUI can view those databases. Perhaps there's a way to migrate them from the GUI to the console? I'd like it consistent across access through the Java hooks, GUI and console. Or, perhaps I'm just writing bad code. I asked on SO: https://stackoverflow.com/q/54028203/262852 thanks, Thufir

2 3

Setting modification timestamp (for content migrated over WebDAV) over REST?
by Andreas Jung 03 Jan '19

03 Jan '19

As part of a migration we move data into BaseX over WebDAV. It would be neat if we could preserver the original timestamp. I am aware that it is not possible to set the timestamp over WebDAV. Would it be possible to set the modified timestamp for particular resource over the resource API or is this timestamp tied to storage internals of BaseX? Andreas

2 1

XQuery from Java
by thufir 03 Jan '19

03 Jan '19

I'm a tad more proficient with BaseX, but, how do I actually build an XQuery? Yes, I can write an XQuery and save it in a text file, then use BaseX for execution. But it would be far more flexible to write the actual XQuery from within Java itself. But how? Oracle gives an example: OXQDataSource ds = new OXQDataSource(); XQConnection con = ds.getConnection(); String query = "<hello-world>{1 + 1}</hello-world>"; XQPreparedExpression expr = con.prepareExpression(query); XQSequence result = expr.executeQuery(); using their datasource. Cannot BaseX do something similar? see also: https://stackoverflow.com/q/53996575/262852 thanks, Thufir

2 1

upper limits on storage; database admin
by thufir 03 Jan '19

03 Jan '19

What are the upper bounds to basex in size? Assuming it's just text xml, gigabytes is quite a bit to my thinking. At a certain, it's "big data" -- but how do you know when you're approaching that point? Or, is the bottleneck more read/write and consistency problems? What little I know of RDBMS is that master/slave can alleviate some bottlenecks. To put this another way: I'm so enthusiastic about basex that I'm having trouble finding a place it doesn't fit. As you approach terabytes and beyond what dbadmin approaches are employed? -Thufir

2 1

Bulk import (moving from eXist to BaseX)
by Andreas Jung 03 Jan '19

03 Jan '19

Hi there, consider moving my XML stuff for a particular project from eXist to BaseX. I have a full dump from eXist with all related content and I want to import it 1:1 into BaseX…is there a bulk loader or what is the preferred way to import an existing folder structure? Of course I can create my own script what would import the data through WebDAV but the dump has about 50.000 files. Andreas

3 4