January 2016 - BaseX-Talk - mailman.uni-konstanz.de

BaseX, DITA and DOCTYPE
by Stefan Popovic 22 Jan '16

22 Jan '16

Hi all, I can’t seem to find any information about how to keep the DOCTYPE when uploading files to a BaseX server. Here’s the situation: 1. We use oXygen and we edit DITA files. 2. We want to use an XML native database, therefore we’re considering BaseX. 3. When importing files in a BaseX server, the DOCTYPE is dropped. 4. However, oXygen needs the DOCTYPE for editing DITA files. Specifically, I am wondering if there is a BaseX server-side setting that would keep the DOCTYPE when uploading a file. Many thanks for your help, Stefan

2 1

XML Prague » User Meeting » Feb 11, 2016 » Join us!
by Christian Grün 22 Jan '16

22 Jan '16

Hi everyone, Once again, I would like to remind you of our BaseX User Meeting in Prague. It will take place on February 11 (Thursday), 10:00 to 13:00. This time, we are more than happy to have eight talks for you: _ SESSION I, 10:00 ___ 1. BaseX 8.4: The Latest Updates. Christian Grün, BaseX GmbH, Konstanz 2. The Power of Promises and Parallel XQuery Execution. James Wright, Denver, Colorado 3. BaseX for linguistic research: transforming the Latin Dependency Treebank into Universal Dependencies. Giuseppe G. A. Celano, Humboldt Chair for Digital Humanities, Leipzig, Germany 4. Isilex, an Easy-To-Deploy Basex CMS for Collaborative XML Databases Projects. Xavier-Laurent Salvador, Paris 13 University, France _ SESSION II, 12:00 ___ 1. BaseX – A Swiss Army Knife for Broadcast Subtitles. Andreas Tai, IRT, Munich 2. Maximilian Gärber, axxepta solutions GmbH, Lindau 3. Extending XQuery with User-Defined Datatypes. Rob Stapper; Borne, Netherlands 4. DITA For Small Teams: Implementing A Sophisticated Hyperdocument Management Application using XQuery and BaseX. Eliot Kimber, Contrext, LLC. Austin, Texas, USA ______________________________ You can find more information on Lanyrd and the XMLPrague conference site: http://lanyrd.com/2016/basex/ http://xmlprague.cz/ Hope to see many of you soon, Christian BaseX Team, 2016

4 4

XQPool
by Chris Speare 20 Jan '16

20 Jan '16

Have been trying to look at connection pooling due to requests of documents taking 1 second to pull - when I have 36000 documents to pull down for processing this is too slow. Some examples mention BaseXConnectionPoolXQDataSource with XQJ Connection Pool, however that seems to been in beta, last updated 02/2014 and the jar file is corrupt. Whilst this isn't under the control of BaseX is there any advice of a newer version, or recommendations for handling connection pools. I have a java service which is running 10 threads which pull from a queue of "request jobs" which involve pulling a document from a BaseX database, then loading into an in memory instance for further querying. This way I am able to pass around sections of the document as I drill down into it (iterating over nodes for processing) which is too slow to carry out through a server instance. Initially I attempted to create one connection to BaseX per thread, however this seemed even slower. Any advice welcome The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes. Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain. Company Registration Number 5240202, Place of Registration Companies House Cardiff.

2 1

xquery:eval bug?
by Marc van Grootel 19 Jan '16

19 Jan '16

Hi, I'm trying to return a map or an array from xquery:eval. Seems this is not possible, yet the signature says it returns item()* xquery:eval('1 + 1') => 2 xquery:eval('[1,2]') => ERROR: [FOTY0014] Items of type array(*) have no string representation. xquery:eval('map { "x": 10 }') => ERROR: [FOTY0014] Items of type map(*) have no string representation. BTW: I saw that xquery:eval#3 is documented as returning item() while the other arities return item()* Tested on 8.3, haven't tested yet on 8.4beta but it's trivial to repro I figure. -- --Marc

4 7

Embedding BaseX in Clojure web app, pointers needed
by Marc van Grootel 19 Jan '16

19 Jan '16

Hi, I'm considering to write a web layer for BaseX based in Clojure. It may be a somewhat longer term project but I would like to bring XML and BaseX closer to Clojure programming. Clojure web apps usually are able to run under various servers/containers (Jetty/Netty etc.) and I would like to be able to use Clojure libraries to handle things like request routing, security and authentication outside of BaseX/XQuery. Some questions that I have while I'm orienting myself. Some of it touches on integration areas that are quite new to me so I am happy to get some general pointers that I can use to dig further. For Clojure I found only one BaseX client library [1] which wraps the standard Java TCP client and it seems to work fine. But I have some broader questions such as - Choosing between using the client or much more intimately embedding BaseX as a library. The latter is probably much more complex but I'm figuring this is the only way to get a good integration as the TCP client is rather limited in functionality. But where to start? What layers of the existing servlet integration to peel off, which ones to keep. Is BaseXServer.java a good starting point? - Is the TCP client generally slower than via the Java API? A couple of queries via clj-basex didn't impress me much qua speed (compared to same query via the GUI). Any starting points or general considerations that could help me prune the (re)search tree are very much appreciated. --Marc [1] https://github.com/kouphax/clj-basex

2 2

Streaming file loads
by Christophe Marchand 19 Jan '16

19 Jan '16

Hello ! We have to load many files (>20.000), large size (>30Gb) into BaseX. Today, that's done vis a BXS script which accesses files thru a network share. I would like to optimize network transfert ; tar / compression at source, uncompress / untar at destination. But I would like to avoid to create temporary files (at source, on NAS server, and on destination server, BaseX host). So, is there an API which I could use to load a "file" thru a stream ? I think I can write an inputstream that redirects data to outpustreams, cutting input data in many output streams, one per file. But may I chain this outputstream to an inputstream usable by BaseX loader ? Best regards, Christophe

2 1

Wiki Edits
by Christian Grün 18 Jan '16

18 Jan '16

In-between: Thanks to James, Jens, Arve, Constantine, Marco, Amanda, Patrick, Alex, ... for your edits in our Wiki! You alle are helping to make it a more and more comprehensive source for everyone working with BaseX.

2 1

Any (hopefully representative) reference korpora of XML-ish documents?
by Albretch Mueller 16 Jan '16

16 Jan '16

OASIS keeps an a interoperability corpus of ODF test documents https://www.oasis-open.org/committees/oic/charter.php Do you use of know of any large XML/-ish reference korpora which could be used for testing purposes? In case, you don't could you suggest where or how could one find such a thing? lbrtchx basex-talk@mailman.uni-konstanz.de:Any (hopefully representative) reference korpora of XML-ish documents?

2 1

ft:search and using thesaurus
by Günter Dunz-Wolff 16 Jan '16

16 Jan '16

Hi all, hi Christian, for a flexible search I want to use this programatic approach: let $ft := map { 'wildcards': true() } let $terms := 'Pa.*' for $city in ft:search('factbook', $terms, $ft)/parent::name[ancestor::city] let $hits := ft:mark($city[ft:contains(text(), $terms, $ft)]) return let $name := $city/ancestor::country/name return ($hits, $name) How could I integrate 'using thesaurus at "thesaurus.xml"', unfortunately thesaurus is not part of the $options argument of ft:search. Cheers, Günter

2 1

Security
by Finney, Tim 15 Jan '16

15 Jan '16

Hi Everyone, Sorry if this is a dumb question. What is a good way to do security in BaseX? I found a stub here: http://docs.basex.org/wiki/Security:_Use_Cases What I would like is to be able to restrict who can do what with a database. Here are a few things I'd like to be able to do: 1. Grant create, read, update, and delete permissions on each document in a database, and have a default mask for a database document. 2. Say whether a user can or cannot execute a function or visit a URL (and get something besides a 404). 3. Allow the creation of roles which can be assigned to users. (Having a particular role allows all users with that role to do particular things, like update docs, or visit particular URLs.) 4. No doubt there are more desiderata. E.g. one might conceivably want to be able to grant permissions at the node level within a document. Any pointers? Best, Tim Finney

2 1