February 2017 - BaseX-Talk - mailman.uni-konstanz.de

Preparing BaseX 8.5.4 (please don't forget Issue #1341)
by Jan Dölle 20 Feb '18

20 Feb '18

Hi, we noticed you prepare release 8.5.4. Please don't forget to fix issue: SQL with BaseX 8.5.3 #1341 Thx Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

4 5

standalone vs GUI character parsing
by Bridger Dyson-Smith 13 Jun '17

13 Jun '17

Hi all - I'm able to create a database with the GUI from an XML document that contains an invalid character (U+0000) -- I guess BaseX does some character scrubbing, which is awesome :). When I try creating a database with the same input XML document from the commandline (using the basex executable), I get an error message. Here are my commands in standalone mode: BaseX 8.5.3 [Standalone] Try 'help' to get more information. > create db test-bad-char /usr/home/bridger/src/another-test.xml "/usr/home/bridger/src/another-test.xml" (Line 4): An invalid XML character (Unicode: 0xb) was found in the element content of the document. > xquery db:create("test-bad-char", "/usr/home/bridger/src/another-test.xml", "/usr/home/bridger/src/", map { "chop": false() }) Stopped at ., 1/10: [FODC0002] "/usr/home/bridger/src/another-test.xml" (Line 4): An invalid XML character (Unicode: 0xb) was found in the element content of the document. > This isn't a surprise (I'm more surprised (pleasantly) by the GUI behavior); is there a way to apply the same "scrubbing" from the GUI in standalone mode? I'm sure there is, but I'm not able to figure out which option to apply. As always, thank you for your time and trouble, and thanks for BaseX. Best, Bridger

3 17

Multipart form-data submissions from RESTXQ
by Tim Thompson 20 Mar '17

20 Mar '17

Hello, I have been agonizing over a problem with a service I'm trying to call from RESTXQ. The service (www.tei-c.org/oxgarage/) only accepts multipart/form-data submissions. It provides a front-end client for uploading files from the browser, which calls a back-end RESTful service to do document conversion. I've installed a local instance of the service ( https://github.com/TEIC/oxgarage) and have it running on Tomcat 7, along with BaseX. The problem arises when I try to submit documents with non-ASCII characters from RESTXQ. Looking at the network traffic, I can see that if the document contains only ASCII characters, the multipart submission body is not base64 encoded. For example: Encapsulated multipart part: (text/xml) Content-Disposition: form-data; name='fileToConvert'; filename='homework.xml'\r\n Content-Type: text/xml\r\n\r\n eXtensible Markup Language <html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta/> <title> Test </title> </head> <body> <math xmlns="http://www.w3.org/1998/Math/MathML"> <msub> <mi/> <mn> 2 </mn> </msub> </math> </body> </html> However, if the document does contain non-ASCII characters (such as β), BaseX sets the Content-Transfer-Encoding to "base64." This causes the OxGarage service to fail because it thinks it is receiving an image file rather than a textual document. For example: Content-Type: text/xml\r\n Content-Transfer-Encoding: base64\r\n\r\n eXtensible Markup Language [truncated] PGh0bWwgeG1sbnM9Imh0dHA6Ly93d3cudzMub3JnLzE5OTkveGh0bWwiPjxoZWFkPjxtZXRhLz48\r\ndGl0bGU+VGVzdDwvdGl0bGU+PC9oZWFkPjxib2R5PjxtYXRoIHhtbG5zPSJodHRwOi8vd3d3Lncz\r\nLm9yZy8xOTk4L01hdGgvTWF0aE1MIj48bXN1Yj48bWk+zrI8L21pPjxtbj5Ud288L21 Attached here is a basic test case to replicate the problem: an HTML page with a form and the RESTXQ function that it calls. I've tried setting a new header to specify Content-Transfer-Encoding as "binary" instead of "base64," but it doesn't replace the default header. Is there any way that the encoding could be controlled from RESTXQ? Thanks in advance! Tim -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library www.linkedin.com/in/timathompson tat2(a)princeton.edu

3 9

Tail Recursion Error on startup
by buddyonweb-software＠yahoo.com 11 Mar '17

11 Mar '17

When we start up BaseX (whether the server or the GUI) and run a particular a query against a particular .xqm file, we always get a tail recursion error. Error:[bxerr:BASX0005] Stack Overflow: Try tail recursion? If we attempt to execute it again (sometimes twice, but have done so repeatedly up to 5 times), the error goes away and all is fine. Is there anything you can suggest or anything we can provide you to see how to eliminate this. This is particularly problematic on our server when we reboot our production application.Anything you can suggest or anyway we can help is much appreciated. Buddy

3 7

basexhttpstop hangs in 8.6.1
by Marco Lettere 02 Mar '17

02 Mar '17

Hello all, I just downloaded Basex861.zip for Linux (Ubuntu 16.04 the host). Unizipped and started basexhttp. Everything ok. In another shell I launch basexhttpstop which correctly shuts down the server started before. But basexhttpstop itself does not terminate. This is causing some headache in our scripts that launch and stop several instances. Any clue? Thanks a lot, Marco.

3 7

Connection reset by peer: socket write error
by France Baril 01 Mar '17

01 Mar '17

We have about 40 databases in out project, but when trying to save files to one of them, users sometimes get this error. We're saving through webdav, on a network connection. We're on version 8.2.3 and cannot upgrade right now. Any clue would be useful. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Integrating IntelliJ IDEA and BaseX
by Bridger Dyson-Smith 01 Mar '17

01 Mar '17

Hi all, I'm hoping to get some feedback (and potential collaborators) on a wiki page I created[1] that attempts to help a user get started with IDEA, XQuery, and BaseX. However!, I'm feeling a bit uncertain about my limited experience with workflows, tooling, and IDEA set up, and so I'm hoping that those of you on this list who use BaseX and IDEA might be willing to pass along feedback about the linked documentation. Particularly, how are you interacting with BaseX both as a processor and as client/server? How are you starting and stopping your server? What pieces of IDEA are you leveraging to make working with XQuery and BaseX a(n even) better experience? Thank you in advance for your time and trouble. Best, Bridger [1] http://docs.basex.org/wiki/Integrating_IntelliJ_IDEA

3 3

A suggestion (csv:doc, ...)
by Hans-Juergen Rennau 28 Feb '17

28 Feb '17

Dear BaseX team, if you are interested in further boosting the power of BaseX as a resource monitoring tool, you might consider the tiny, yet useful extension described below. Currently we have various functions for parsing non-XML formats into node trees: json:parse($text ...) csv:parse($text ...) html:parse($text ,,, These functions expect as input the text to be parsed, not the URI from which to retrieve the text. Of course, it is trivial to combine retrieval and parsing, using fn:unparsed-text(), like so: unparsed-text('foo.json') ! json:parse(.) However, the resulting document does not have a document URI, and it would be cumbersome to associate it with one. So how about adding three functions json:doc($uri ...) csv:doc($uri ...) html:doc($uri ...) Two advantages: first the document URI is available, second - sheer elegance. As an example of this elegance, consider the task to create a list of all .csv files found in a directory tree which have inconsistent record lengths. Using csv:doc, the solution is a simple expression, rather than a program: file:list($dir, true(), "*.csv") ! concat($dir, '/', .) ! csv:doc(.) [1 eq count(//record/count(*) => distinct-values())] / document-uri(.) Cheers,Hans-Jürgen

1 0

Help with understanding collections and user management
by kalibuk＠centrum.cz 28 Feb '17

28 Feb '17

Hallo, I have few questions while trying to get used to and use BaseX database in our solution. A) Could be empty collection in a database created? This query db:add("MyDBName","","/NewCollectionName") perforemed in GUI creates collection NewCollectionName but copies there also bunch of other things used as example… I tried also to ADD a xml file to NewCollection which works , new collection was created, but when I deleted that file, collection disappered also ! B) Is it possible to grant various users different access rights to different collections under one database ? Eg. granting access rights to groups of users and/or creating roles ? Regards and thanks for your good job, Jan Matuszek

2 1

Exit a for-loop?
by Joseph 27 Feb '17

27 Feb '17

Hi, I have two sets of numbers, and I would like to write a for-loop for comparison, so that I get only the first match between the numbers. I was thinking of a double for-loop, but I do not know how to exit the comparison as soon as I get the first match. Any idea? Thanks. Joseph

3 2