- BaseX-Talk - mailman.uni-konstanz.de

A BaseX/DITA use case...
by France Baril 29 Oct '16

29 Oct '16

For those who are interested in the use of XML content for publishing, this presentation is about using BaseX to power a slideshow editing tool that builds slides from existing DITA documentation/training content... https://www.brighttalk.com/community/content-marketing/ webcast/9273/209719?utm_campaign=community-live-recorded&utm_content=&utm_ source=brighttalk-portal&utm_medium=web&utm_term= - France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Download hinter Firewall funktioniert nicht
by Schindler Wolfgang Dr. 27 Oct '16

27 Oct '16

Hallo, der Download der aktuellen Version des BaseX Windows Installers auf einen Rechner, der über Proxy (hinter einer betrieblichen Firewall) aufs Web zugreift, funktioniert nicht. Warum weiß ich nicht genau, könnte aber vermuten, dass an der Art der URI http://files.basex.org/releases/8.5.3/BaseX853.exe liegt. Gibt es eine andere Methode an den Download zu kommen. Danke fürs Helfen und noch einen schönen Tag! Beste Grüße, Wolfgang Schindler

2 1

Check if server is running, silently
by Bram Vanroy 27 Oct '16

27 Oct '16

Hi all To make clear to users which corpora are currently available and which aren't, I'm checking to see if a BaseX server instance exists and then check if a specific database exists. Testing for the database is done with db:query (as I learned through this mailinglist), but I'm not sure how I can silently test for the server in PHP. All BaseX examples use try-catch blocks, which makes sense to catch errors that go wrong, and do something with them. If I'm not mistaken these errors are automatically logged by Apache (maybe also by other webservices). This means that if I'm only checking the existence of a server with the code below (variables left out), I will always write an error to a log file. Obviously, that is not what I want because I know that the error 'Cannot communicate with server' is to be expected when the server does not exist! try { $session = new Session($dbhost, $dbport, $dbuser, $dbpwd); // db:exists returns a string 'false', still need to convert to bool $corpusExists = toBoolean($session->query("db:exists('$databaseName')")->execute()); $session->close(); if ($corpusExists) { $availabilityArray[] = $databaseName; } } catch (Exception $e) { // } This script works perfectly fine, but I do not want the errors to be logged (for this case) to prevent my error log to be full of the same error. Is there another way to test for a BaseX instance only? For instance, a way to return false when the server does not exist, I could do something like: $session = new Session($dbhost, $dbport, $dbuser, $dbpwd); If ($session) { // db:exists returns a string 'false', still need to convert to bool $corpusExists = toBoolean($session->query("db:exists('$databaseName')")->execute()); $session->close(); if ($corpusExists) { $availabilityArray[] = $databaseName; } } Thank you in advance Bram Vanroy

2 2

Some GUI suggestions
by Andy Bunce 27 Oct '16

27 Oct '16

Hi, Here are some suggestions for future GUI enhancements: Project window: * Add recent locations button, similar to the editor (recent files) Editor window: * use scrollable run of tabs rather than multi row see [1]. Ideally with dropdownlist to select any item as with Eclipse, Firefox etc. * more tab close options. E.g "close all", "close others" Query info window Very useful but typically, at any one time, I am only interested in a particular section from: Compiling,Optimized Query,Query,Result,Timing,Query plan. Maybe checkbox config for which are shown or links to sections or tabs for sections Map/tree/folder windows All these views are rooted at a document. There are times when I would like a collection based root here, as shown on database>properties>resources Cheers /Andy [1] http://docs.oracle.com/javase/7/docs/technotes/guides/swing/1.4/tabbedPane.…

3 5

Re: [basex-talk] Text resources
by Kendall Shaw 27 Oct '16

27 Oct '16

Err… I mean: convert:binary-to-string(db:retrieve(‘some’,’some.txt’)) Can I skip the base64 part? Kendall From: <basex-talk-bounces(a)mailman.uni-konstanz.de> on behalf of Kendall Shaw <kendall.shaw(a)workday.com> Date: Wednesday, October 26, 2016 at 5:05 PM To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Subject: [basex-talk] Text resources Is this how I should retrieve text that is stored using db:store, within xquery? stream:materialize(db:retrieve(‘some’,’some.txt’)) ? Kendall

2 1

Text resources
by Kendall Shaw 27 Oct '16

27 Oct '16

Is this how I should retrieve text that is stored using db:store, within xquery? stream:materialize(db:retrieve(‘some’,’some.txt’)) ? Kendall

1 0

Adding UIDs to all the elements in a collection
by Graydon Saunders 19 Oct '16

19 Oct '16

HI -- In the process of trying to find the differences between two collections of schemas (the XML differences, as opposed to the not-semantically-meaningful differences in the order of the definitions), I find myself wanting to stick UIDs on everything. (So I can go "oh, this element node is different, but it has descendant elements UIDs also in the list of differences, I don't want this one, the descendants are more precise" (because if I don't do something like this, I'm getting xsd:schema every time...)) I haven't done anything with updating expressions before. By itself, in the GUI, for $x in /descendant-or-self::* return insert node(attribute UID {generate-id($x)}) into $x works. Since I would like everything in one query, with a little flailing I've got as far as let $new as document-node()+ := for $each in db:open($newName) return copy $temp := $each modify ( for $x in $temp/descendant-or-self::* return insert node(attribute UID {generate-id($x)}) into $x ) return $temp return $new And there are all the elements with UID attributes associated with them. Is there a better way to do this? Thanks! Graydon

3 3

Compiler issue?
by Marco Lettere 17 Oct '16

17 Oct '16

Dear BaseX team, running the following two queries [1,2] (which should be semantically equivalent to my eyes) I get different results. In particular [2] sometimes return multiple results or empty sequence which is pretty odd, isn't it? I've tried on 8.5.3 and on a recent snapshot labeled 8.5.4 (beta 6e9bf7c). Regards, Marco. [1] let $domain := for $record in (1 to 100) where $record mod 5 = 0 return $record let $index := 1 + random:integer(count($domain)) return $domain[$index] [2] let $domain := for $record in (1 to 100) where $record mod 5 = 0 return $record return $domain[1 + random:integer(count($domain))]

2 2

Creating more than a million databases per session: Out Of Memory
by Bram Vanroy | KU Leuven 17 Oct '16

17 Oct '16

Hi all I've talked before on how we restructured our data to drastically improve search times on a 500 million token corpus. [1] Now, after some minor improvements, I am trying to import the generated XML files into BaseX. The result would be 100,00s to millions of BaseX databases - as we expect. When doing the import, though, I am running into OOM errors. We put our memory limit on 512MB. The thing is that this seems incredibly odd to me: because we are creating so many different databases, which are all really small as a consequence, I would not expect BaseX to need to store much in memory. After each database is created, the garbage collector can come along and remove everything that was needed for the previously generated database. A solution, I suppose, would be to close and open the BaseX session on each creation but I'm afraid that (on such a huge scale) the impact on speed would be too large. How it is set up now, in pseudo code: ---------------------------------------------------------------------------- ---- $session = Session->new(host, port, user, pw); # @allFiles is at least 100,000 items For $file (@allFiles) { $database_name = $file . "name"; $session->execute("CREATE DB $database_name file "); $session->execute("CLOSE"); } $session->close(); ---------------------------------------------------------------------------- ---- So all databases are created on the same session which I believe causes the issue. But why? What is still required in memory after ->execute("CLOSE")? Are the indices for the generated databases stored in memory? If so, can we force them to write to disk? ANY thoughts on this are appreciated. Enlightenment on how what is stored in a Session's memory is useful as well. Increasing the memory should be a last resort. Thank you in advance! Bram [1]: http://www.lrec-conf.org/proceedings/lrec2014/workshops/LREC2014Workshop-CML C2%20Proceedings-rev2.pdf#page=20

3 4

executing xquery on basex
by Wang, Genneva 16 Oct '16

16 Oct '16

Hi We have seen some weird issue with basex only when executing xquery via java client (the basexclient.java from https://github.com/BaseXdb/basex/blob/master/basex-examples/src/main/java/o…) . And I was wondering if you would have any tips. The issue is happening when executing xquery to execute the function fn:current-dateTime() We have logs the queries that we are sending prior to calling the execute method in BasexClient.java, so we know that the xquerys are constructed correctly. However, we have been receiving inconsistent results from execute this xquery. Below are some examples of the basex logs. 05:42:40.907 172.16.0.43:51776 admin REQUEST XQUERY fn:current-dateTime() 0.11 ms 05:42:40.908 172.16.0.43:51776 admin OK Query executed in 0.18 ms. 0.77 ms 05:42:44.787 172.16.0.35:56245 admin REQUEST Ìº°Ì±ïERY fn:current-dateTime() 10000.3 ms 05:42:44.787 172.16.0.35:56245 admin ERROR Stopped at , 1/6: Unknown command: Ìº°Ì±ïERY. Did you mean 'ALTER'? 0.03 ms In this basex log, as you can see, that the first time that the query "XQUERY fn:current-dateTime()"went successful, and somehow the second time the the query was being altered (in red above) and the query was not able to recognize the query from basex. We were not able to reproduce this issue consistently. We have cross check the log on our applications so we know that the query has been constructed the same prior to making calls to basex. Any thoughts would be greatly appreciated. Thanks. Regards, -Genneva

2 1