June 2018 - BaseX-Talk - mailman.uni-konstanz.de

Global locks
by Andy Bunce 11 Feb '19

11 Feb '19

Running the following in the GUI (8.6.5) ``` let $db:="BEP" return count(collection($db)) ``` The info windows shows $db is inlined Compiling: - inline $db_0 - pre-evaluate collection("BEP") to document-node() sequence - pre-evaluate count((db:open-pre("BEP",0), ...)) to xs:integer - simplify gflwor Optimized Query: 9193 All good. Submitting a job ``` let $q:='let $db:="BEP" return count(collection($db))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` returns: <job id="job90" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.007S" reads="(global)" writes="(none)">let $db:="BEP" return count(collection($db))</job> Note @reads="(global)" But ``` let $q:='count(collection("BEP"))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` <job id="job92" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.006S" reads="BEP" writes="(none)">count(collection("BEP"))</job> Note @reads="BEP" Is this correct and/or of any consequence? /Andy

2 8

BaseX 9.0: The Spring Edition!
by Christian Grün 01 Nov '18

01 Nov '18

Dear BaseX aficionados, We are very happy to announce the release of BaseX 9.0! The new version of our XML database system and XQuery 3.1 processor includes some great new features and a vast number of minor improvements and optimizations. It’s both the usage of BaseX in productive environments as well as the valuable feedback of our open source users that make BaseX better and better, and that allow and motivate us to keep going. Thanks to all of you! Along with the new release, we invite you to visit our relaunched homepage: http://basex.org/. Java 8 is now required to run BaseX. The most prominent features of Version 9.0 are: XQUERY - Comprehensive extensions in the internal XQuery optimizer framework - Dynamic hash joins rewritings of general comparisons - Register query jobs as persistent services - Process very large CSV files via the new CSV 'xquery' format - Update Module: higher-order functions for performing updates - Unified static typing, including maps, arrays and function items - COPYNODE: Lightweight copying of XML fragments - ENFORCEINDEX: Enforce rewriting for index access STORAGE - Improved database compression (short strings, whitespaces) WEB APPLICATIONS - Permissions layer: Unified definition of RESTXQ access patterns - RESTXQ: Full support for client- and server-side quality factors - REST: Run BaseX command scripts - Web server upgrade to Jetty 9 REPOSITORIES - Combined packaging mechanism (XQuery and Java) - Java Packaging: Bundling of additional libraries DISTRIBUTIONS - Revised detection and configuration of BaseX home directory - Windows executable: better detection of Java libraries DBA: BASEX DATABASE ADMINISTRATION - Improved editing and evaluation of XQuery modules - Revised file, session and job management More details can be found on our homepage. We are looking forward to your feedback. Enjoy and have fun, Christian, BaseX Team

7 8

Full-Text
by Ветошкин Владимир 23 Jul '18

23 Jul '18

4 22

Passing sequence of strings to the java class
by Alexander Shpack 03 Jul '18

03 Jul '18

Hey, team! Just simple question. How to pass sequence of string to the java class? let $values := for $i in (1 to 3) return $i cast to xs:string return j:exec($values) In case when local function returns one item all is good. Otherwise j:exec takes array of item()+, but not the array of stings. If you just call j:exec(("1","2")) than all works as expected. Any thoughts? Is it bug or feature? ;) BaseX 9.0 Thanks! -- s0rr0w

2 7

Unexpected removal of BaseX Database
by Arjan Loeffen 02 Jul '18

02 Jul '18

Dear BaseX people, We create a backup of a BaseX 8.6.4 database using a windows scheduled process: call basexclient -V -Uadmin -Padmin -c "CREATE BACKUP imvertor-*" We have a server process that interacts with the databases, all called Imvertor-*. In accessing the database at certain moments the backup process seems to conflict with the update process. This is visible in the log: [...] 11:59:12.012 127.0.0.1:60319 admin REQUEST [GET] http://localhost:8984/rest/ imvertor-jobs 11:59:12.106 127.0.0.1:60319 admin 200 95.65 ms 11:59:12.121 127.0.0.1:60319 admin REQUEST [DELETE] http://localhost:8984/rest/imvertor-jobs/2018-06-14-11-58-17-450.xml 11:59:12.137 127.0.0.1:60319 admin 200 5.08 ms 11:59:12.137 127.0.0.1:60322 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs 11:59:12.200 127.0.0.1:60322 admin 200 73.59 ms 11:59:12.215 127.0.0.1:60322 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs 11:59:21.075 127.0.0.1:60323 admin REQUEST SET QUERYINFO 0.13 ms 11:59:21.075 127.0.0.1:60323 admin OK QUERYINFO: true 0.1 ms *11:59:21.184 127.0.0.1:60323 <http://127.0.0.1:60323/> admin REQUEST CREATE BACKUP imvertor-* 0.21 ms* *11:59:22.372 127.0.0.1:60322 <http://127.0.0.1:60322/> admin 400 Database 'imvertor-jobs_665091421' could not be renamed. 10166.92 ms* *11:59:22.372 127.0.0.1:60322 <http://127.0.0.1:60322/> admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs <http://localhost:8984/rest/imvertor-jobs>* *11:59:27.309 127.0.0.1:60323 <http://127.0.0.1:60323/> admin ERROR Database 'imvertor-jobs' is being updated, or update was not completed. Backup for 'imvertor-jobs-regression' was created in 53.29 ms. Backup for 'imvertor-jobs_665091421' was created in 1262.1 ms. Backup for 'imvertor-models' was created in 4760.92 ms. Backup for 'imvertor-models-regression' was created in 51.58 ms. 6128.15 ms* *11:59:27.309 127.0.0.1:60322 <http://127.0.0.1:60322/> admin 404 Database 'imvertor-jobs' was not found. 4932.96 ms* 12:01:03.465 127.0.0.1:60325 admin REQUEST [GET] http://localhost:8984/rest/?command=list 12:01:03.481 127.0.0.1:60325 admin 200 3.24 ms 12:01:03.543 127.0.0.1:60325 admin REQUEST [GET] http://localhost:8984/rest/ imvertor-jobs 12:01:03.543 127.0.0.1:60325 admin 404 Database 'imvertor-jobs' was not found. 0.36 ms 12:01:03.543 127.0.0.1:60325 admin REQUEST [PUT] http://localhost:8984/rest/ imvertor-jobs 12:01:03.575 127.0.0.1:60325 admin 201 Database 'imvertor-jobs' created in 13.47 ms. 22.83 ms [...] This is rather a serious problem; the whole database is lost. Our software is set up such that the database is created when it is not found. Hence the last log... Do you recognize the problem, and can you specify how to avoid it? Hope this gives you enough info. Thanks in advance! -- Arjan Loeffen, Armatiek BV 06-12918997

2 2

GUI
by Giuseppe Celano 29 Jun '18

29 Jun '18

Hi, I have updated Java (10 from 8) and I cannot apparently customize the GUI anymore on my Mac (if I click on BaseXGUI > aboutBaseXGUI, I cannot access the relevant tabs). Is this a known issue? Moreover, if I start the GUI from the command line, I keep getting the warning message "Illegal reflective access by org.basex.gui.GUIMacOSX". Is there a way to avoid that? Thanks. Ciao, Giuseppe Universität Leipzig Institute of Computer Science, NLP Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano(a)informatik.uni-leipzig.de E-mail: giuseppegacelano(a)gmail.com Web site 1: http://www.dh.uni-leipzig.de/wo/team/ Web site 2: https://sites.google.com/site/giuseppegacelano/

3 6

Tracing query execution
by Iwan Briquemont 29 Jun '18

29 Jun '18

Hello, I use BaseX mostly for boolean queries, I have a hardware database and I check if specific hardware support features I need. It works great but when something is not as expected, it's hard to find out the reason. E.g. given an expression like: $some-value = $some-list and (custom:predicate() or $x > $y) I would like to know why it's true or false. For now I add trace() manually on the subexpressions, rerun, add trace to more specific parts, etc. Ideally I would want to break down the query execution so it shows the values of subparts of the query to pinpoint why it is false, e.g. have an output like: $some-value = $some-list and (custom:predicate() or $x > $y) -> false()$some-value = $some-list -> true()$some-value -> 1$some-list -> (1, 2, ..., 10)custom:predicate() or $x > $y -> false()custom:predicate() -> false()... # It should also go inside the function$x > $y -> false()$x -> 10$y -> 11 Any ideas how it could be achieved? Looking at the code, maybe a debug() (like iter() or item()) method could be added to Expr objects which would trace the expression query, file, line and the result of the expression (or probably the first x characters of the result to avoid huge output)? With an xquery function which would trigger it. I also thought of modifying the query programmatically to add trace() calls but that seems overly complicated. Best regards, Iwan

3 2

Distributing service as EAR
by Mauro Mugnaini 29 Jun '18

29 Jun '18

Hi All, We are used to implement and deploy services into containers (Tomcat, JBoss, Wildfly, ...) as single WAR and for this kind of work we always implement starting from the BaseX WAR distribution. Now, looking in depth into the structure of the WAR, we noted that all the third party JARs, BaseX common classes JAR and XQJ bridge JAR are located into WEB-INF/lib folder whereas HTTP related classes (filters, servlet, listener and so on) are located inside the WEB-INF/classes. Moreover a possibly useless (?) WEB-INF folder with another web.xml and another jetty.xml in the same WEB-INF/classes. My question is: is there any reason why files in WEB-INF/classes are not “jarred” into a single archive and placed into WEB-INF/lib folder? Are there any cons doing that way according to your experience? The objective is to optimize the EAR content, where several WARs of services are packaged into a single EAR file, by factoring out all the JARs into the /lib folder of the EAR. Thank you and regards, Mauro

2 1

Cancelling long running query
by Shaun Flynn 29 Jun '18

29 Jun '18

Hello there, I have had a look in the documentation and was wondering, is it possible to cancel a query once it has been submitted using ClientQuery/ClientSession? Would calling close() on ClientQuery do that? Shaun

3 2

Copy Path in GUI seems to recently not give correct path for target
by Alex Everitt 28 Jun '18

28 Jun '18

Hi, I'm fairly certain there is a bug in the GUI now. I often right click in the GUI and choose Copy Path (from tree and map etc.) and until recently that worked every time. Now I'm getting paths that are just obviously not correct from the second level of the tree down. The first level of the tree is ok. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse Then the second level of the tree and levels not ok. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResult/ListOrdersResult *Should be: db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse/ ListOrdersResult And so on. db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/Orders/Orders/Orders *Should be: db:open("bigale_order_list_since_2017-03-31", "bigale_orders_1")/ListOrdersResponse/ ListOrdersResult/Orders This may have started since the 9 release. Thanks, Alex Everitt

2 1