BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5256 discussions

Potential Bug 9.0
by Dieter Zanzinger 05 Nov '18

05 Nov '18

Dear BaseX-Team, I encountered some unexpected behavour, maybe a bug? I declare a collection of function-signatures. Then I iterate over the collection inside a copy/modify-construct. Each function adds a node to the database. This works as expected: declare variable $_:abschlussqueries := (_:f1#2 , _:f2#2); declare %updating %rest:path('treez/ab4') function _:abschluss4() as element() { <Postabschluss>{ ( try{ let $db := doc('FGfax')/Dateien/Datei for $d in $db return ( copy $c := $d modify ( for $funct at $counter in $_:abschlussqueries return ( (: prof:dump("bla: " || $counter) , :) prof:void(""), $funct($c, $counter) ) ) return ( $c ) ) } catch * { let $db := doc('FGfax')/Dateien return error(xs:QName("dieter:norights10"), "Error: "|| $err:code || ': ' || $err:description , 418 ) } ) }</Postabschluss> }; declare %updating function _:f1($c, $counter ) { try {( filepath:copy-to("C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla.xml","C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla1.xml"), insert node <f1>function1 </f1> as last into $c )} catch * { insert node <f1>{"Error: "|| $err:code || ': ' || $err:description}</f1> as last into $c } }; declare %updating function _:f2($c, $counter ) { try {( filepath:copy-to("C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla.xml","C:\Users\Win7ProUser\Documents\FGscan_ScanDocs\bla1.xml"), insert node <f2>function2 </f2> as last into $c )} catch * { insert node <f2>{"Error: "|| $err:code || ': ' || $err:description}</f2> as last into $c } }; ————————————— Result: <?xml version="1.0" encoding="ISO-8859-1"?> <Postabschluss> <> <Datei uuid="8ad03f50-4b9c-461a-b818-1a97dc5735e9"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061002-154925-00498171251x1800.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> <Datei uuid="26a3aee7-a0d8-4b8d-acd4-90554c8ab28c"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061003-154928-0049242344x1801.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> <Datei uuid="af0548aa-08cf-464a-839d-421363f452ce"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061220-154966-004999429025.pdf</sortedPath> <f1> <>function1 </f1> <f2> <>function2 </f2> </Datei> —————— But if remove the line: prof:void("“), the result is: <?xml version="1.0" encoding="ISO-8859-1"?> <Postabschluss> <> <Datei uuid="8ad03f50-4b9c-461a-b818-1a97dc5735e9"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061002-154925-00498171251x1800.pdf</sortedPath> </Datei> <Datei uuid="26a3aee7-a0d8-4b8d-acd4-90554c8ab28c"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061003-154928-0049242344x1801.pdf</sortedPath> </Datei> <Datei uuid="af0548aa-08cf-464a-839d-421363f452ce"> <> <sortedPath znen=""> <>@SMB10.211.55.6/netzlaufwerktestF/sortierter_Posteingang/OHNE/#Fax_OHNE_AZ--201803061220-154966-004999429025.pdf</sortedPath> </Datei> </Postabschluss> Do you have any explanation for this behavour? Some other updating expression instead of prof:void(„“) works as well. But if my only call is to the functions, it does not work. Sincerely Dieter Zanzinger

2 1

Conceptual problems using BaseX from Python
by Kristian Kankainen 03 Nov '18

03 Nov '18

Hello, XQuery is a lovely language and together with BaseX it is very lovely. But now, for a project that need Python, I find difficulties understanding the general workflow communicating between BaseX and Python. My basic situation boils down to 1) execute a query on BaseX that returns a list of data 2) analyse every item in the in Python 3) push the analysis result back in to BaseX. I have done updates like this solely in XQuery but this time I need the analysis part done in Python. Since I seem to only get a list of strings out of a query executed by the client, is this usecase even possible? Below is attached my sample running code Best regards, Kristian K ```Python from BaseXClient import BaseXClient # open a session session = BaseXClient.Session('localhost', 1984, 'admin', 'admin') # execute a query that returns a list of entry elements query = session.query(""" let $list := <list> <entry> <a>1</a> 2 </entry> <entry> <a>1</a> 2 <c>3</c> </entry> </list> let $items := for $entry in $list/entry[not(exists(./c))] return $entry return $items """ ) # process each item of the query for typecode, item in query.iter(): print(type(item)) print(item) session.close() ``` This returns simply: <class 'str'> # the type of returned item is of class 'str' <entry> # this is the content of the plain text object <a>1</a> 2 </entry>

3 2

blanks after , in set no longer allowed...
by Peter Villadsen 01 Nov '18

01 Nov '18

Hi I installed version 9.1. the other day, and I found that my app did not work after that. A little debugging quickly identified the culprit. When I submit queries to the backend I calculate a set of predefined variable bindings used in the queries. It turns out I did: public string CalculateBindingsString(params Tuple<string, string>[] vars) { string result = string.Empty; if (vars != null) { foreach (var v in vars) { var name = v.Item1; var value = v.Item2; if (ValidateVariableName(name)) { if (result.Any()) result += ", "; result += name + "=" + value; } } } return result; } See the blank there? That caused the subsequent USE BINDINGS call to fail. Removing the blank fixed it all. If this was part of a bug fix, the fix was a breaking change. Is there a list of such breaking changes for each release? Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

1 0

BaseX 9.0: The Spring Edition!
by Christian Grün 01 Nov '18

01 Nov '18

Dear BaseX aficionados, We are very happy to announce the release of BaseX 9.0! The new version of our XML database system and XQuery 3.1 processor includes some great new features and a vast number of minor improvements and optimizations. It’s both the usage of BaseX in productive environments as well as the valuable feedback of our open source users that make BaseX better and better, and that allow and motivate us to keep going. Thanks to all of you! Along with the new release, we invite you to visit our relaunched homepage: http://basex.org/. Java 8 is now required to run BaseX. The most prominent features of Version 9.0 are: XQUERY - Comprehensive extensions in the internal XQuery optimizer framework - Dynamic hash joins rewritings of general comparisons - Register query jobs as persistent services - Process very large CSV files via the new CSV 'xquery' format - Update Module: higher-order functions for performing updates - Unified static typing, including maps, arrays and function items - COPYNODE: Lightweight copying of XML fragments - ENFORCEINDEX: Enforce rewriting for index access STORAGE - Improved database compression (short strings, whitespaces) WEB APPLICATIONS - Permissions layer: Unified definition of RESTXQ access patterns - RESTXQ: Full support for client- and server-side quality factors - REST: Run BaseX command scripts - Web server upgrade to Jetty 9 REPOSITORIES - Combined packaging mechanism (XQuery and Java) - Java Packaging: Bundling of additional libraries DISTRIBUTIONS - Revised detection and configuration of BaseX home directory - Windows executable: better detection of Java libraries DBA: BASEX DATABASE ADMINISTRATION - Improved editing and evaluation of XQuery modules - Revised file, session and job management More details can be found on our homepage. We are looking forward to your feedback. Enjoy and have fun, Christian, BaseX Team

7 8

ArrayIndexOutOfBoundsException: Maximum array size reached
by Han (US), Paul P 30 Oct '18

30 Oct '18

Hello, We encountered the below error when using this API: archive:extract-to($tempDirPath, file:read-binary($zipFilePath)). The zip file size is 51396593 and the inflated file size is 2796146027. Please let me know if you need additional information. We expect our data files to be at least 10 times bigger than these numbers. POST failed with response 400: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de> Version: BaseX 9.0.2 Java: Oracle Corporation, 1.8.0_121 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Maximum array size reached. at org.basex.util.Array.newSize(Array.java:238) at org.basex.util.Array.newSize(Array.java:227) at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.io.OutputStream.write(OutputStream.java:116) at org.basex.query.func.archive.ArchiveIn.read(ArchiveIn.java:77) at org.basex.query.func.archive.ArchiveExtractTo.item(ArchiveExtractTo.java:40) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:48) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:330) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) at org.basex.core.cmd.AQuery.query(AQuery.java:100) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) at org.basex.http.rest.RESTQuery.query(RESTQuery.java:69) at org.basex.http.rest.RESTQuery.run0(RESTQuery.java:37) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.core.Command.execute(Command.java:116) at org.basex.http.rest.RESTServlet.run(RESTServlet.java:27) at org.basex.http.BaseXServlet.service(BaseXServlet.java:59) at javax.servlet.http.HttpServlet.service(HttpServlet.java:729) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:230) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.catalina.filters.CorsFilter.handleNonCORS(CorsFilter.java:419) at org.apache.catalina.filters.CorsFilter.doFilter(CorsFilter.java:169) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:192) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:165) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:198) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:474) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:140) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:79) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:624) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:349) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:783) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:798) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1434) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.lang.Thread.run(Thread.java:745) Regards, Paul

2 2

slow DB when updating
by radim-havlicek＠post.cz 30 Oct '18

30 Oct '18

Hello, when one client is uploading file to a database (let's say Database1), upd. basex file is created and exists until the file is uploaded to the database Database1. Problem is that meanwhile the upload is running, all other clients reading data from the Database1 read the data very, very slowly. Also clients trying to read data from Database2 or Database3 reads the data very, very slowly while the upload to Database1 is running. Also the client trying to upload data to Database2 is not successful until the upload to Database1 is done. Database1, Database2 and Database3 are databases in the same BaseX database. Can I speed up the loading data from various databases at the same time or the parallel uploading? I've read about the PARALLEL option in .basex option file, but are there any best practices what the value should be regarding to the database size or the number of databases? And are there similar best practices to CACHETIMEOUT, TIMEOUT and KEEPALIVE options? Are there more information than what is at http://docs.basex.org/wiki/Options ? Thanks for your reply in advance. Best regards, Radim Havlicek

2 1

How to pass an XPath expression as parameter?
by Andreas Mixich 29 Oct '18

29 Oct '18

Is there a way to do something like this? declare function local:insert( $doc as node(), $at-location as xpath(), (: I know, there is no 'xpath' type, this is just for demo :) $what as node()* ) as node() { copy $c := $doc modify insert node $what into $at-location return $c }; let $xml := <xml><body>This is a paragraph.</body></xml> let $nd := <this><is><a>Test</a></is></this> return local:insert($xml, xpath("/body"), $nd) As I see it, it would need a dynamic xs:string => XPath expression conversion or a defer XPath expression, which both do not exist, for $at-location. I managed to do this, however: declare function local:insert($doc, $at-location, $what) { let $update := ``[ declare variable $doc external; declare variable $what external; declare variable $at-location external; copy $c := $doc modify insert node $what into `{$at-location}` return $c ]`` return xquery:eval($update, map{ 'doc':$doc, 'at-location':$at-location, '$what':$what }) }; let $xml := <xml><body>This is a paragraph.</body></xml> let $node := <this><is><a>Test</a></is></this> return local:insert($xml, "$c/body", $node) Ideally (for me), there would be a 'defer' XPath expression, that starts its life as a string (when passed) and then unfolds upon call. Or a type (or function) fn:xpath(), that behaves that way. Or am I just blind and don't see the obvious, and there *is* a simpler solution? -- Minden jót, all the best, Alles Gute, Andreas Mixich

2 2

BaseX-standard-installation-with-embedded-jetty-- how to deploy other webapp
by Dieter Zanzinger 27 Oct '18

27 Oct '18

Dear BaseX-fellows, the websocket-feature in 9.1 is great. Now- to use ist, I need the BaseX-Version with embedded Jetty. My problem is, that I need another web app, too. Up to now, I used Tomcat as container for BaseX and the other webapp. Is it possible, to deploy another app in the embedded Jetty ? Any hints, how to do that? In Tomcat and - as far as I know in a standard Jetty installation - I just copy the .war into the webapps-Folder. That doesn´t work in the embedded Jetty. I would be glad for hints. Sincerely Dieter Zanzinger

2 1

fn:format-number() for german style numbers
by Wiemer, Sebastian 27 Oct '18

27 Oct '18

2 1

Database Updates
by Dave Kopecek 25 Oct '18

25 Oct '18

Hi All, Given a database created from catalog.xml below. What's the best way to update & add records received daily as in file daily-update.xml ? Coming from relational DBs & new to this. I ultimately need to script/automate this. Hoping there's some magic command I'm missing & looking for best way to approach the problem. Thanks, -Dave catalog.xml <?xml version="1.0" encoding="UTF-8"?> <CATALOG> <ENTRIES> <ENTRY> <SKU>1</SKU> <TITLE>Empire Burlesque</TITLE> <ARTIST>Dylan</ARTIST> <PRICE>10.90</PRICE> </ENTRY> <ENTRY> <SKU>2</SKU> <TITLE>Hide your heart</TITLE> <ARTIST>Bonnie Tyler</ARTIST> <PRICE>9.90</PRICE> </ENTRY> </ENTRIES> </CATALOG> daily-update.xml <?xml version="1.0" encoding="UTF-8"?> <CATALOG> <ENTRIES> <ENTRY> <SKU>1</SKU> <PRICE>19.90</PRICE> <NEWTHING>I wasn't here before the update</NEWTHING> </ENTRY> <ENTRY> <SKU>1971</SKU> <TITLE>Tupelo Honey</TITLE> <ARTIST>Van Morrison</ARTIST> <PRICE>8.20</PRICE> </ENTRY> </ENTRIES> </CATALOG>

3 5

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk