BaseX-Talk

basex-talk@mailman.uni-konstanz.de

7 participants
5254 discussions

Add namespace bindings via copy/modify/return
by Hans-Juergen Rennau 24 Sep '25

24 Sep '25

Dear BaseX people, I cannot use copy/modify/return in order to add a namespacing: let $doc := <doc><a/></doc>return copy $doc_ := $doc modify insert node namespace xyz {'https://basex.org/ns'} into $doc_ return $doc_ =><doc> <a/></doc> Is this a bug? Kind regards,Hans-Jürgen

5 8

Multithreading issues after upgrade to BaseX 12
by Johannes Bauer 22 Sep '25

22 Sep '25

Hi, we experience some problems after the upgrade to version 12 with the fulltext search. We are using xquery:fork-join() to run the fulltext search on multiple databases at the same time (see attachment). This worked fine with version 11 but has strange effects after the upgrade to version 12. With BaseX 11 the log output is like this: 09:03:51.054 [0:0:0:0:0:0:0:1]:55079 admin REQUEST [POST] /dba/query?file=ftsearch.xq 09:03:51.203 SERVER admin TRACE local:search-db(ALL) 100.4 ms 09:03:51.204 SERVER admin TRACE local:search-db(ALL) 1721 09:03:51.243 SERVER admin TRACE local:matches() 38.84 ms 09:03:51.270 SERVER admin TRACE local:search-db(MD) 166.69 ms 09:03:51.270 SERVER admin TRACE local:search-db(MD) 1883 09:03:51.282 SERVER admin TRACE local:matches() 11.9 ms ... 09:03:52.284 SERVER admin TRACE local:search-db(XP) 307.84 ms 09:03:52.284 SERVER admin TRACE local:search-db(XP) 74128 09:03:52.525 SERVER admin TRACE local:matches() 241.64 ms 09:03:52.796 SERVER admin TRACE local:matches() 581.56 ms 09:03:52.796 SERVER admin TRACE local:search-distinct() search "test" 1710.79 ms 09:03:53.200 [0:0:0:0:0:0:0:1]:55079 admin 200 2160.7 ms After about 2 seconds the search is finished. With BaseX 12 two things might happen. ConcurrentModificationException This happens almost immediatelly. 500 Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 12.0 Java: Eclipse Adoptium, 21 OS: Windows 10, amd64 Stack Trace: java.util.ConcurrentModificationException at java.base/java.util.ArrayList$Itr.checkForComodification(ArrayList.java:1095) at java.base/java.util.ArrayList$Itr.next(ArrayList.java:1049) at org.basex.query.QueryResources.close(QueryResources.java:94) at org.basex.query.QueryContext.close(QueryContext.java:543) at org.basex.http.restxq.RestXqResponse.finish(RestXqResponse.java:152) at org.basex.http.web.WebResponse.create(WebResponse.java:63) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:70) at org.basex.http.BaseXServlet.service(BaseXServlet.java:68) at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:587) at org.eclipse.jetty.ee9.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1397) at org.eclipse.jetty.ee9.servlet.ServletHolder.handle(ServletHolder.java:765) at org.eclipse.jetty.ee9.servlet.ServletHandler.doHandle(ServletHandler.java:528) at org.eclipse.jetty.ee9.nested.ScopedHandler.handle(ScopedHandler.java:127) at org.eclipse.jetty.ee9.security.SecurityHandler.handle(SecurityHandler.java:603) at org.eclipse.jetty.ee9.nested.HandlerWrapper.handle(HandlerWrapper.java:124) at org.eclipse.jetty.ee9.nested.ScopedHandler.nextHandle(ScopedHandler.java:197) at org.eclipse.jetty.ee9.nested.SessionHandler.doHandle(SessionHandler.java:612) at org.eclipse.jetty.ee9.nested.ScopedHandler.nextHandle(ScopedHandler.java:195) at org.eclipse.jetty.ee9.nested.ContextHandler.doHandle(ContextHandler.java:1045) at org.eclipse.jetty.ee9.nested.ScopedHandler.nextScope(ScopedHandler.java:164) at org.eclipse.jetty.ee9.servlet.ServletHandler.doScope(ServletHandler.java:483) at org.eclipse.jetty.ee9.nested.ScopedHandler.nextScope(ScopedHandler.java:162) at org.eclipse.jetty.ee9.nested.SessionHandler.doScope(SessionHandler.java:589) at org.eclipse.jetty.ee9.nested.ScopedHandler.nextScope(ScopedHandler.java:162) at org.eclipse.jetty.ee9.nested.ContextHandler.doScope(ContextHandler.java:966) at org.eclipse.jetty.ee9.nested.ScopedHandler.handle(ScopedHandler.java:125) at org.eclipse.jetty.ee9.nested.ContextHandler.handle(ContextHandler.java:1719) at org.eclipse.jetty.ee9.nested.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1565) at org.eclipse.jetty.ee9.nested.HttpChannel.dispatch(HttpChannel.java:724) at org.eclipse.jetty.ee9.nested.HttpChannel.handle(HttpChannel.java:512) at org.eclipse.jetty.ee9.nested.ContextHandler$CoreContextHandler$CoreToNestedHandler.handle(ContextHandler.java:3029) at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1071) at org.eclipse.jetty.server.Server.handle(Server.java:182) at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:678) at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:416) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:322) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:99) at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:480) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:443) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:293) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:201) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:311) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:981) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1211) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1166) at java.base/java.lang.Thread.run(Thread.java:1583) 189.44 ms Full text search never finishes 09:00:12.422 [0:0:0:0:0:0:0:1]:55041 admin REQUEST [POST] /dba/query?file=ftsearch.xq 09:00:12.633 SERVER admin TRACE local:search-db(ALL) 115.46 ms 09:00:12.635 SERVER admin TRACE local:search-db(ALL) 1721 09:00:12.672 SERVER admin TRACE local:matches() 37.09 ms 09:00:12.711 SERVER admin TRACE local:search-db(MD) 194.24 ms 09:00:12.711 SERVER admin TRACE local:search-db(MD) 1883 09:00:12.725 SERVER admin TRACE local:matches() 13.66 ms 09:00:12.851 SERVER admin TRACE local:search-db(LS) 334.48 ms 09:00:12.851 SERVER admin TRACE local:search-db(LS) 169524 09:00:12.923 SERVER admin TRACE local:search-db(CT) 406.58 ms 09:00:12.923 SERVER admin TRACE local:search-db(CT) 80086 ... 09:00:13.483 SERVER admin TRACE local:search-db(US) 47012 09:00:13.553 SERVER admin TRACE local:search-db(POC) 828.06 ms 09:00:13.554 SERVER admin TRACE local:search-db(POC) 10147 09:00:13.693 SERVER admin TRACE local:search-db(MR) 1020.89 ms 09:00:13.693 SERVER admin TRACE local:search-db(MR) 223155 The process "hangs" and never finishes and CPU is running on full load. The current database where it hangs is always a different one. Does this have anything to do with the Jetty update? It seems to be related to the multithreading. Best Regards Johannes

2 1

Who wants to take over the management of my RBaseX package?
by Ben Engbers 16 Sep '25

16 Sep '25

Since my retirement (five years ago), there has been no reason for me to program in R or to continue working on maintaining my RBaseX package. This package is still being downloaded, and in all the years it has been available on the internet, I have never received any questions about it. Maintaining it will therefore take very little time. When I do program, I use the C++ language (and I still hope to get my C++ client for BaseX bug-free). Is there anyone who would like to take over the management of RBaseX? Ben Engbers

1 0

load-xquery-module
by Rob Stapper 15 Sep '25

15 Sep '25

Hi Christian, I'm experimenting with dynamic modul loading using: 'load-xquery-module'. I have a few questions concerning this function: - Does this function cache the loaded modul like "import module" does? If I interpret the profiling data correcty, it does not. If so is it possible to also cache dynamicly loaded modules? - "location-hints" of this function accepts a set of locations. It seems that all these locations must contain a module with the given modul-uri. I would expect the one would be sufficient. What is the idea behind this locationset? Thanx in advance for your response. mvgr. Rob Stapper

2 1

array:sort, array:sort-by, and docs access
by Bridger Dyson-Smith 23 Aug '25

23 Aug '25

Dear Christian and BaseX friends, I hope this email finds you well! I had a question about function signatures: it would seem that there's a typo/issue with the signature (and final example) for array:sort[1,2]. Shouldn't the signature for array:sort read: array:sort( $array as array(*), $collation as xs:string? := fn:default-collation(), $key as fn(item()*) as xs:anyAtomicType* := fn:data#1 ) as item()* (cribbed from the qt4cg.org specs[3])? Unless I'm misreading the signature... in which case, excuse me! Additionally, the current signature for array:sort seems to be in approximate alignment with array:sort-by, which is missing from our lovely BaseX docs' array page. To further my confusion, it looks like the examples from the qt4cg.org array:sort-by[4] signature work generally in my BaseX 12.0. Could that be added, or is the function still waiting in the BaseX wings? :) Best wishes, Bridger [1] https://docs.basex.org/main/Array_Functions#array:sort [2] the example `array:sort( [ 1, 2, 3 ], keys := fn($n) { -$n })` throws an error in BaseX 12.0: [XPST0017] array:sort(array[,collation,key]): Unknown keyword: keys. I'll update the example if I may please have access, otherwise, change `keys` to `key`, please. [3] https://qt4cg.org/specifications/xpath-functions-40/Overview.html#func-arra… [4] https://qt4cg.org/specifications/xpath-functions-40/Overview.html#func-arra…

2 2

Tracking xquery:fork-join()
by Johannes Bauer 13 Aug '25

13 Aug '25

Hi, I have question regarding parallel processing of requests. We use the following (simplified) code to run fulltext searches on multiple databases with xquery:fork-join() in parallel. The performance is tracked and logged with prof:time(). declare function documents:search-dbs($dbs as xs:string*, $query as xs:string) as element()* { let $funcs := for $db in $dbs return function() { documents:search-db($db, $query) } return xquery:fork-join($funcs) }; declare function documents:search-db($db as xs:string, $query as xs:string) as element()* { let $data := prof:time( (: Run fulltext search on database here :) (), 'documents:search-db(' || $db || ') ' ) return $data }; The log output looks like this: 17:58:54.125 SERVER admin TRACE documents:search-db(MD) 127.19 ms 17:58:54.139 SERVER admin TRACE documents:search-db(OEM) 142.39 ms 17:58:54.226 SERVER admin TRACE documents:search-db(CS) 229.55 ms 17:58:54.485 SERVER admin TRACE documents:search-db(TEST) 487.16 ms 17:58:54.989 SERVER admin TRACE documents:search-db(ALL) 991.72 ms 17:58:55.205 SERVER admin TRACE documents:search-db(POC) 1206.7 ms 17:58:56.461 SERVER admin TRACE documents:search-db(RO) 2462.38 ms 17:59:00.964 SERVER admin TRACE documents:search-db(US) 6965.86 ms 17:59:01.424 SERVER admin TRACE documents:search-db(PT) 7425.54 ms 17:59:02.260 SERVER admin TRACE documents:search-db(MI) 8262.05 ms 17:59:04.142 SERVER admin TRACE documents:search-db(XP) 10144.15 ms 17:59:05.300 SERVER admin TRACE documents:search-db(AT) 11301.95 ms 17:59:06.353 SERVER admin TRACE documents:search-db(CT) 12356.84 ms 17:59:12.157 SERVER admin TRACE documents:search-db(MR) 18158.48 ms 17:59:14.042 SERVER admin TRACE documents:search-db(LS) 20043.82 ms 17:59:14.999 SERVER admin TRACE documents:search-db(DA) 21000.18 ms To me it seems that the requests are not done in parallel. The request time is always cumulative. Questions: - Is this just an issue of the prof:time() logging? - Do the searches really run in parallel? - Or are they maybe blocked and serialized by some database lock? Any help to analyse this will be appreciated. Best Regards Johannes

1 0

file:current-dir(), file:path-to-native()
by Hans-Juergen Rennau 08 Aug '25

08 Aug '25

Dear BaseX people, I noticed a peculiar behaviour of file:current-dir() on a Windows system. file:current-dir()=>C:\program files\Oxygen XML Editor 25\ file:path-to-native(current-dir()=>C:\Program Files\Oxygen XML Editor 25\ Note the difference: "Program Files" vs. "programfiles". Is this intended? Would one not expect that any path returned by a file:* function *is* native? (Remark: the difference of case can become very important when constructing relative paths.) Kind regards,Hans-Jürgen : On the system in question, the folder "Program Files" is mapped to "programme" (I do not know the reasons. cu

2 2

Migration einer alten RESTXQ-Anwendung nach BaseX 12.0 - ClassNotFoundException für Servlets
by Günter Dunz-Wolff 08 Aug '25

08 Aug '25

"Ich migriere eine bestehende Anwendung von einer alten BaseX-Version auf BaseX 12.0." "Mein systemd-Dienst startet den Server, aber die Anwendung schlägt mit einem 503-Fehler fehl." "Das Log zeigt java.lang.ClassNotFoundException für org.basex.http.rest.RestServlet und org.basex.http.restxq.RestXqServlet." Fügen Sie den Inhalt Ihrer web.xml bei. Frage: "Wie lauten die korrekten Klassennamen und die korrekte web.xml-Konfiguration, um REST und RESTXQ in BaseX 12.0 zu aktivieren?"

2 4

validate:xsd-report - resolving imports
by Hans-Juergen Rennau 08 Aug '25

08 Aug '25

Dear BaseX people, using function 'validate:xsd-report' I notice a surprising behaviour: - if supplying the XSD via URI, it works as expected- if supplying the XSD as node, the imports cannot be resolved Is this a known behaviour and intended? In case it is not, see PS for simple code reproducing the behaviour. Kind regards,Hans-Jürgen PS:(1) doc.xml<doc b:att="99" xmlns:b="http://basex.org"/> (2) schema1.xsd<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:b="http://basex.org" elementFormDefault="qualified"> <xs:import namespace="http://basex.org" schemaLocation="schema2.xsd"/> <xs:element name="doc"> <xs:complexType> <xs:attribute ref="b:att"/> </xs:complexType> </xs:element></xs:schema> (3) schema2.xsd<xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" targetNamespace="http://basex.org" elementFormDefault="qualified"> <xs:attribute name="att" type="xs:integer"/></xs:schema> (4) validate.xqvalidate:xsd-report('doc.xml', 'schema1.xsd'),'===',validate:xsd-report('doc.xml', doc('schema1.xsd'))

2 1

Websocket configuration Basex 12
by Andy Bunce 05 Aug '25

05 Aug '25

Hi, I would like to increase the websocket message length from the default of 64 KB. The websocket documentation implies this can be done via web.xml [1] However, while searching for the syntax I came across the suggestion it is different with the Jetty version 12 API [2] The Jetty docs have this example [3] // Configure the ServerContainer. container.setDefaultMaxTextMessageBufferSize(128 * 1024); but my quick code search of the BaseX source found nothing similar. Is it possible to configure the webSocket MaxTextMessageBufferSize in BaseX 12.0? /Andy [1] https://docs.basex.org/main/WebSockets#configuration [2] https://stackoverflow.com/questions/79610426/setting-the-max-buffer-size-fo… [3] https://jetty.org/docs/jetty/12/programming-guide/server/websocket.html#sta…

3 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk