BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5241 discussions

terrible performance of webserver under BaseX11
by Rob Stapper 10 Sep '24

10 Sep '24

Hi Christian, My webserver-app that performed reasenably well under BaseX10 performs terribly under Basex11. Chrome even gives me at the end of the process an 'out of memory' message. So it is not only performance but also resource-usage. I have absolutely no clou how to address this, so all suggestions are very welcome. mvgr. Rob Stapper

2 1

Unexpected error: Improper use? Potential bug? Your feedback is welcome:
by Rob Stapper 03 Sep '24

03 Sep '24

Hi Christian, After the hollidaybreak I found the courage to try to port my application to BaseX's version 112. I get the error-dump shown below. Any idea what is going wrong here? error-dump: ========= Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 11.2 Java: Eclipse Adoptium, 17.0.8 OS: Windows 10, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Index 3 out of bounds for length 3 at org.basex.query.func.Closure.setSignature(Closure.java:418) at org.basex.query.func.StaticFuncs$FuncCache.init(StaticFuncs.java:268) at org.basex.query.func.StaticFuncs.check(StaticFuncs.java:83) at org.basex.query.QueryParser.check(QueryParser.java:270) at org.basex.query.QueryParser.parseLibrary(QueryParser.java:198) at org.basex.query.QueryContext.lambda$parseLibrary$1(QueryContext.java:236) at org.basex.query.QueryContext.run(QueryContext.java:763) at org.basex.query.QueryContext.parseLibrary(QueryContext.java:234) at org.basex.query.QueryContext.parse(QueryContext.java:178) at org.basex.http.web.WebModule.qc(WebModule.java:100) at org.basex.http.web.WebModule.parse(WebModule.java:57) at org.basex.http.web.WebModules.parse(WebModules.java:376) at org.basex.http.web.WebModules.parse(WebModules.java:367) at org.basex.http.web.WebModules.parse(WebModules.java:367) at org.basex.http.web.WebModules.cache(WebModules.java:336) at org.basex.http.web.WebModules.find(WebModules.java:149) at org.basex.http.web.WebModules.restxq(WebModules.java:116) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:44) at org.basex.http.BaseXServlet.service(BaseXServlet.java:69) at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:587) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1410) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:764) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:529) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:131) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:598) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:223) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1580) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:221) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1381) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:176) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:484) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1553) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:174) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1303) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:129) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:122) at org.eclipse.jetty.server.Server.handle(Server.java:563) at org.eclipse.jetty.server.HttpChannel$RequestDispatchable.dispatch(HttpChannel.java:1598) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:753) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:501) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:287) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:314) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:100) at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:53) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:421) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:390) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:277) at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:199) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:411) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:969) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1194) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1149) at java.base/java.lang.Thread.run(Unknown Source) mvgr. Rob Stapper

2 1

Alternatives to JTattoo in combination with BaseX GUI?
by Zimmel, Daniel 03 Sep '24

03 Sep '24

Hi, I noticed that JTattoo is no longer working properly with BaseX 11 (which is not a surprise because it looks like an abandoned project). I liked to use it to force a dark theme to the GUI. Does anybody know of alternatives? Are there any? Thanks, Daniel

2 2

xquery insert via REST API
by Liedtke, Alexander 28 Aug '24

28 Aug '24

Hallo in die Runde, vielleicht kann mir hierzu jmd einen Tipp geben. Ich nutze die Rest API um via post xqueries (mit python requests) zu machen - das klappt mit z.B. replace auch problemlos. Gerne würde ich jedoch auch insert nutzen - allerdings bekomme ich hier grundsätzlich eine 500 response. Die query mache ich gemäß der Doku nach dem Beispielschema: insert nodes (<phone/>, <mail/>) into //name In den Logs von dba sehe ich hierzu nichts. Ich bekomme auch sonst keine Info auf der shell in Form einer Fehlermeldung. Der Test Request sieht wie folgt aus: xq = '<query><text> insert node <test/> into //object[@id="574"]</text></query>' url = 'http://localhost:8080/rest/ids/ObjectIDs.xml' header = {'Media-Type': 'application/xml', 'charset':'utf-8'} res = requests.post(url, headers=header, data=xq, auth=_auth.getBaseXAuth()) Hat hierzu vielleicht jemand Anmerkungen / Ideen? Vielen Dank im Voraus Alexander Liedtke

1 1

Basex java.lang.ArrayIndexOutOfBoundsException
by Chavez, Robert 19 Aug '24

19 Aug '24

Greetings, We are suddenly seeing the following error message when using the REST API and also when using to Web GUI when trying to list the contents of a database by clicking on the database name and also when clicking on “optimize” (screen shot of gui attached). Does anyone have experience with hw to handle this? Version: BaseX 10.4 Java: Amazon.com Inc., 17.0.12 OS: Linux, amd64 Thank you, Robert Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de> Version: BaseX 10.4 Java: Amazon.com Inc., 17.0.12 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: Index 2147483647 out of bounds for length 17322 at org.basex.io.random.TableDiskAccess.fpre(TableDiskAccess.java:514) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:474) at org.basex.io.random.TableDiskAccess.read5(TableDiskAccess.java:180) at org.basex.data.Data.textRef(Data.java:467) at org.basex.data.DiskData.text(DiskData.java:272) at org.basex.query.func.db.DbListDetails$2.get(DbListDetails.java:96) at org.basex.query.func.db.DbListDetails$2.get(DbListDetails.java:1) at org.basex.query.func.fn.FnSubsequence.value(FnSubsequence.java:108) at org.basex.query.expr.IterMap.value(IterMap.java:106) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:146) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:78) at org.basex.query.QueryContext.next(QueryContext.java:375) at org.basex.query.expr.constr.Constr.add(Constr.java:73) at org.basex.query.expr.constr.CElem.item(CElem.java:149) at org.basex.query.expr.constr.CElem.item(CElem.java:1) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.constr.Constr.add(Constr.java:72) at org.basex.query.expr.constr.CElem.item(CElem.java:149) at org.basex.query.expr.constr.CElem.item(CElem.java:1) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.List$1.iter(List.java:213) at org.basex.query.expr.List$1.next(List.java:181) at org.basex.query.QueryContext.next(QueryContext.java:375) at org.basex.query.expr.constr.Constr.add(Constr.java:73) at org.basex.query.expr.constr.CElem.item(CElem.java:149) at org.basex.query.expr.constr.CElem.item(CElem.java:1) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.func.StaticFuncCall.evalArgs(StaticFuncCall.java:147) at org.basex.query.func.FuncCall.value(FuncCall.java:53) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:82) at org.basex.query.scope.MainModule$1.next(MainModule.java:55) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:79) at org.basex.http.web.WebResponse.create(WebResponse.java:58) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:72) at org.basex.http.BaseXServlet.service(BaseXServlet.java:69) at javax.servlet.http.HttpServlet.service(HttpServlet.java:733) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:202) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96) at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:541) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92) at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:690) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343) at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:373) at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:65) at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:868) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1589) at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61) at java.base/java.lang.Thread.run(Thread.java:840)

2 4

recursively used variables
by Rob Stapper 12 Aug '24

12 Aug '24

Hi, The code[1] below and send as attachment generates a error message: “Static variable depends on itself: $Q{http://www.w3.org/2005/xquery-local-functions}test”. I use these variables to refer to my private functions in my modules so I can easyly refer to them in a inheritance situation. It’s not a big problem for me but I was wondering if the error-triggering is justified or that it should work. [1]=========================================== declare variable $local:test := local:test#1 ; declare %private function local:test( $i) { if ( $i > 0) then $local:test( $i - 1) } ; $local:test( 10) =========================================== Kind regards, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

4 7

Bug report
by Csaba Fekete 12 Aug '24

12 Aug '24

Hello The following works on Basex 10.7 but fails on Basex 11.1. The command I'm trying to run is: /opt/basex/bin/basex -v -c'OPEN mydb; ADD "/tmp/ZTH4ZRO.xml"' I've attached the XML file.The output I'm getting: Database 'mydb' was opened in 54.52 ms. Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 11.1 Java: Ubuntu, 11.0.19 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: arraycopy: length -1 is negative at java.base/java.lang.System.arraycopy(Native Method) at org.basex.util.Array.insert(Array.java:99) at org.basex.util.list.ObjectList.insert(ObjectList.java:153) at org.basex.index.resource.Docs.insert(Docs.java:166) at org.basex.index.resource.Resources.insert(Resources.java:71) at org.basex.data.Data.indexAdd(Data.java:1098) at org.basex.data.Data.insert(Data.java:836) at org.basex.query.up.atomic.Insert.apply(Insert.java:44) at org.basex.query.up.atomic.AtomicUpdateCache.applyUpdates(AtomicUpdateCache.java:291) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:275) at org.basex.core.cmd.Add.lambda$run$0(Add.java:62) at org.basex.core.cmd.ACreate.update(ACreate.java:90) at org.basex.core.cmd.Add.run(Add.java:56) at org.basex.core.Command.run(Command.java:233) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:131) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:94) at org.basex.core.CLI.execute(CLI.java:78) at org.basex.core.CLI.execute(CLI.java:65) at org.basex.BaseX.<init>(BaseX.java:82) at org.basex.BaseX.main(BaseX.java:44)

2 3

Typos in BaseX documentation
by Amanda Galtman 09 Aug '24

09 Aug '24

Hi, BaseX team. I found a couple of typos in the BaseX documentation. I wouldn't mind fixing them myself if I knew how to do so in the new RESTXQ format. Is the source in GitHub, and are BaseX users encouraged to contribute corrections to the documentation? Here are the details, in case you'd rather fix them yourself. Typo 1: The page https://docs.basex.org/main/Standard_Functions starts with a stray "f" ("fThis page presents") Typo 2: On the page https://docs.basex.org/main/File_Functions, the following example is missing a closing curly brace before the final parenthesis: file:write('data.bin', xs:hexBinary('414243'), { 'method': 'basex') Thanks, Amanda

2 1

Ignoring non-fatal XML syntax issues in third-party HTML from command line
by Ross Goldberg 08 Aug '24

08 Aug '24

I am trying to use an xpath passed to basex on the macOS command line to extract data from a downloaded third-party HTML file. The file isn't completely valid xml syntax (but only in elements that aren't referenced by my xpath), so basex outputs errors instead of the data that I want. How can I configure basex to ignore xml syntax issues that aren't fatal for my xpath? If it cannot be so configured: - could that option be added as a new feature? - in the meantime, what other macOS command-line xpath parsers can ignore non-fatal XML syntax issues? Which of those support the newest versions of xpath, are performant, etc.? Thanks. Sent with Proton Mail secure email.

2 1

Performance & scaling
by Csaba Fekete 29 Jul '24

29 Jul '24

Hi I have read the Advanced User Guide section in the documentation and I got a lot of useful information but I'm still a little bit stuck. I have large (1 GB+) mostly single document databases and complex queries that often take too long to execute. Apart from optimizing the queries, what are my options to speed things up? Any ideas are welcome. 1) Vertical scaling - how does a single BaseX instance respond to adding more CPUs or RAM? Which one could improve performance? Apart from indexing, are there any fine-tuning options that could help improve performance? 2) Partitioning: would it make sense to break my documents into several smaller ones, run the queries against them in parallel and then merge the results? Has anyone done such optimization? Did it work? 2) Horizontal scaling: the docs read: *"The BaseX client-server architecture offers ACID-safe transactions, with multiple readers and writers."* - Where can I get a guide on how to set up a single writer - multiple readers architecture? Thank you Csaba

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk