BaseX-Talk

basex-talk@mailman.uni-konstanz.de

13 participants
5244 discussions

Stack overflow with random-number-generator
by Joe Wicentowski 11 May '20

11 May '20

Hi all, I encountered a stack overflow error with the following code, which is designed to return as many random numbers as the user requests. BaseX's error suggested, "Try tail recursion?" I think I am already using tail recursion. Changing the $n variable from 1407 to 1406 or lower avoids the error. Any number 1407 or higher triggers the error. Thank you for any hints! Joe ``` xquery version "3.1"; declare function local:get-random-numbers($how-many as xs:integer, $generator as map(*)) { if ($how-many ge 1) then ( $generator?number, local:get-random-numbers($how-many - 1, $generator?next()) ) else () }; declare function local:get-random-numbers($how-many as xs:integer) { local:get-random-numbers($how-many, random-number-generator()) }; let $n := 1407 return local:get-random-numbers($n) => count() ```

2 2

Performance loss between version 9.2.4 and 9.3.2 when executing specific xQuery
by BIRKNER Michael 11 May '20

11 May '20

Hi, I am observing a performance loss between BaseX versions 9.2.4 (which I was using so far) and 9.3.2 (to which I updated recently) when executing an xQuery like this: --- (: Open 2 databases and get all <record>s :) let $recsFromDb1 := db:open('db1')/record let $recsFromDb2 := db:open('db2')/record (: Get distinct IDs of all records in db1 :) let $idsFromRecsInDb1 := distinct-values($recsFromDb1/exampletag[@exampleattr='id']) (: Iterate over the distinct IDs of db1 and return the records from db2 with the same ID :) for $id in $idsFromRecsInDb1 let $recFromDb2WithSameId := $recsFromDb2[exampletag[@exampleattr='id']=$id] return $recFromDb2WithSameId --- In BaseX version 9.2.4 the query executes very fast (2 - 3 seconds). In 9.3.2 I didn't wait to the end ... I aborted after several minutes because I suspected that something must be wrong. Both BaseX instances have allocated the same amount of memory (4096MB). The databases (db1 and db2) were created in the respective BaseX version from scratch and contain attribute and text indexes. They were optimized before executing the query mentioned above. All options and preferences are the same in both BaseX instances. I am using the GUI in Ubuntu 18.04. Here are some more details about the two databases: db1: - Size: 2255MB - Nodes: 97598775 - Documents: 7489 - Uptodate: true db2: - Size: 883MB - Nodes: 46317512 - Documents: 1 - Uptodate: true Does someone have an idea why there is such a difference in performance between the two BaseX versions? Thanks for any answers and hints! Best regards, Michael Mag. Michael Birkner AK Wien - Bibliothek 1040, Prinz Eugen Straße 20-22 T: +43 1 501 65 12455 F: +43 1 501 65 142455 M: +43 664 88957669 michael.birkner(a)akwien.at<mailto:Michael.BIRKNER@akwien.at> wien.arbeiterkammer.at<http://wien.arbeiterkammer.at/> Besuchen Sie uns auch auf: facebook<http://www.facebook.com/arbeiterkammer/> | twitter<https://twitter.com/Arbeiterkammer> | youtube<https://www.youtube.com/user/AKoesterreich> -------------------------------------------------- Die AK setzt sich seit 100 Jahren für Gerechtigkeit ein. Damals. Heute. Für immer. arbeiterkammer.at/100<https://arbeiterkammer.at/100><https://arbeiterkammer.at/100><https://w.ak.at/zukunftsprogramm> [https://wien.arbeiterkammer.at/ak100_maildisclaimer.png]<https://arbeiterkammer.at/100> Beachten Sie, dass Sie uns ab sofort unter einer geänderten Rufnummer erreichen. Bitte speichern Sie gleich Ihren Kontakt zur AK Wien ein unter 501 65 1, gefolgt von der gewohnten Durchwahl. Dieses Mail ist ausschließlich für die Verwendung durch die/den darin genannten AdressatInnen bestimmt und kann vertrauliche bzw rechtlich geschützte Informationen enthalten, deren Verwendung ohne Genehmigung durch den/ die AbsenderIn rechtswidrig sein kann. Falls Sie dieses Mail irrtümlich erhalten haben, informieren Sie uns bitte und löschen Sie die Nachricht. UID: ATU 16209706 I https://wien.arbeiterkammer.at/datenschutz

4 11

Storing xml message
by Ramzi Hammouda 08 May '20

08 May '20

Hello, First, thanks for the effort you're putting it to help BaseX users. I'm Using POST method to update BaseX database, I want to insert an xml node to an existing document calastone.xml in calastone database , if the node contains '<', it returns an error " Line 6): The value of attribute "value" associated with an element type "variable" must not contain the '<' character." code: <query> <text> let $message := '<Id>CTN53</Id>' return insert nodes $message as last into doc("calastone/calastone.xml") </text> <variable name='message' value='<Id>CTN53</ID>'/> </query> the same code without '<' adds the text correctly. how to solve this problem? Note that this is a question I posted on Stackoverflow, Link<https://stackoverflow.com/questions/60456387/passing-in-xquery-with-basex-p…>. Christian Grun suggested using < and > for attributes and CDATA for text nodes. After applying that solution, the xml stored is in this form <Id>CTN53</Id> This is not what I'm looking for. Is there any other more convenient solutions to store XML messages with Rest APIs? I know PUT method works fine but it overwrites the content of the document. Thank you. P Respectons ensemble l'environnement. N'imprimez ce message que si n?cessaire. Let's respect the environment together. Only print this message if necessary.

2 2

Send byte[] to http response ?
by Mickael Desfrenes 07 May '20

07 May '20

Hello, Probably my ignorance, but I struggle to send a byte array (byte[]) from a java module to a restxq response. Something a bit like this: return (<rest:response> <http:response status="200"> <http:header name="content-type" value="application/pdf"/> </http:response> </rest:response>, SomeJavaModule:getSomeBytes($module_instance)) I know there is a binary module in BaseX but I tried various things and couldn't get the wanted output. I could probably write the bytes in a file and then use file:read-binary() but it's something I'd like to avoid. Any clue here ? Mickaël

2 1

9.2.1 not found in maven central
by andreas.hengsbach＠nexoma.de 07 May '20

07 May '20

Hi, is there a reason, that I can't find the current Version (9.2.1) in maven central? Thanks and best regards, Andreas

3 3

Bug creating full-text index
by Sebastian Guerrero 06 May '20

06 May '20

Hello from Argentina!!!, thanks for the excellent software, I'm so happy learning a bit more about BaseX! Sadly I get an error trying to create a full-text index for a 51GB database: *Improper use? Potential bug? Your feedback is welcome:Contact: basex-talk(a)mailman.uni-konstanz.de <basex-talk(a)mailman.uni-konstanz.de>Version: BaseX 9.3.2Java: Oracle Corporation, 1.8.0_231OS: Windows 10, amd64Stack Trace: java.lang.NegativeArraySizeException at org.basex.index.ft.FTList.next(FTList.java:93) at org.basex.index.ft.FTBuilder.merge(FTBuilder.java:239) at org.basex.index.ft.FTBuilder.write(FTBuilder.java:147) at org.basex.index.ft.FTBuilder.build(FTBuilder.java:86) at org.basex.index.ft.FTBuilder.build(FTBuilder.java:23) at org.basex.data.DiskData.createIndex(DiskData.java:198) at org.basex.core.cmd.CreateIndex.create(CreateIndex.java:100) at org.basex.core.cmd.Optimize.optimize(Optimize.java:181) at org.basex.core.cmd.Optimize.optimize(Optimize.java:163) at org.basex.core.cmd.Optimize.optimize(Optimize.java:92) at org.basex.core.cmd.Optimize.finish(Optimize.java:82) at org.basex.core.cmd.ACreate.update(ACreate.java:96) at org.basex.core.cmd.CreateIndex.run(CreateIndex.java:64) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.core.Command.execute(Command.java:116) at org.basex.gui.dialog.DialogProgress.lambda$execute$0(DialogProgress.java:182) at java.lang.Thread.run(Unknown Source)* I'm using BaseX GUI. Is it a known problem? any advice? Regards, Sebastian.

2 2

Use of function-lookup in REST-XQ environment
by Mauro Mugnaini 04 May '20

04 May '20

Hi all, In order to have a "dynamic backend” implementation to REST-XQ invocations we used the fn:function-lookup() function but we are experiencing a strange behavior if the target looked-up function is an updating function that for example adds a resource to a database. Putting the provided files in the webapp folder of a fresh new BaseX latest (9.3.2) downloaded instance (adding "MIXUPDATES = true” setting in the .basex and with a database named DB already created inside) and invoking the REST function that calls directly the backend function with [1] the resource is correctly created on the database, by invoking the REST function that performs the dynamic lookup by using the fn:function-lookup() with [2] it completes without errors but the resource is not added to the DB. In our implementation the implementation modules are stored in the repo but the same behavior can be reproduced with “direct” function call as per my example. Is there any limitation in the looked-up function related to updating databases? Regards, Mauro [1] http:send-request( <http:request method="POST"> <http:body media-type="application/xml"/> </http:request>, "http://localhost:8984/store", <joe/> ) [2] http:send-request( <http:request method="POST"> <http:body media-type="application/xml"/> </http:request>, "http://localhost:8984/dyn-store", <joe/> )

2 4

BaseXClient command line run query requiring admin permissions?
by DYER Chris 04 May '20

04 May '20

I am trying to run some xquery scripts via the basexclient command line after logging in as a user with create permissions, but getting an error that admin permissions are required. basexclient connect to server using db_creator (with CREATE permissions) OPEN MyDatabase RUN test.xq → admin permission needed. Contents of test.xq : //database_info/version If I login as admin user, this sequence works fine. If I run this command via the rest interface in a browser and log in as db_creator, this also works. ( localhost:8984/rest/MyDatabase/?run=test.xq) If I run this command via the rest interface in a browser and log in a guest (permissions NONE) it says read permissions required (expected). Is there some limitation on running xq scripts from the command line client that requires admin permissions? Or am I missing some steps somewhere? Cheers, Chris

2 3

Unconfirmed bug: NPE using cached transformer
by Andrew Sales 29 Apr '20

29 Apr '20

Hello, I'd like to run a transform on multiple documents using a cached transformer, accumulating any errors that occur. This minimal example - for $doc in (<a/>,<b/>, <c/>) return try{ xslt:transform( $doc, <xsl:transform xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version='2.0'> <xsl:template match='/'><xsl:sequence select='error()'/></xsl:template> </xsl:transform>, map{}, map{'cache':'true'} ) } catch * {$err:description} - results in: Error in xsl:sequence/@select on line 1 column 135 of [...]: FOER0000: Error signalled by application call on error()Improper use? Potentia l bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.2 Java: Oracle Corporation, 1.8.0_241 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.io.OutputStream.write(Unknown Source) at java.io.PrintStream.write(Unknown Source) at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) at sun.nio.cs.StreamEncoder.flushBuffer(Unknown Source) at java.io.OutputStreamWriter.flushBuffer(Unknown Source) at java.io.PrintStream.write(Unknown Source) at java.io.PrintStream.print(Unknown Source) at java.io.PrintStream.println(Unknown Source) at net.sf.saxon.lib.StandardLogger.println(StandardLogger.java:121) at net.sf.saxon.lib.Logger.error(Logger.java:45) at net.sf.saxon.lib.StandardErrorListener.fatalError(StandardErrorListen er.java:305) at net.sf.saxon.Controller.reportFatalError(Controller.java:958) at net.sf.saxon.Controller.transform(Controller.java:1914) at net.sf.saxon.s9api.XsltTransformer.transform(XsltTransformer.java:579 ) at net.sf.saxon.jaxp.TransformerImpl.transform(TransformerImpl.java:185) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java: 135) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java: 62) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:40) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:51) at org.basex.query.expr.Try.value(Try.java:94) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:72) at org.basex.query.QueryContext.next(QueryContext.java:353) at org.basex.query.scope.MainModule$1.next(MainModule.java:104) at org.basex.core.cmd.AQuery.query(AQuery.java:109) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.api.client.LocalSession.execute(LocalSession.java:132) at org.basex.api.client.Session.execute(Session.java:36) at org.basex.core.CLI.execute(CLI.java:92) at org.basex.BaseX.<init>(BaseX.java:107) at org.basex.BaseX.main(BaseX.java:43) The exception does not occur if 'cache' is set to 'false'. Relatedly, if I amend the query to this: for $doc in (<a/>,<b/>,<c/>) return try{ xslt:transform( $doc, <xsl:transform xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:xs="http://www.w3.org/2001/XMLSchema" version='2.0'> <xsl:template match='/'> <xsl:sequence select='if(a) then error(xs:QName("err"), "oops") else .'/> </xsl:template> </xsl:transform>, map{}, map{'cache':'true'} ) } catch * {<err>{$err:description}</err>} the error message is passed through for the first item in the sequence (<a/>), but is lost, resulting in <err/> when adjusted to error on subsequent items (<b/> or <c/>). Again, this works as expected if the transformer is not cached. Thanks and regards, Andrew <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campai…> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

3 3

RuntimeException: Key should not exist
by Braunschweig, Björn 28 Apr '20

28 Apr '20

Hey there, I use basex in production for a couple of years now without problems. However on Saturday I got the error messages down below [1]. My storage architecture is that documents are saved throughout the day in a single database. For the next day a new database is created. When I got these errors and created a new database documents could be saved again. I think it has something to do with the index structures. The error messages were all similar but with different values after "key should not exist". Deployment method: docker BaseX 9.3.1 [Standalone] Try 'help' to get more information. > info General Information: Version: 9.3.1 Used Memory: 10 MB Global options: AUTHMETHOD: Basic CACHETIMEOUT: 3600 DBPATH: /srv/basex/data DEBUG: false FAIRLOCK: false GZIP: false HOST: localhost HTTPLOCAL: false IGNORECERT: false IGNOREHOSTNAME: false KEEPALIVE: 600 LANG: English LANGKEYS: false LOG: true LOGMSGMAXLEN: 1000 LOGPATH: .logs NONPROXYHOSTS: PARALLEL: 8 PARSERESTXQ: 3 PASSWORD: PORT: 1984 PROXYHOST: PROXYPORT: 0 REPOPATH: /srv/basex/repo RESTPATH: RESTXQERRORS: true RESTXQPATH: SERVERHOST: SERVERPORT: 1984 STOPPORT: 8985 TIMEOUT: 30 USER: WEBPATH: /srv/basex/webapp Local options ADDARCHIVES: true ADDCACHE: false ADDRAW: false ARCHIVENAME: false ATTRINCLUDE: ATTRINDEX: true AUTOFLUSH: true AUTOOPTIMIZE: false BINDINGS: CASESENS: false CATFILE: CHECKSTRINGS: true CHOP: true COMPPLAN: true COPYNODE: true CREATEFILTER: *.xml CREATEONLY: false CSVPARSER: DEFAULTDB: false DIACRITICS: false DTD: false ENFORCEINDEX: false EXPORTER: FORCECREATE: false FTINCLUDE: FTINDEX: false FULLPLAN: false HTMLPARSER: INLINELIMIT: 100 INTPARSE: false JSONPARSER: LANGUAGE: en LSERROR: 0 MAINMEM: false MAXCATS: 100 MAXLEN: 96 MAXSTAT: 30 MIXUPDATES: false PARSER: xml QUERYINFO: false RUNQUERY: true RUNS: 1 SERIALIZE: true SERIALIZER: SKIPCORRUPT: false SPLITSIZE: 0 STEMMING: false STOPWORDS: STRIPNS: false TAILCALLS: 256 TEXTINCLUDE: TEXTINDEX: true TEXTPARSER: TOKENINCLUDE: TOKENINDEX: false UPDINDEX: false WITHDB: true WRITEBACK: false XINCLUDE: true XMLPLAN: false [1] Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.3.1 Java: IcedTea, 1.8.0_212 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Key should not exist: 'urn:diasid:fty:kopal:0200507050000000000047' at org.basex.util.Util.notExpected(Util.java:61) at org.basex.index.value.UpdatableDiskValues.add(UpdatableDiskValues.java:77) at org.basex.data.Data.indexAdd(Data.java:1090) at org.basex.data.Data.insert(Data.java:828) at org.basex.query.up.atomic.Insert.apply(Insert.java:44) at org.basex.query.up.atomic.AtomicUpdateCache.applyUpdates(AtomicUpdateCache.java:294) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:278) at org.basex.core.cmd.Replace.replace(Replace.java:106) at org.basex.core.cmd.Replace.access$000(Replace.java:20) at org.basex.core.cmd.Replace$1.run(Replace.java:58) at org.basex.core.cmd.ACreate.update(ACreate.java:90) at org.basex.core.cmd.Replace.run(Replace.java:55) at org.basex.core.Command.run(Command.java:257) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:105) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:93) at org.basex.http.rest.RESTExec.run0(RESTExec.java:31) at org.basex.http.rest.RESTCmd.run(RESTCmd.java:70) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.core.Command.execute(Command.java:116) at org.basex.http.rest.RESTServlet.run(RESTServlet.java:31) at org.basex.http.BaseXServlet.service(BaseXServlet.java:65) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsyncServlet.service(ServletHolder.java:1391) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:760) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:547) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:590) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1607) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1297) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:485) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1577) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1212) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:500) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:547) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:270) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:806) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:938) at java.lang.Thread.run(Thread.java:748) Regards, Björn

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk