- BaseX-Talk - mailman.uni-konstanz.de

Query regarding delete documents
by Deepak Dinakara 05 Feb '24

05 Feb '24

Hi, I wanted to understand more on how deleting documents impact the storage layout. I did go through https://docs.basex.org/wiki/Storage_Layout but didn't find all the required information. I observed that size of files like "txt.basex" and "atv.basex" doesn't shrink on deleting documents. Is that expected? PS: Thanks for the great product. Thank you, Deepak

2 3

A question about (non standard) BaseX stopping
by Pierre-Yves Jallud 05 Feb '24

05 Feb '24

Hi all, after having configuring a BaseX hub (|cluster|farm|...?), I have a last problem (I hope 🤞😅). When I want to stop a BaseX instance with basexhttpstop (or basexhttp stop), I have different results, but none stop the instance. The context: * I'm using the following java version: *OpenJDK 64-Bit Server VM (Red_Hat-11.0.21.0.9-1.el7_9) (build 11.0.21+9-LTS, mixed mode, sharing)* * in the .bash_profile of the basexusr1 (and for each (system LINUX) BaseX user), I precise the BASEX_JVM variable (*export BASEX_JVM="-Dorg.basex.path=/basex-ferme/sites/basex1"*) to customize the webapp and data repository * */basex-ferme/sites/basex1/basex* is a symbolic link to the BaseX reference (every site has this symbolic link) located here: */basex-ferme/basex* (hum... this is also a symbolic link pointing to the last version of basex: */basex-ferme/basex-10.7*) * the ports are different for each instance and are (only) precised when I launch the BaseX process * I launch each process with this command (adapting basex1, basexusr1 and ports for each BaseX): *su - -s /bin/bash basexusr1 -c "/basex-ferme/sites/basex1/basex/bin/basexhttp -S -h11204 -p11205 -s11206" * * for each command below, the code returned is ($?) 0... but the process is still running 🤔 (as the web site). I only test the access of the DBA service (logging as admin) and I've got no database(at this time). The result of the stop commands: 1. > su - -s /bin/bash basexusr1 -c "/basex-ferme/sites/basex1/basex/bin/basexhttpstop -h11204 -p11205 -s11206" BaseX 10.7 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @1523ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 11204). Server was stopped (port: 11205). 2. > su - -s /bin/bash basexusr1-c "/basex-ferme/sites/basex1/basex/bin/basexhttp stop -h11204 -p11205 -s11206" BaseX 10.7 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @1441ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 11204). Server was stopped (port: 11205). 3. > su - -s /bin/bash basexusr1-c "/basex-ferme/sites/basex1/basex/bin/basexhttp stop -s11206" BaseX 10.7 [HTTP Server]: 11205). [main] INFO org.eclipse.jetty.util.log - Logging initialized @1819ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8080). Server was stopped (port: 1984). 4. > su - -s /bin/bash basexusr1-c "/basex-ferme/sites/basex1/basex/bin/basexhttp stop -h11204 -s11206" BaseX 10.7 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @1366ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 11204). Server was stopped (port: 1984). 5. > su - -s /bin/bash basexusr1-c "/basex-ferme/sites/basex1/basex/bin/basexhttp stop -p11205 -s11206" BaseX 10.7 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @1006ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8080). Server was stopped (port: 11205). ... and there is no track of the stop request in the log file (but there are the tracks of the admin access). The only solution I have found is to kill the process. That's my plan B, but I hope there is another cleaner solution 🤞😎 Has anyone a suggestion to resolve my problem?... and sorry for the complexity of the context 😓 Greetings Pierre-Yves ------------------------------------------------------------------------ *Pierre-Yves Jallud* /Pôle Humanité Numériques / Ingénieur en ingénierie logicielle/ ------------------------------------------------------------------------ IHRIM - UMR 5317 <http://ihrim.ens-lyon.fr> CNRS <https://www.cnrs.fr> ENS de Lyon <http://www.ens-lyon.fr> 15 Parvis René Descartes - BP7000 - 69342 Lyon CEDEX 07 +33 (0)4 37 37 63 83 - pierre-yves.jallud(a)ens-lyon.fr ------------------------------------------------------------------------

2 1

hof:until qt4cg drops?
by Andy Bunce 03 Feb '24

03 Feb '24

I wanted to look up the hof:until[1] syntax in the wiki. It tells me that it has been replaced with fn:iterate-while. Well, I hope, when the dust settles, there is something similar to this in the spec, but it looks like it may not be iterate-while . Today a user of the current BaseX release(10.7) is going to struggle to find what hof:until does and wont find any fn:iterate-while . I think deprecating functions and moving forward is great. I do like to see what 4.0 might bring with the BaseX 11 betas but if I catch myself writing anything substantial I stop. The ground is unstable. I think the wiki should center on the functionality of the current release, with just teasers about the future. Christian, I think you hinted that the future may hold some documentation API built into the product, or did I imagine that? /Andy [1] https://docs.basex.org/wiki/Higher-Order_Functions_Module,

2 3

How to configure org.basex.path
by Pierre-Yves Jallud 03 Feb '24

03 Feb '24

Hi all, I would like to precise the home directory of BaseX using org.basex.path (cf. https://docs.basex.org/wiki/Configuration#Home_Directory) Is it possible to configure this when I launch the basexhttp? For exemple, something like (befor launching basexhttp): export org.basex.path=/path/to/my/basex Or maybe: basexhttp -S org.basex.path=/path/to/my/basex ... or what else? Many thanks in advance to enlighten me 😇 Pierre-Yves PS: as you can see, I didn't use Java for a long time 😅 ------------------------------------------------------------------------ *Pierre-Yves Jallud* /Pôle Humanité Numériques / Ingénieur en ingénierie logicielle/ ------------------------------------------------------------------------ IHRIM - UMR 5317 <http://ihrim.ens-lyon.fr> CNRS <https://www.cnrs.fr> ENS de Lyon <http://www.ens-lyon.fr> 15 Parvis René Descartes - BP7000 - 69342 Lyon CEDEX 07 +33 (0)4 37 37 63 83 - pierre-yves.jallud(a)ens-lyon.fr ------------------------------------------------------------------------

3 5

RESTXQ knocked out!
by Hans-Juergen Rennau 01 Feb '24

01 Feb '24

Dear BaseX people, suddenly RESTXQ does not work any more on my machine. (Here, "suddenly" means when using RESTXQ again after a pause of three months and having installed a new BaseX version in the meantime, 11.0 beta.) Any attempt to access a RESTXQ-defined URL produces a mysterious error message: HTTP ERROR 500 java.lang.NoClassDefFoundError: org/basex/build/text/TextOptions URI: /dbaSTATUS: 500MESSAGE: java.lang.NoClassDefFoundError: org/basex/build/text/TextOptionsSERVLET: RESTXQCAUSED BY: java.lang.NoClassDefFoundError: org/basex/build/text/TextOptionsCAUSED BY: java.lang.ClassNotFoundException: org.basex.build.text.TextOptionsCaused by:java.lang.NoClassDefFoundError: org/basex/build/text/TextOptions at org.basex.http.web.WebModule.parse(WebModule.java:63) at org.basex.http.web.WebModules.parse(WebModules.java:376) at org.basex.http.web.WebModules.parse(WebModules.java:367) at org.basex.http.web.WebModules.cache(WebModules.java:336) at org.basex.http.web.WebModules.find(WebModules.java:149) at org.basex.http.web.WebModules.restxq(WebModules.java:116) Emptying the lib/custom folder did not help. Neither did a reinstallation of BaseX (see PS). With kind regards -Hans-Jürgen PS: After observing the error, I tried to install the official release (10.7). To my amazement, the version did not change, it remained the 11.0 beta snapshot, even after restarting the machine. And, of course, the error remained. (After this, I felt knocked out myself. Is there anything that I understand?)

2 2

RESTXQ oddity?
by Murray, Gregory 29 Jan '24

29 Jan '24

Hello, I’m trying to build my first BaseX web application. I’ve got a RESTXQ function for returning static files to the browser, and other RESTXQ functions corresponding to URLs in the web application. The function for static files is based on the one in DBA: (:~ Returns the specified static file to the browser as binary data. :) declare %rest:GET %rest:path('theocom/static/{$dir=.+}/{$file=.+}') function c:file($dir as xs:string, $file as xs:string) { let $path := file:base-dir() || 'static/' || $dir || '/' || $file return ( web:response-header( map { 'media-type': web:content-type($path) }, map { 'Content-Length': file:size($path) } ), file:read-binary($path) ) }; Another function returns the home page for the web application. That page works just fine. The HTML document gets returned to the browser, and the static CSS and image files are sent to the browser successfully. (:~ Returns the home page for the entire web application. :) declare %rest:GET %rest:path('theocom') %output:method('html') %output:html-version('5') function c:home() { let $params := c:http-params() return ( c:extra-response-headers(), home:get-home-page($params) ) }; I have another RESTXQ function that corresponds to a URL that goes deeper into the web application: (:~ Returns a page listing contributors (libraries whose content we've imported), for browsing. :) declare %rest:GET %rest:path('theocom/contributors/{$alpha=[a-z]}') %output:method('html') %output:html-version('5') function c:browse-contributors($alpha as xs:string) { let $params := map:merge( ( map:entry("browse", "contributor"), map:entry("alpha", upper-case($alpha)), c:http-params() ) ) return ( c:extra-response-headers(), browse:contributors($params) ) }; The problem I’m having is that on this page, the browser returns 404 for the static files, even though the code for the HTML <head> where the CSS files are linked is identical to the home page. Am I doing something wrong, or is the BaseX RESTXQ implementation doing something unexpected? Thanks, Greg Gregory Murray Director of Digital Initiatives Wright Library Princeton Theological Seminary

3 7

Re: [basex-talk] GUI feature request: paste into search boxes
by James Ball 28 Jan '24

28 Jan '24

Tim, I'm on an M1 MacBook Air and Cmd-V works for me in the GUI exactly as normal on macOS. Interestingly Ctl-V doesn't. I build BaseX as an app[1] but I just tried double clicking the .jar file directly and Cmd-V still worked. I wonder if the JDK has an impact? I run the Amazon Corretto version. [1] https://docs.basex.org/wiki/MacOS > Message: 3 > Date: Wed, 17 Jan 2024 17:58:46 +0000 > From: "Thompson, Timothy" <timothy.thompson(a)yale.edu <mailto:timothy.thompson@yale.edu>> > To: Andy Bunce <bunce.andy(a)gmail.com <mailto:bunce.andy@gmail.com>> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de <mailto:basex-talk@mailman.uni-konstanz.de>> > Subject: Re: [basex-talk] GUI feature request: paste into search boxes > Message-ID: > <CO6PR08MB77566B17B81325EB71851F87F9722(a)CO6PR08MB7756.namprd08.prod.outlook.com <mailto:CO6PR08MB77566B17B81325EB71851F87F9722@CO6PR08MB7756.namprd08.prod.outlook.com>> > > Content-Type: text/plain; charset="windows-1252" > > Thanks, Andy, good point. I?m on macOS (M2 chip), and I?ve run into other keyboard issues. Cmd-V is the usual paste combination, which works in the editor pane, but I?ve just realized that Ctrl-V works to paste in the search boxes :) > > Apologies for the noise! > Tim > > > -- > Tim A. Thompson (he, him) > Librarian for Applied Metadata Research > Yale University Library > www.linkedin.com/in/timathompson <http://www.linkedin.com/in/timathompson><http://www.linkedin.com/in/timathompson>

1 0

Consistent NPE loading content on one server, other server works
by Eliot Kimber 24 Jan '24

24 Jan '24

I have two servers running the same code, both on 10.7. I have a REST API handler that takes data as input and stores it in a database, applying some preprocessing to the data first. The data successfully loads on my dev server and consistently fails on the production server, with this Java failure: [INFO] Posting "/Users/eliot.kimber/git-basex/product-content-analytics/analytics/adobe/adobe-analytics-Utah_Pages_Viewed_Aug2023-clean.csv" [INFO] as filename "adobe-analytics-Utah_Pages_Viewed_Aug2023-clean.csv" [INFO] to Mirabel server "http://mirabel.corp.service-now.com:9984"... Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 10.7 Java: Oracle Corporation, 17.0.8 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException: Cannot invoke "org.basex.index.IdPreMap.write(org.basex.io.IOFile)" because "this.idmap" is null at org.basex.data.DiskData.write(DiskData.java:151) at org.basex.data.DiskData.close(DiskData.java:160) at org.basex.core.Datas.unpin(Datas.java:52) at org.basex.core.cmd.Close.close(Close.java:45) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:124) at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:119) at org.basex.query.up.DataUpdates.applyDbUpdates(DataUpdates.java:213) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:172) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:179) at org.basex.query.QueryContext.update(QueryContext.java:663) at org.basex.query.QueryContext.lambda$iter$4(QueryContext.java:357) at org.basex.query.QueryContext.run(QueryContext.java:766) at org.basex.query.QueryContext.iter(QueryContext.java:357) at org.basex.http.restxq.RestXqResponse.serialize(RestXqResponse.java:78) at org.basex.http.web.WebResponse.create(WebResponse.java:58) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:72) at org.basex.http.BaseXServlet.service(BaseXServlet.java:69) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) at org.eclipse.jetty.servlet.ServletHolder$NotAsync.service(ServletHolder.java:1459) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:799) at org.eclipse.jetty.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1656) at org.eclipse.jetty.servlets.CrossOriginFilter.handle(CrossOriginFilter.java:319) at org.eclipse.jetty.servlets.CrossOriginFilter.doFilter(CrossOriginFilter.java:273) at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:201) at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1626) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:552) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:600) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:235) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1624) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1440) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:505) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1594) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1355) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:487) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:732) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:479) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:833)[INFO] Data loaded. The two servers are essentially identical Linux servers, although the production server has more resources. Any idea what might cause this failure or what I can do to diagnose it? There must be some non-obvious difference in these two servers but I don’t know what to look for. The code doing the load to a database is: let $reportPath as xs:string := ``[/`{$analyticsmgmt:csvPathRoot}`/`{$source}`/`{$reportType}`/`{$reportName}`.xml]`` let $msg := prof:dump(``[[INFO] Storing analytics report "`{$reportPath}`"]``) let $csv := $csv transform with { insert node attribute {'timestamp'} {$timeStampStr} into ./* } let $csv := $csv transform with { analyticsmgmt:dispatchAnalysticsStorePreProcessing($reportName, ., $debug) } return try { (db:put($analyticsDb, $csv, $reportPath), db:optimize($analyticsDb, true(), map{ 'attrindex' : true(), 'tokenindex' : true(), 'updindex' : true() }) ) } catch * { util:logToConsole( 'analyticsmgmt:storeAnalyticsCsvReport', ``[`{$err:code}`: `{$err:description}`]``, 'error' ) } Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

2 4

function prof:dump not working
by DK Singh 22 Jan '24

22 Jan '24

Hi, I am using BaseX 9.5 and we are using the prof:dump() function for debugging code and data. When a query is run in the BaseX GUI, the output of prof:dump() is shown in the info view. When we are calling this function in XQUERY and try to print output of prof:dump() in the log then it is not printing anything. As per BaseX documentation, if LOGTRACE is 'ON' and BaseX is being used as a web-application, then the output of prof:dump() function gets logged in database logs. Checked on the server, LOGTRACE is 'ON' but the output is not getting logged in log file.. Also we try it to store output prof:dump() in a variable and print it into log file but not working let $_Logs := prof:dump($work/@id || ' (' || $work/*:titleSet/*:title[1] || ')', 'Excluded from output, as no media found: ') return admin:write-log('output of function prof:dump is: '|| $_Logs) Can you please suggest how we can capture output of function prof:dump() in a XML format or in the BaseX log file? Thank You Dharmendra

2 1

GUI feature request: paste into search boxes
by Thompson, Timothy 17 Jan '24

17 Jan '24

Hello, In the BaseX GUI, it’s not possible (as far as I can tell) to paste a copied value into search boxes. Not being able to do so can be inconvenient, for example, when searching for a string like a UUID in result output, etc. Is lack of support for pasting intentional, or am I missing something? Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research Yale University Library www.linkedin.com/in/timathompson<http://www.linkedin.com/in/timathompson>

2 2