- BaseX-Talk - mailman.uni-konstanz.de

parsing error using the new http-client in BaseX 10.x http module
by Andreas Hengsbach | nexoma 07 Dec '22

07 Dec '22

Hi all, it seems that the new http client in basex 10.x behaves differently when evaluating the response. If, for example, an API that usually delivers JSON then delivers an HTML page on a 404, I run into a parser problem. [experr:HC0002] Conversion failed: Stopped at ., 1/1: [json:parse] (1:1): Unexpected JSON value: '<br />...'. The error page is correctly delivered with content type "text/html". How is it decided which parser to use? I would have expected the content type of the response to be used. Has anyone else observed this behaviour? This is how I used the http module: let $response := http:send-request(<http:request method='post' ><http:body media-type='application/json'/></http:request>, fn:concat($host, $apiKey), $body) return ( (: do someting :) ) The problem definitely does not occur with BaseX 9.x. Many thanks and best regards Andreas

1 0

BaseX GraalVM native-image
by dliakh＠gmail.com 03 Dec '22

03 Dec '22

Hello Everyone, Didn't anybydy try and is that possible to convert the BaseX JAR to a "native-image" (using GraalVM's convertor or any other tool maybe)? The reason: I have to use BaseX in scripts and Makefiles as an XQuery engine and have to call it often. The problem is the JVM startup time affects the performance significantly when it has to start multiple times. I tried just naïvely running the GraalVM's native-image convertor against the BaseX103.jar file and got errors with long backtraces (that I didn't quite understand to be honest). Did anybody try that, maybe? Best regards

5 6

RBaseX version 1.1.2
by Ben Engbers 02 Dec '22

02 Dec '22

Hi, Version 1.1.2 of RBaseX-client has been accepted by CRAN. Differences with version 1.1.1 are that 'Store' and 'Replace' have been replaced by 'put' and 'putBinary' and that now the tests have to been executed with Test/testBasex credentials. The daily download-average of RBaseX is 10. But since I haven't received any feedback yet, I don't know to what extent this package contributes to Basex's popularity. Ben Engbers

1 0

Server Performance
by Johannes Bauer 01 Dec '22

01 Dec '22

Hi all, we have two Linux server VMs where our BaseX application is running - Integration - Production The used database is about 5 GB including a fulltext index and is identical on both systems. The production VM is more potent in all aspects (CPU, RAM, Disk IO, ...). Dispite all of that we do not get any significantly better performance in the production system. On top of that we even have XQuery requests that sporadically take very long (> 1 minute) that would normally take only less than one second. Again these long requests only happen in the production environment. My first assumption was that maybe it is due to additional load on the server from other sources. But that was not the case. We have the spikes even when there is no load at all. Has anyone similar experiences or any ideas what could be the cause for this behaviour? Best Regards Johannes

3 3

right way to create a db in the middle of processing?
by Graydon Saunders 28 Nov '22

28 Nov '22

Hello -- So I've got a pattern where I want to: 1. perform some processing using proc:execute() on a directory tree of XML files (easy) 2. load the result of the processing (a parallel structure tree of XML files) into a new db (in principle, easy; db:create() does this) 3. extract information from the newly created db and write that to a file (easy) 4. use proc:execute() to run different processing on the file written in step 3 (easy, I think) 5. load the result (thankfully a single file) and process it with a query (easy, I can stuff that in a function) Ideally, this winds up as something invoked from a single query file as a sequence of functions because its eventual fate is to be part of an automated test that would ideally be a "run this one thing, look at the boolean result". I hang up on step 2; so far as I can tell, there isn't a way to say "go create a database and then make it usable to these other modules that are guaranteed not to happen until db:create() has completed" but this seems like such a common thing to want to do that I feel like I must be missing something. Thanks! Graydon

5 8

Logging in JSON format
by Huib Verweij 28 Nov '22

28 Nov '22

Hi, from https://docs.basex.org/wiki/Logging I understand all logging in BaseX uses a fixed text format. For our Kibana/Elastic Search logging solution in OpenShift it is recommended to use JSON as the logging format. Is it possible to make BaseX generate logs in JSON format? If not, does anyone have any experience importing the BaseX logs into Kibana/Elastic Search? Hartelijke groet, Huib Verweij.

2 1

Fulltext search with wildcards
by Johannes Bauer 23 Nov '22

23 Nov '22

Hi, I have another question regarding fulltext search performance with wildcards. Our fulltext index is rather big with 1.3 GB and about 500.000 entries. When I use the following search where there are no matches: *ft:search('db', 'CT020/.*/P', map{'wildcards':true()})* it takes about 10 seconds to get the empty result. The query requires a big amount of free memory. If I use this query here (that also has no matches): *ft:search('db', 'CT.*/20/P', map{'wildcards':true()})* it only takes about some milliseconds. Any ideas why the placement of the wildcard has such big impact on the performance? Best Regards Johannes

2 1

Working with custom stores
by Tim Thompson 22 Nov '22

22 Nov '22

Hello, Using the store module, is it possible to read and merge multiple custom stores into main memory, or to set a particular store as context for a query? Or, do I need to serialize the stores, e.g., as JSON and then create databases for them? Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research www.linkedin.com/in/timathompson timothy.thompson(a)yale.edu

2 7

Pretty print
by Giuseppe G. A. Celano 19 Nov '22

19 Nov '22

Hi, I am trying to prettyprint an XML file. I tried the serialization option “indent”=“yes”, but it does not work as expected. On BaseX 9, the prettyprint was the default setting: how to get the same result in BaseX 10 (and later)? Thanks. Best, Giuseppe

8 13

BaseX unreachable behind load balancer
by Harry King 19 Nov '22

19 Nov '22

Hi, I’m wondering if someone might be able to offer a hint or two. I’m attempting to run BaseX in AWS behind a Network Load Balancer (NLB) using the 9.5.2 docker image with the default config to start with. I’ve setup a TCP target group and the healthcheck appears happy on port 1984.Reachability analyser suggests firewall is good to go. From the local box I can telnet localhost 1984: telnet localhost 1984 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. BaseX:3334891053316136 I get a similar response if I use the server’s private IP address: telnet 10.x.x.x 1984 Trying 10.x.x.x... Connected to 10.x.x.x. Escape character is '^]'. BaseX:3335242111998298 So far, so good. If I attempt the same via the NLB I get a timeout, which suggests to me either firewall issue or the application is refusing to listen for some reason. The documentation, seems to suggest by default, basex should respond to requests from any IP or hostname, do I understand that correctly, or do I need to alter the default config? Thanks in advance!

3 3