BaseX-Talk

basex-talk@mailman.uni-konstanz.de

8 participants
5255 discussions

BaseX GraalVM native-image
by dliakh＠gmail.com 03 Dec '22

03 Dec '22

Hello Everyone, Didn't anybydy try and is that possible to convert the BaseX JAR to a "native-image" (using GraalVM's convertor or any other tool maybe)? The reason: I have to use BaseX in scripts and Makefiles as an XQuery engine and have to call it often. The problem is the JVM startup time affects the performance significantly when it has to start multiple times. I tried just naïvely running the GraalVM's native-image convertor against the BaseX103.jar file and got errors with long backtraces (that I didn't quite understand to be honest). Did anybody try that, maybe? Best regards

5 6

RBaseX version 1.1.2
by Ben Engbers 02 Dec '22

02 Dec '22

Hi, Version 1.1.2 of RBaseX-client has been accepted by CRAN. Differences with version 1.1.1 are that 'Store' and 'Replace' have been replaced by 'put' and 'putBinary' and that now the tests have to been executed with Test/testBasex credentials. The daily download-average of RBaseX is 10. But since I haven't received any feedback yet, I don't know to what extent this package contributes to Basex's popularity. Ben Engbers

1 0

Server Performance
by Johannes Bauer 01 Dec '22

01 Dec '22

Hi all, we have two Linux server VMs where our BaseX application is running - Integration - Production The used database is about 5 GB including a fulltext index and is identical on both systems. The production VM is more potent in all aspects (CPU, RAM, Disk IO, ...). Dispite all of that we do not get any significantly better performance in the production system. On top of that we even have XQuery requests that sporadically take very long (> 1 minute) that would normally take only less than one second. Again these long requests only happen in the production environment. My first assumption was that maybe it is due to additional load on the server from other sources. But that was not the case. We have the spikes even when there is no load at all. Has anyone similar experiences or any ideas what could be the cause for this behaviour? Best Regards Johannes

3 3

right way to create a db in the middle of processing?
by Graydon Saunders 28 Nov '22

28 Nov '22

Hello -- So I've got a pattern where I want to: 1. perform some processing using proc:execute() on a directory tree of XML files (easy) 2. load the result of the processing (a parallel structure tree of XML files) into a new db (in principle, easy; db:create() does this) 3. extract information from the newly created db and write that to a file (easy) 4. use proc:execute() to run different processing on the file written in step 3 (easy, I think) 5. load the result (thankfully a single file) and process it with a query (easy, I can stuff that in a function) Ideally, this winds up as something invoked from a single query file as a sequence of functions because its eventual fate is to be part of an automated test that would ideally be a "run this one thing, look at the boolean result". I hang up on step 2; so far as I can tell, there isn't a way to say "go create a database and then make it usable to these other modules that are guaranteed not to happen until db:create() has completed" but this seems like such a common thing to want to do that I feel like I must be missing something. Thanks! Graydon

5 8

Logging in JSON format
by Huib Verweij 28 Nov '22

28 Nov '22

Hi, from https://docs.basex.org/wiki/Logging I understand all logging in BaseX uses a fixed text format. For our Kibana/Elastic Search logging solution in OpenShift it is recommended to use JSON as the logging format. Is it possible to make BaseX generate logs in JSON format? If not, does anyone have any experience importing the BaseX logs into Kibana/Elastic Search? Hartelijke groet, Huib Verweij.

2 1

Fulltext search with wildcards
by Johannes Bauer 23 Nov '22

23 Nov '22

Hi, I have another question regarding fulltext search performance with wildcards. Our fulltext index is rather big with 1.3 GB and about 500.000 entries. When I use the following search where there are no matches: *ft:search('db', 'CT020/.*/P', map{'wildcards':true()})* it takes about 10 seconds to get the empty result. The query requires a big amount of free memory. If I use this query here (that also has no matches): *ft:search('db', 'CT.*/20/P', map{'wildcards':true()})* it only takes about some milliseconds. Any ideas why the placement of the wildcard has such big impact on the performance? Best Regards Johannes

2 1

Working with custom stores
by Tim Thompson 22 Nov '22

22 Nov '22

Hello, Using the store module, is it possible to read and merge multiple custom stores into main memory, or to set a particular store as context for a query? Or, do I need to serialize the stores, e.g., as JSON and then create databases for them? Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research www.linkedin.com/in/timathompson timothy.thompson(a)yale.edu

2 7

Pretty print
by Giuseppe G. A. Celano 19 Nov '22

19 Nov '22

Hi, I am trying to prettyprint an XML file. I tried the serialization option “indent”=“yes”, but it does not work as expected. On BaseX 9, the prettyprint was the default setting: how to get the same result in BaseX 10 (and later)? Thanks. Best, Giuseppe

8 13

BaseX unreachable behind load balancer
by Harry King 19 Nov '22

19 Nov '22

Hi, I’m wondering if someone might be able to offer a hint or two. I’m attempting to run BaseX in AWS behind a Network Load Balancer (NLB) using the 9.5.2 docker image with the default config to start with. I’ve setup a TCP target group and the healthcheck appears happy on port 1984.Reachability analyser suggests firewall is good to go. From the local box I can telnet localhost 1984: telnet localhost 1984 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. BaseX:3334891053316136 I get a similar response if I use the server’s private IP address: telnet 10.x.x.x 1984 Trying 10.x.x.x... Connected to 10.x.x.x. Escape character is '^]'. BaseX:3335242111998298 So far, so good. If I attempt the same via the NLB I get a timeout, which suggests to me either firewall issue or the application is refusing to listen for some reason. The documentation, seems to suggest by default, basex should respond to requests from any IP or hostname, do I understand that correctly, or do I need to alter the default config? Thanks in advance!

3 3

Dynamic combination search on specific path in BaseX
by DK Singh 15 Nov '22

15 Nov '22

HI I want to perform combination (AND OR) search on the basis of the provided parameter by the user, where user will select the field name e.g.(title, isbn, author) and their value from front-end so here field name will be the parameter for the BaseX. Currently i am asking front-end person the generate below combination query ( (title = "United States" or isbn = "2345371242192") and author ="Jhon" ) Now the all parameter value will be compared to specific XPATH , like below. let $Author := 'David Hare' let $title := "United States " let $isbn:= '2345371242192 ' return db:open('test')/*[(( normalize-space(string-join((*:info/*:author)[1]/*:personname//text()) ) = $Author or $title = *:info/*:title ) and $isbn="*:info/isban")]/base-uri() In the above code XPATH is hardcoded, but I want it to concatenate on the fly once string query comes front-end then it will be passed to Basex . Is there any other way to achieve this? or how should i ask combinations query from front-end so that i could achieve this. Thanks Dharmendra Kumar Singh

2 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk