BaseX-Talk

basex-talk@mailman.uni-konstanz.de

13 participants
5243 discussions

BaseX 9.4.6
by Christian Grün 07 Jan '21

07 Jan '21

Dear all, Our new year patch release features various new performance tweaks and minor bug fixes. Thanks all for your support! Have a pleasant 2021, Christian BaseX Team

2 1

FOP module
by Jerome Chauveau 07 Jan '21

07 Jan '21

Hi, I am trying to use the (too old ?) FOP module, but unsuccessfully. I copied that example : import module namespace fop = 'org.basex.modules.fop.FOP'; let $xsl := xslt:transform('fop.xml', 'fop.xsl') let $pdf := fop:transform($xsl) return file:write-binary('fop.pdf', $pdf) from this thead : [ https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-February/006326.h… | https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-February/006326.h… ] which generates that error (in a BaseX 9.3) : [XPTY0004] class org.basex.modules.fop.FOP tried to access private method 'void org.basex.query.value.item.B64.<init>(byte[])' (org.basex.modules.fop.FOP and org.basex.query.value.item.B64 are in unnamed module of loader 'app'). Caused by: FOP:transform(document-node()). Any suggestions on how to fix this ? Thanks Regards Jérôme

3 9

error "lock file does not exist" after "add" command
by Zachary N. Dean 04 Jan '21

04 Jan '21

Hi Thomas, Author of the Erlang client here. :-) I haven't seen this before, but I haven't used pooled connections either. Is there a minimal example for the commands that you run that I could use to reproduce this and ensure it's not a problem in the client? Thanks, Zack

2 1

LDAP Module
by Maciej Nestorowicz 28 Dec '20

28 Dec '20

Hi, I wanted to know, is there any module in BaseX which is responsible for LDAP authentication and authorization? Kind Regards, Maciej Nestorowicz

1 0

Database access in a function
by Giuseppe G. A. Celano 18 Dec '20

18 Dec '20

Hi, I have a script where I join two databases. It works. However, when I try to put the content of this script in a function, and then call it (with the databases being the arguments), the execution is slowed down (I guess the indexes are not properly accessed). Is there a way to overcome this? Thanks.

2 1

write result to file?
by Nicholas 16 Dec '20

16 Dec '20

how is the return result from a query written to a file? thanks, Nick

3 5

set parser csv header
by Nicholas 15 Dec '20

15 Dec '20

How do I set the CSV parser to use "header" true? so that when the record is imported it has the header information as below? nicholas@mordor:~/flwor/csv$ nicholas@mordor:~/flwor/csv$ basex BaseX 9.0.1 [Standalone] Try 'help' to get more information. > > create database addressbook Database 'addressbook' created in 240.02 ms. > > open addressbook Database 'addressbook' was opened in 0.06 ms. > > set parser csv PARSER: csv > > add addressbook.csv Resource(s) added in 23.74 ms. > > xquery . <csv> <record> <entry>Name</entry> <entry>First Name</entry> <entry>Address</entry> <entry>City</entry> </record> <record> <entry>Huber</entry> <entry>Sepp</entry> <entry>Hauptstraße 13</entry> <entry>93547 Hintertupfing</entry> </record> </csv> Query executed in 219.65 ms. > > exit Enjoy life. nicholas@mordor:~/flwor/csv$ nicholas@mordor:~/flwor/csv$ basex addressbook.xq <csv> <record> <Name>Huber</Name> <First_Name>Sepp</First_Name> <Address>Hauptstraße 13</Address> <City>93547 Hintertupfing</City> </record> </csv>nicholas@mordor:~/flwor/csv$ nicholas@mordor:~/flwor/csv$ nicholas@mordor:~/flwor/csv$ cat addressbook.csv Name,First Name,Address,City Huber,Sepp,Hauptstraße 13,93547 Hintertupfing nicholas@mordor:~/flwor/csv$ nicholas@mordor:~/flwor/csv$ cat addressbook.xq xquery version "3.1"; let $text := file:read-text('addressbook.csv') return csv:parse($text, map { 'header': true() }) nicholas@mordor:~/flwor/csv$ see also: https://stackoverflow.com/q/65275618/4531180 thanks, Nick

2 1

java bindings - Data types
by Andre Bovy 15 Dec '20

15 Dec '20

Dear BasexTalk, for different (good or bad) reasons, I would like to use the java HTTPConnection instead of the http:client module. But, I am not able to find the correct syntax for these statements. I have tried the middle dot character to force the correct type, without success I receive always the message : [XPTY0004] java.net.URL instance expected as first argument, xs:anyURI found. Any idea? Thank you in advance declare namespace HttpURLConnection ="java.net.HttpURLConnection"; declare namespace URL ="java.net.URL"; let $urlString := "https:www.google.com" let $url := URL:new($urlString) let $httpConn := URL:openConnection($url) return $urlString

2 1

Slow BaseX cold performance
by Peter Villadsen 14 Dec '20

14 Dec '20

All, I am facing some issues with BaseX (9.3.1) performance when running cold, i.e. immediately after the server is started. The problem I am seeing is that the performance of moderately complex queries is terrible for a some time after the database is opened, but then improves dramatically after a few query evaluations have taken place. For instance, a certain query takes around 7 minutes to when the server has just been started, but then performance improves to consistently to take around 18 seconds. This happens for most queries, it is not a characteristic of any particular query, as far as I can tell. This is annoying, of course, and users are complaining that the system is not responsive. Here are some observations: 1. The first time the query is submitted the java process does not consume any CPU cycles and no footprint is added to the 10GB that is allocated when the database is opened (it takes around 1 minute to open the database. You can see the database info below). I would have expected a surge of activity as soon as the query was submitted, as all the 16 cores contribute to evaluating the result. 2. If I use the BaseX GUI (with an allowed 26GB but consuming around 10GB in this case) I never get any delays - The query performance is consistently around 18 secs, immediately after opening the database. 3. Both the HTTP server or TCP server exhibit this anomaly. 4. After the initial sluggishness, when the database is running warm, the performance stays satisfactory, at around 18 seconds. I have never seen it return to the bad situation. 5. The first time the query is run, the footprint rises about 1GB to around 11GB. It does not increase with subsequent query evaluations. 6. I think that the system remains warm even if I close down the java server process and start it again. Is this an accepted behavior or an anomaly? Why is the behavior different if the database is queried in the stand-alone situation (the BaseX UI client)? Is there some setting that I need to provide to the Java process to ameliorate the cold performance? Any indexes that I have to put in place? Any suggestions are welcome. Here are some stats describing the hardware setup: The machine hosting both the server and the client is a powerful 16 core box running a AMD EPYC 7452 Processor with 64GB RAM running in the cloud; since they both the client and the server are running on the same box, there should be negligible network latency in this scenario. The machine (running windows server 2016 datacenter) is doing nothing else at the time of these tests: The Idle process consumes 99% of the CPU time and almost no disk or network access takes place. The machine does not have hardware disks - They are hosted on another box, I believe. The database information: <database> <databaseproperties> <name>generated</name> <size>16 GB</size> <nodes>705422480</nodes> <documents>136673</documents> <binaries>0</binaries> <timestamp>2020-09-17T22:24:15.037Z</timestamp> <uptodate>false</uptodate> </databaseproperties> <resourceproperties> <inputpath>C:/Users/pvillads/Desktop/generated/</inputpath> <inputsize>16 GB</inputsize> <inputdate>2020-09-17T22:24:14.943Z</inputdate> </resourceproperties> <indexes> <textindex>false</textindex> <attrindex>false</attrindex> <tokenindex>false</tokenindex> <ftindex>false</ftindex> <textinclude/> <attrinclude/> <tokeninclude/> <ftinclude/> <language>English</language> <stemming>false</stemming> <casesens>false</casesens> <diacritics>false</diacritics> <stopwords/> <updindex>false</updindex> <autooptimize>false</autooptimize> <maxcats>100</maxcats> <maxlen>96</maxlen> <splitsize>0</splitsize> </indexes> </database> $ java -version java version "1.8.0_271" Java(TM) SE Runtime Environment (build 1.8.0_271-b09) Java HotSpot(TM) 64-Bit Server VM (build 25.271-b09, mixed mode) Thanks, Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

2 1

Copying databases between servers: pth.basex?
by James Ball 12 Dec '20

12 Dec '20

Hello, I’ve been debugging a strange issue on a system and I can’t quite understand what’s causing it. I create some databases on my local laptop (macOS). They provide master data for a larger system so I then copy them to a cloud server (Linode/Amazon). I recently switched updated some queries to use db:open with a path restriction to make them run faster. Everything worked on the laptop but nothing was returned on the server for the same paths. If I optimise(all) the database on the server it then works. After the optimisation, on the server there is a file called pth.basex and a file called idp.basex. On the Mac there is NO file in the database folder called pth.basex or idp.basex. I’m not sure what pth.basex or idp.basex are as they’re not referenced on Storage Layout[1] This is copying the database files directly. I have had mixed results using backup zip files - sometimes it works and sometimes it fails. Has anyone else observed this behaviour? What are the steps I should take to ensure reliable movement of databases? What are these mysterious files? I’m happy to update the Wiki with any new information . Many thanks, James [1] https://docs.basex.org/wiki/Storage_Layout <https://docs.basex.org/wiki/Storage_Layout>

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk