April 2022 - BaseX-Talk - mailman.uni-konstanz.de

Free Text - understanding
by Hans-Juergen Rennau 25 Apr '22

25 Apr '22

Dear BaseX people, it would be kind if you could check my understanding of Free Text @ BaseX. (1) Tokenization ignores element borders. If correct, I suggest documentation of the fact, seehttps://www.w3.org/TR/xpath-full-text-10/#TokenizationSec"In the absence of an implementation-definedway to differentiate, element markup (start tags, end tags, andempty-element tags) creates token boundaries." (2) Function ft:search can only find individual text nodes, it is not possible to apply scope "phrase" or "all words" beyond the boundaries of an individual text node. So, for example, given a document<doc> <t1>Stand </t1> <t2>der Information. Siehe unten.</t2></doc> there is no way of searching for "Stand der Information" *and* obtain information about the location of the match (in other words - search via ft:search). (3) The unit "sentence" (as for example used in the qualifier same sentence) is exclusively defined by the occurrences of "." (dot) characters. In particular, it is unrelated to text node boundaries. For example:$doc contains text "Stand der Information siehe" same sentence yields false.$doc contains text "Stand der Information" same sentence yields true. (4) The unit "paragraph" (as for example used in the qualifier "same paragraph") is not delimited - "same paragraph" always applies. A check would be highly appreciated! Kind regards,Hans-Jürgen PS: I think there is a bug concerning "different sentence": basex "'base.x' contains text 'base x' same sentence" false basex "'base.x' contains text 'base x' different sentence" false basex "'base x' contains text 'base x' same sentence" true basex "'base x' contains text 'base x' different sentence" false PPS: Thank you very much for the excellent implementation of Free Text - for several years, it has been in productive use by a mission critical service mapping format markup to semantic markup.

2 3

Interrupted queries - partial results?
by Patrick Durusau 21 Apr '22

21 Apr '22

Greetings! Is it possible to capture partial results from an interrupted query? When I realize a query is taking too long for the data involved, it might be helpful in correcting the mistake. Thanks! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

3 6

Performing extra data conversion for double values (by XQuery)
by Markus Elfring 21 Apr '22

21 Apr '22

Hello, I would like to perform a sanity check for some input data which represent numbers that are using the comma as the decimal separator. I stumbled on the message “[FORG0001] Cannot convert to xs:double: …” then according to the evaluation of another XQuery script by the software “BaseX 9.7”. https://docs.basex.org/wiki/XQuery_Errors#Functions_Errors Can any functions help with the safe handling of currency values for my use case? https://docs.basex.org/wiki/Conversion_Module Regards, Markus

2 1

Joining a varying number of information sources (with XQuery)?
by Markus Elfring 19 Apr '22

19 Apr '22

Hello, It is supported to specify a fixed number of information sources for a for clause. https://www.w3.org/TR/xquery-31/#id-xquery-for-clause I imagine that the selection of for bindings can occasionally vary so much and might become so big that it would be needed to construct FLWOR expressions by more sophisticated data structures. I guess that the specification of consistent join conditions (and related constraints) would become more challenging. Can any programming interfaces help further to work with such use cases? https://docs.basex.org/wiki/XQuery_Module Regards, Markus

5 32

Improving the understanding for counting of entries in data groups
by Markus Elfring 19 Apr '22

19 Apr '22

Hello, I constructed the following XML file for another test of the software “BaseX 9.7”. <?xml version="1.0" encoding="UTF-8" standalone="yes"?> <test_data> <info> <id>12</id> <topics> <topic>Demo1</topic> <topic>Demo2</topic> </topics> </info> <info> <id>23</id> <topics> <topic>Demo1</topic> <topic>Demo2</topic> </topics> </info> <info> <id>34</id> <topics> <topic>Test1</topic> <topic>Test2</topic> <topic>Test3</topic> </topics> </info> <info> <id>45</id> <topics> <topic>Test1</topic> <topic>Test2</topic> <topic>Test3</topic> </topics> </info> <info> <id>56</id> <topics> <topic>Test1</topic> <topic>Test2</topic> <topic>Test3</topic> </topics> </info> <info> <id>67</id> <topics> <topic>Probe1</topic> </topics> </info> </test_data> I tried the following XQuery script out accordingly. declare option output:method "csv"; declare option output:csv "header=yes, separator=|"; for $x in //test_data/info group by $topics := string-join($x/topics/topic/data(), "*") let $incidence := count($topics) order by $incidence descending return <csv> <record> <topic_combination>{$topics}</topic_combination> <incidence>{$incidence}</incidence> </record> </csv> Corresponding test result: topic_combination|incidence Demo1*Demo2|1 Test1*Test2*Test3|1 Probe1|1 I would like to see the numbers “2” and “3” instead at the end of two rows for such a data analysis approach. I would appreciate further advices for this use case. Regards, Markus

2 1

CVE-2022-22965: Spring framework 0-day remote code execution vulnerability
by Bülow, Gilles 14 Apr '22

14 Apr '22

Hi all, to exclude issues with BaseX and the topic in this email-subject (CVE-2022-22965: Spring framework 0-day remote code execution vulnerability<https://securityboulevard.com/2022/04/spring4shell-vulnerability-cve-2022-2…>) I would like to know if BaseX could possibly be affected by the problem discussed and if so, when there is an update scheduled which can solve this problem. Thanks in advance for replies Regards Gilles other links: https://www.dfn-cert.de/aktuell/0day-schwachstelle-spring-framework-apache-… https://tanzu.vmware.com/security/cve-2022-22965 -- Dr.-Ing. Gilles Bülow Project Manager Digitalization Production IT DKE German Commission for Electrical, Electronic & Information Technologies Merianstraße 28 63069 Offenbach am Main Phone: +49 69 6308-294 Fax: +49 69 6308-9294 Mobile: +49 170 5769243 gilles.buelow(a)vde.com<mailto:gilles.buelow@vde.com> http://www.dke.de<http://www.dke.de/> [cid:VDE_Email_Abbinder_VDEHiglights2021_aaf1e897-893b-444a-a4a4-f03d3e97ff22.jpg]<https://www.vde.com/highlights> VDE Verband der Elektrotechnik Elektronik Informationstechnik e. V. VDE Association for Electrical, Electronic & Information Technologies Vorstand / Executive Board: Ansgar Hinz (Vorsitzender / CEO); Dr. Beate Mand (stellv. Vorsitzende / CFO) Rechtsform / Legal form: Eingetragener Verein / Registered association Amtsgericht Vereinsregister / Local court register of associations: Frankfurt am Main / Nr. / No: VR 4884 Sitz der Gesellschaft / Association's registered office: Frankfurt am Main, Germany USt-IdNr. / VAT-ID: DE 114 235 367 Datenschutzinformationen<https://www.vde.com/dsh-vde> Data Protection Information<https://www.vde.com/dpn-vde> Der Inhalt dieser E-Mail (sowie der ggf. enthaltenen Anhänge) ist vertraulich und kann darüber hinaus durch besondere Bestimmungen geschützt sein. Sollten Sie nicht der vorgesehene Empfänger sein, bitten wir Sie, den Versender zu informieren und die Nachricht zu löschen. Die Weitergabe sowie Vervielfältigung, Verwertung und Mitteilung seines Inhalts ist nur mit unserer ausdrücklichen Genehmigung gestattet. Alle Rechte vorbehalten, insbesondere für den Fall der Schutzrechtsanmeldung. This e-mail and any attachments are confidential and may also be privileged. If you are not the intended recipient, please immediately notify the sender and delete this message. Its contents are not to be passed on, duplicated, exploited or disclosed without our express permission. All rights reserved, especially the right to apply for protective rights.

2 1

Closing a socketconnection
by Ben Engbers 14 Apr '22

14 Apr '22

Hi, While reading the basexdbc.c code from Alexander Holupirek, I saw that he explicitly sends the 'exit' command to the server before closing the socket. I couldn't find anything on this command in the client server protocol. Is it necessary to send this command to the server? If so what is the effect of sending this command? Ben Engbers

2 1

BaseX Query Performance
by Darryl Pretto 12 Apr '22

12 Apr '22

Hi, I have a BaseX 9.0 instance running on Jetty 9.4.8 on RHEL 7.9. I run many different types of queries on several thousand XML files, about 10gb total source files. These queries take several hours to complete. While I have been able to rewrite queries here and there to optimize them, I am wondering what is the best way to increase BaseX query performance overall. When I check the server CPU and memory neither of them have high utilization. The CPU use varies but mostly is at 12%. The memory use is similar. I have allocated 8gb of memory to Jetty via the Java options settings: -Xms8g -Xmx8g Are there any other resources I can check or change to increase overall query speed? Thanks, Darryl

3 2

Re: [basex-talk] Checking the display of line breaks in the info view
by Markus Elfring 12 Apr '22

12 Apr '22

> What do you mean with space character? I suggest to take a closer look at the differences from a display like “``["line 1 line 2 line 3"]``” in comparison to the mentioned test example. Would you find any other representation more appropriate here? Regards, Markus

4 8

Basexgui Feature suggestion
by Majewski, Steven Dennis (sdm7g) 11 Apr '22

11 Apr '22

It would be handy if there was a way to bind results to current context for additional inspection/investigation/query of results. Currently, it seems, you would have to save results to a file and then create database from that file to make an additional query on results. That binding would be available from editor or input bar. Or perhaps alternatively, it could include an option to base visualizations on results instead of open database — although I’m guessing the former would be easier to implement than the latter. — Steve Majewski

6 11