BaseX-Talk

basex-talk@mailman.uni-konstanz.de

8 participants
5255 discussions

Adding another document from XQuery evaluation
by Markus Elfring 21 May '22

21 May '22

Hello, The software “BaseX” is providing direct support for file formats like “XML” and “CSV”. Corresponding data can be generated by customised XQuery scripts. I got the impression that additional documents can be integrated into selected databases so far by specifying file names. Does this mean that data (which would be determined by a script evaluation) need to be exported into a file for a subsequent file import? I imagine that another function combination for the available modules can make such an operation more convenient. Regards, Markus

9 21

BaseX, RESTXQ, and React?
by Eliot Kimber 20 May '22

20 May '22

I’m starting to learn React in the context of enhancing a React-based site created by others (lightstep.com/incident-reponse/docs). I’m also developing a non-trivial web application in BaseX (the Project Mirabel system I’ve mentioned before). For Mirabel I just hacked some pages using RESTXQ and the least CSS and JavaScript I could get away with, cribbing liberally from the out-of-the-box BaseX web apps. But as I learn about React and its companion, Material UI, I’m thinking that there’s probably a lot of power to combining React with RESTXQ as a way to build a top-notch site with lots of interactivity at relatively low cost (React and MUI provide all the interaction implementation details you might want). But I’m not sure what this would mean in practice. I’m wondering if anyone else has done this or at least thought about it enough to have some ideas about what to do or not do? In addition, at the most recent DITA conference, Convex 2022, George Bina presented a very interesting experiment in generating React components for DITA topics where the components did the dynamic content resolution at delivery time rather than at HTML building time, enabling practical incremental update of DITA-based content through a React-based site. The same technique could be applied to RESTXQ by generating XQuery modules for individual topics. But an advantage of a React approach is that it’s more general and could be used with any React-based site. But in any case it’s gotten me thinking more about the generation of information I see React being used mostly in statically-generated sites that are published through something like Netlify but my Mirabel application is very much almost entirely dynamic in that most of the content is the result of queries. One could treat BaseX as a supplier of microservices via a REST API and that’s probably how most users of BaseX with React do it, if for no other reason than separate groups are probably responsible for the web stuff and the BaseX stuff. But in the case of my Mirabel application it’s a single team doing everything with limited web development knowledge but access to talented web designers. So having all the web stuff also in BaseX makes development and maintenance easier with the team we have. We’re not JavaScript programmers but we can manage composing React components together and doing the minimal programming needed to make them behave appropriately. Clearly I can just have RESTXQ-generated pages import the React libraries and supporting components directly and I can generate JSX code as inline scripting and maybe that’s the best approach for an all-RESTXQ site but maybe there’s something better? Or does stepping up to a proper React site that uses BaseX as a source of microservices make more sense, even for this small project? Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

4 4

ODBC support for BaseX?
by Markus Elfring 20 May '22

20 May '22

Hello, The software “BaseX” is providing direct support for document databases. Is any support available for data management by interfaces like the following? * Open Database Connectivity * Java Database Connectivity How are corresponding drivers evolving? Regards, Markus

5 6

Selecting nodes in a db by source file name
by Charles Bearden 19 May '22

19 May '22

Let's say I have a database built from 40+ XML documents, each with about 4 million nodes for a total of about 404 million nodes, of which 30k are high-level records of interest. Let's say that a given node of interest (a PubMed record, actually) may occur once in this database for each time it has been updated, and I can identify the most recent version of that record by the PubMed ID and the filename (an ascending sort of the filenames sorts them from least recent to most recent). Is there a way in XQuery I can identify a record in this database not only by its PubMed ID but also limit the result set by source document name? I know that `db:path($elem)` gives me the document name for an element, but I want to use the document name to help pick out the element from among several that may share its PMID. Context: I have 26 such databases, each of which contains 43-44 source files, each of which contains 30000 records. I have built one index database that, for each record, includes PubMed ID, source filename, and database name. For a given PMID I can very quickly retrieve the db name and the file name, but I need to search the db not only by PMID but also by source filename in order to select the most recent version of a record. Thank you & all the best, Chuck Bearden

5 5

Checking run time characteristics according to the handling of customised indexes
by Markus Elfring 17 May '22

17 May '22

Hello, Some indexes are generally supported also by the software “BaseX”. https://docs.basex.org/wiki/Indexes Some data processing approaches would usually depend on indexes for primary and foreign keys. https://en.wikipedia.org/wiki/Primary_key How much do run time characteristics influence data transfers (and conversion of corresponding data structures) for the available indexing technologies? Regards, Markus

1 0

Repeating data based on varying items in an array
by Markus Elfring 16 May '22

16 May '22

Hello, It seems that I am still not familiar enough with the programming language “XQuery” for the quick specification of a bit of code for a general data processing task. Thus I hope that the following use case can be clarified better. A sequence like “(["f" [1 2 3]], ["g" [4, 5]])” might be an interesting test example. It contains two nested arrays. * One part refers to fixed data. * Another part refers to some items with a varying number. I would like to convert the varying items into a data representation like the following. f,1 f,2 f,3 g,4 g,5 Can any customised functions help for the desired transformation? Regards, Markus

3 11

Add a comment to a backup?
by Jonathan Robie 13 May '22

13 May '22

I have been making backups before doing particularly complex things to my treebanks, and I find myself writing down information about what stage of processing a given backup corresponds to. "after replacing subtrees for missing compounds" I wish I could associate these strings with backups in BaseX so I can more easily know which one I would restore if something went wrong. Jonathan

4 8

Developments for address books
by Markus Elfring 12 May '22

12 May '22

Hello, Various data models and corresponding applications can be constructed also with the help of the software “BaseX”. One popular data management tool is the address book (which can be supported by customised hardware and software), isn't it? Would you like to point any development repositories and further information sources out for such an application domain? Regards, Markus

1 0

Oxygen and BaseX Integrations?
by Eliot Kimber 06 May '22

06 May '22

I’m looking at ways to better integrate BaseX with Oxygen, both for XQuery editing and as a way to augment Oxygen’s DITA authoring features (i.e., using BaseX to provide more comprehensive link and search database features). Radu pointed me to Project Argon https://github.com/axxepta/project-argon but it looks like it hasn’t been updated in a few years (last commit was 2017) and my initial attempt to run the gradle build failed on the Java version detection. I’ll reach to the Project Argon team but I’m wondering if anyone else is doing anything with Oxygen integration. I’m looking for a couple of things: * Enable editing XQuery modules in Oxygen with validation, either using Saxon or BaseX, whichever is easier. While the BaseX editor is decent I really miss the Oxygen features I’ve come to know and love, like outline view. My initial attempt to set up an entity resolution catalog to make this work did not succeed, but I didn’t have a lot of time to spend on it. * Embedded BaseX server in an Oxygen add-on. This shouldn’t be too hard and we have a ServiceNow-specific add-on I could do this in, but I’m always looking for solutions I can crib from… Thanks, Eliot _____________________________________________ Eliot Kimber Sr Staff Content Engineer O: 512 554 9368 M: 512 554 9368 servicenow.com<https://www.servicenow.com> LinkedIn<https://www.linkedin.com/company/servicenow> | Twitter<https://twitter.com/servicenow> | YouTube<https://www.youtube.com/user/servicenowinc> | Facebook<https://www.facebook.com/servicenow>

1 0

Not sure if feature/bug/my mistake!
by Patrick Durusau 06 May '22

06 May '22

Greetings! I have a directory of files that I use to create a database, using the directory as my starting point. On Debian, the files appear in this order: 01-matthew.xml 02-mark.xml 03-luke.xml 04-john.xml If I create an empty database and then add the files one by one, in that order, then //title[@type="main"] returns: ΚΑΤΑ ΜΑΘΘΑΙΟΝ ΚΑΤΑ ΜΑΡΚΟΝ ΚΑΤΑ ΙΩΑΝΗΝ ΚΑΤΑ ΙΩΑΝΗΝ On the other hand, if I start at the directory, add xml files, the database is created and //title[@type="main"] returns: ΚΑΤΑ ΙΩΑΝΗΝ ΠΡΟΣ ΕΦΕΣΙΟΥΣ ΚΑΤΑ ΜΑΘΘΑΙΟΝ ΙΩΑΝΟΥ Α Question (sorry for the long setup): Is the sort order of manually added files an artifact of the manual addition? That is I cannot expect users across systems to experience the same load order as I do? Asking because I'm writing documentation along with example queries for several datasets and documenting random results, isn't likely to be helpful to readers. I am aware I can use db:list(database-name) to obtain and sort on the original file names but that takes me away from the file content. Ah, BaseX 9.7.1 on Debian. You know, the files don't have internal sort attributes. ntorder = "digit" would be enough to sort on that attribute and return the book names in the expected order. I'm sure there are better solutions, suggestions appreciated! Patrick -- Patrick Durusau patrick(a)durusau.net Technical Advisory Board, OASIS (TAB) Editor, OpenDocument Format TC (OASIS), Project Editor ISO/IEC 26300 Co-Editor, ISO/IEC 13250-1, 13250-5 (Topic Maps) Another Word For It (blog): http://tm.durusau.net Homepage: http://www.durusau.net Twitter: patrickDurusau

3 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk