October 2024 - BaseX-Talk - mailman.uni-konstanz.de

BaseX 9.6: The Summer Edition
by Christian Grün 28 Nov '24

28 Nov '24

Dear all, We provide you with a new and fresh version of BaseX, our open source XML framework, database system and XQuery 3.1 processor: https://basex.org/ Apart from our main focus (query rewritings and optimizations), we have added the following enhancements: XQUERY: MODULES, FEATURES - Archive Module, archive:write: stream large archives to file - SQL Module: support for more SQL types - Full-Text Module, ft:thesaurus: perform Thesaurus queries - Fulltext, fuzzy search: specify Levenshtein limit - UNROLLLIMIT option: control limit for unrolling loops XQUERY: JAVA BINDINGS - Java objects of unknown type are wrapped into function items - results of constructor calls are returned as function items - the standard package "java.lang." has become optional - array arguments can be specified with the middle dot notation - conversion can be controlled with the WRAPJAVA option - better support for XQuery arrays and maps WEB APPLICATIONS - RESTXQ: Server-Timing HTTP headers are attached to the response For a more comprehensive list of added and updated features, look into our documentation (docs.basex.org) and check out the GitHub issues (github.com/BaseXdb/basex/issues) Have fun, Your BaseX Team

11 43

Unable to paste into external variable dialogue box in the GUI-Basex 11.4
by brian＠kennison.name 25 Oct '24

25 Oct '24

Hello Everyone, Not a big deal but can’t paste into the external variable dialog box. I have a script that has several external variables (urls) which are long so I paste them in the dialog box in the GUI (Basex-11.4). Anybody else experiencing this? Thanks for your time —Brian

6 9

Write files in parallel?
by Thompson, Timothy 17 Oct '24

17 Oct '24

Hello, Is it possible to call file:write-text-lines in parallel inside a fork-join operation? I have multiple databases that I would like to run a query over, in parallel, and write the results as JSON Lines to a file per database. When I try this, it doesn’t seem to parallelize. Thanks in advance, Tim -- Tim A. Thompson (he, him) Librarian for Applied Metadata Research Interim Manager, Metadata Services Unit Yale University Library www.linkedin.com/in/timathompson<http://www.linkedin.com/in/timathompson>

3 7

How to recognize a byte-order-mark?
by Hans-Juergen Rennau 11 Oct '24

11 Oct '24

Dear BaseX people, there is a serializatioin parameter for adding a byte-order-mark when serializing. Such a document cannot be parsed using fn:doc() - error message: [FODC0002] "C:/projects/ofx-works/work/test-bom.xml" (Line 1): Content ist nicht zulässig in Prolog. This message is rather unspecific. My question: is there a way how to determine if a byte-order-mark is used in a given file? Kind regards,Hans-Jürgen

2 2

Re: [basex-talk] Setting multiple CSV EXPORTER options is not documented on docs.basex.org
by Christian Grün 03 Oct '24

03 Oct '24

Hi Navel, > BaseX Xquery CSV module is for dealing with CSV files which we don't have. With this module, you can serialize XML data as CSV (and parse CSV back to XML). But that’s certainly just one way to do it. Hi Owen, > However, I wonder how BaseX might deal with more than a million records. Feel free to get back to us once you encounter any limits. Best, Christian Naval Sarda <nsarda(a)epicomm.net> schrieb am Do., 3. Okt. 2024, 14:45: > Hi Owen, Christian, > > We are working on Stratml files which are in XML format. BaseX Xquery CSV > module is for dealing with CSV files which we don't have. > > We can scale up BaseX by adding more servers and splitting the data > between more servers if the record counts goes high. > > Naval > > > On 02/10/24 10:54 pm, Owen Ambur wrote: > > Naval, can you answer Christian's question? > > My sense is that a lot of features have been built into BaseX that we > could use but I don't have the knowledge or expertise to understand how > best to do so. At least, I hope we're not reinventing capabilities that > are already available to address our technical objectives > <https://aboutthem.info/SQS.xml> as well as our broader conceptual > objectives <https://aboutthem.info/ATI.xml>. > > Christian, this morning we had a very encouraging Zoom meeting with folks > at GSA who are finally getting around to figuring out how to help Uncle > Sam's agencies comply with section 10 > <https://www.linkedin.com/pulse/trustworthy-institutions-owen-ambur/> of > the GPRA Modernization Act. I encouraged them not to reinvent the StratML > schemas and it would be great if the BaseX community could help us > demonstrate the benefits of using them, not only by U.S. federal agencies > but agencies at all levels of government, worldwide, as well as tax-favored > organizations and others whose plans and reports should be matters of > public record. > > There are >5.8K plans in the StratML collection > <https://stratml.us/drybridge/index.htm> and indexed in the query > service. Their URLs are listed in sitemap format at > https://stratml.us/docs/sitemap.xml > > I am contemplating whether to hire someone to convert the relevant > elements of the IRS Form 990 database > <https://www.irs.gov/charities-non-profits/tax-exempt-organization-search-bu…> > to StratML format, using the templates at > https://stratml.us/drybridge/index.htm#MPR4CO However, I wonder how > BaseX might deal with more than a million records. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Wednesday, October 2, 2024 at 12:18:16 PM EDT, Christian Grün > <christian.gruen(a)gmail.com> <christian.gruen(a)gmail.com> wrote: > > > Hi Owen, > > Is it based on the BaseX XQuery CSV Module? > > Best, > Christian > > > > > Owen Ambur <owen.ambur(a)verizon.net> schrieb am Mi., 2. Okt. 2024, 18:12: > > I'm not sure how this exchange might relate but my developer has provided > CSV export capabilities for query results listings at StratML > <https://search.aboutthem.info/> > > > StratML <https://search.aboutthem.info/> > > > > Any comments or suggestions on how we might enhance the functionality of > our StratML-enabled query service would be most welcome. > > Owen Ambur > https://www.linkedin.com/in/owenambur/ > > > On Tuesday, October 1, 2024 at 04:42:12 AM EDT, Christian Grün < > christian.gruen(a)gmail.com> wrote: > > > Hi Omar, > > Thanks for the observation. For the SERIALIZER option, there was a > corresponding note which I have added to the EXPORTER option, along with > a little example for exporting CSV [1]. > > Best, > Christian > > [1] https://docs.basex.org/main/Options#exporter > > > > On Mon, Sep 30, 2024 at 4:04 PM Omar Siam <Omar.Siam(a)oeaw.ac.at> wrote: > > Hi, > > I just tried after some time to script a CSV export with a BXS file. I > forgot how to set multiple options for the csv serialization. In the end > this worked: > <set > option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> > I can not find it on docs.basex.org. Perhaps this should be added and > explained. > > Best regards > > -- > Mag. Ing. Omar Siam > Austrian Center for Digital Humanities and Cultural Heritage > Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences > Stellvertretende Behindertenvertrauensperson | Deputy representative for > disabled persons > Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria > T: +43 1 51581-7295 > omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh > >

1 0

Setting multiple CSV EXPORTER options is not documented on docs.basex.org
by Omar Siam 02 Oct '24

02 Oct '24

Hi, I just tried after some time to script a CSV export with a BXS file. I forgot how to set multiple options for the csv serialization. In the end this worked: <set option="EXPORTER">method=csv,csv=header=true,,lax=false,,quotes=true</set> I can not find it on docs.basex.org. Perhaps this should be added and explained. Best regards -- Mag. Ing. Omar Siam Austrian Center for Digital Humanities and Cultural Heritage Österreichische Akademie der Wissenschaften | Austrian Academy of Sciences Stellvertretende Behindertenvertrauensperson | Deputy representative for disabled persons Bäckerstraße 13, 1010 Wien, Österreich | Vienna, Austria T: +43 1 51581-7295 omar.siam(a)oeaw.ac.at | www.oeaw.ac.at/acdh

3 4