BaseX-Talk

basex-talk@mailman.uni-konstanz.de

12 participants
5242 discussions

HTTP Client DELETE with body
by Marco Lettere 12 Jun '21

12 Jun '21

Dear all, I have to call an API which model an HTTP DELETE operation based on the body of the request. It looks like currently http:send-request is not allowing body to be present ("Body not expected for method DELETE."). I feel that this is bit too restrictive interpretation of the spec which states (as far as I recall) that there is no defined semantic for the operation but not that it is forbidden. Is there any possibility to relax this behaviour and allow for bodies in DELETE calls? [1] Thank you very much. Marco. [1] https://github.com/BaseXdb/basex/blob/382c8097afb1ec5bac1e9511a2287686c33f6…

3 6

Re: [basex-talk] Error with full-text and fuzzy query
by Christian Grün 07 Jun '21

07 Jun '21

cc to the list (2)… Christian Grün <christian.gruen(a)gmail.com> schrieb am Mo., 7. Juni 2021, 15:47: > …and another snapshot for you: modifier letters [1] will now be > regarded as diacritical characters, and queries such as… > > tokenize('faraʼid faraid Birkan')[. contains text 'faraʼid' using fuzzy] > > …will only regard the first two terms as similar. As a consequence, > fuzzy queries for terms with modifiers should get a lot faster. > > You’ll need to recreate your full-text index to take full advantage of the > fix. > > [1] https://de.wikipedia.org/wiki/Unicodeblock_Spacing_Modifier_Letters > > > > On Mon, Jun 7, 2021 at 2:00 PM Christian Grün <christian.gruen(a)gmail.com> > wrote: > > > > > Out of curiosity, is there a way to access those individual term > similarity statistics via XQuery? > > > > I assume there is no straightforward way, but you can check the first > > results of a full-text query: > > > > ft:search('your-db', 'faraʼid', map { "fuzzy": true() })[position() < > 10] > > > > And I noticed that due to the modifier letter (ʼ), many non-similar > > results are returned as well. I’ve raised another issue to track this > > down [1]. > > > > [1] https://github.com/BaseXdb/basex/issues/2015 >

1 0

Re: [basex-talk] Error with full-text and fuzzy query
by Christian Grün 07 Jun '21

07 Jun '21

cc to the list… Christian Grün <christian.gruen(a)gmail.com> schrieb am Mo., 7. Juni 2021, 13:50: > Thanks, Tim, that was helpful. It turned out that the index contains > an unusually high number of similar tokens for one search terms in > your query: > > faraʼid : 13709 similar terms > muhammad : 131 similar terms > siraj : 50 similar terms > ... > > A new snapshot with a bug fix is available, in which similar terms are > collected non-recursively [1]. I’d have wished that your search was > evaluated faster (it takes around 6 seconds on machine) but at least > it succeeds. I’ll have some more thoughts. > > Cheers, > Christian > > [1] https://files.basex.org/releases/latest/ > > > > On Mon, Jun 7, 2021 at 1:17 PM Tim Thompson <timathom(a)gmail.com> wrote: > > > > Thank you, Christian. If it's still helpful, here is a link to download > the document I am using as my full-text index. > > > > All best, > > Tim > > > > > > -- > > Tim A. Thompson > > Metadata Librarian > > Yale University Library > > > > On Mon, Jun 7, 2021 at 6:19 AM Christian Grün <christian.gruen(a)gmail.com> > wrote: > >> > >> I think I managed to build up a bug scenario that should resemble > >> yours [1]: If thousands of similar terms are found, the results cannot > >> be recursively joined anymore. > >> > >> [1] https://github.com/BaseXdb/basex/issues/2014 > >> > >> > >> > >> On Mon, Jun 7, 2021 at 10:28 AM Christian Grün > >> <christian.gruen(a)gmail.com> wrote: > >> > > >> > Hi Tim, > >> > > >> > I’m still trying to get this reproduced. > >> > > >> > The error is caused by excessive recursive functions call. Out of > >> > interest, could you try to increase the size of the Java Stack Trace > >> > and see if the error persists? This can be achieved by assigning a > >> > large value to the JVM via the Xss flag [1]. You could e.g. add > >> > -Xss64m to the BASEX_JVM variable in the BaseX start scripts [2]. > >> > > >> > Internal notes… If yes, we might be confronted with an infinite loop. > >> > If no, we should try to rewrite a recursive index lookup to an > >> > iterative one. > >> > > >> > If your data is not confidential, feel free to provide me with a > download link. > >> > > >> > Cheers, > >> > Christian > >> > > >> > [1] > https://stackoverflow.com/questions/3700459/how-to-increase-the-java-stack-… > >> > [2] https://docs.basex.org/wiki/Start_Scripts > >> > > >> > > >> > > >> > On Fri, Jun 4, 2021 at 11:03 PM Tim Thompson <timathom(a)gmail.com> > wrote: > >> > > > >> > > Thanks, Christian. The rest of the stack trace was just many lines > of "at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74)" until > the end: > >> > > > >> > > [qtp1546693040-47] WARN > org.eclipse.jetty.server.handler.ErrorHandler - Error page too large: 500 > java.lang.StackOverflowError Request(POST // > 10.5.157.229:10214/dba/query-eval)@7dcadc62 > >> > > [qtp1546693040-47] INFO > org.eclipse.jetty.server.handler.ErrorHandler - Disabling showsStacks for > ErrorPageErrorHandler@53032c30{STARTED} > >> > > > >> > > Best regards, > >> > > Tim > >> > > > >> > > > >> > > -- > >> > > Tim A. Thompson > >> > > Metadata Librarian > >> > > Yale University Library > >> > > > >> > > On Fri, Jun 4, 2021 at 1:30 PM Christian Grün < > christian.gruen(a)gmail.com> wrote: > >> > >> > >> > >> Hi Tim, > >> > >> > >> > >> > [qtp1546693040-47] WARN org.eclipse.jetty.server.HttpChannel - > /dba/query-eval > >> > >> > java.lang.StackOverflowError > >> > >> > at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:73) > >> > >> > at > org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74) > >> > >> > >> > >> Could you share some more lines of the stack trace with us? > >> > >> > >> > >> Thanks in advance > >> > >> Christian >

1 0

Error with full-text and fuzzy query
by Tim Thompson 07 Jun '21

07 Jun '21

Hello, I have a full-text index defined on a database with 21,936,670 entries. I'm hitting a stack overflow error when I try to query the following (normalized) string with a fuzzy query: "sajawandi, siraj al-din muhammad ibn muhammad, active 12th century. faraʼid al-sirajiyah" The index entries look like this: <d a="http://id.loc.gov/authorities/names/n2008037847"> <n>Sajāwandī, Sirāj al-Dīn Muḥammad ibn Muḥammad, active 12th century. Farāʼiḍ al-Sirājīyah</n> <d>12th cent.</d> </d> If I create a new DB ("ftindex-test") with only that one entry and try the following lookup, it works: ft:search( "ftindex-test", "sajawandi, siraj al-din muhammad ibn muhammad, active 12th century. faraʼid al-sirajiyah" , map {"mode": "phrase", "content": "entire", "fuzzy": true()} )/.. However, if I try the same query against the full index (with ~22 million entries), it fails with a stack overflow error: [qtp1546693040-47] WARN org.eclipse.jetty.server.HttpChannel - /dba/query-eval java.lang.StackOverflowError at org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:73) at org.basex.index.query.FTIndexIterator$2.pos(FTIndexIterator.java:74) ... If I remove the "fuzzy" parameter, the query does work against the full index. Is this a bug, a known limitation here, or something that I'm missing? Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian Yale University Library

2 4

speaking effectively to the optimizer
by Graydon Saunders 04 Jun '21

04 Jun '21

hello -- So I want to subtract one list of sentences from another list of sentences. (As a way of checking "what did processing do to this document?"; we know it added some words, and if we added words to the sentence it was at the start of the sentence, but none of the original words should be changed or missing or reordered relative to the document.) I have tested that I have the sequences of strings which are the list of sentences before I use them to call: declare function local:subtractSentences($before as xs:string*,$after as xs:string*) as xs:string* { let $thisBefore as xs:string? := head($before) let $thisAfter as xs:string? := head($after) return if (not(exists($thisBefore)) or not(exists($thisAfter))) then $after (: we're done because we're out of strings, but if we have any after left we want it :) else if (ends-with($thisAfter,$thisBefore)) then (replace($thisAfter,$thisBefore,''),local:subtractSentences(tail($before),tail($after))) else ($thisAfter,local:subtractSentences($before,tail($after))) }; In ~150 ms, I get Error: Stack Overflow: Try tail recursion? so I have written the function wrong. What's the more useful pattern for this case? Thanks! Graydon

4 3

thesaurus URILiteral vs node
by Liam R. E. Quin 01 Jun '21

01 Jun '21

What would be involved in extending BaseX's full text to allow a thesaurus to be supplied as a node instead of a URI? I want to construct one on the fly, and using file:write() seems excessive. Liam -- Liam Quin, https://www.delightfulcomputing.com/ Available for XML/Document/Information Architecture/XSLT/ XSL/XQuery/Web/Text Processing/A11Y training, work & consulting. Barefoot Web-slave, antique illustrations: http://www.fromoldbooks.org

2 6

insert MS SQL server bigint from BaseX via sql:execute-prepared
by Martin Honnen 31 May '21

31 May '21

I am trying to use BaseX to enter data from its XML db into an MS SQL server database, according to https://docs.microsoft.com/en-us/sql/connect/jdbc/using-basic-data-types?vi… the MS SQL server column type bigint is mapped to long in Java. However, when I try <sql:parameter type="long">{$id}</sql:parameter> with BaseX and sql:execute-prepared, I get an error saying [sql:error] An SQL exception occurred: unsupported type: long The BaseX documentation https://docs.basex.org/wiki/SQL_Module#sql:execute-prepared indeed only lists attribute type { "int" | "string" | "boolean" | "date" | "double" | "float" | "short" | "time" | "timestamp" | "sqlxml" } as the possible types. Am I out of luck trying to use BaseX that way for that datatype? Using <sql:parameter type="int">{$id}</sql:parameter> the sql doesn't succeed.

2 2

BaseX with Apache
by Tim Thompson 27 May '21

27 May '21

With apologies for the not-strictly-BaseX question--but I'm running BaseX through a reverse proxy with Apache (and Let's Encrypt), and I can't figure out how to disable directory listing for the BaseX webapp/static directory. I've tried editing the apache2 conf files in the standard ways. Hoping someone here has a quick solution to share. Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian Yale University Library

3 3

BaseX 9.5.3
by Christian Grün 27 May '21

27 May '21

Dear all, A new BaseX patch release is available. It comes with minor bug fixes and little enhancements: • RESTXQ responses now come with a Server-Timing HTTP header (motivated by Reece) • A context file can be specified via the Bindings Dialog of the XQuery editor (motivated by Hans-Jürgen) • The current HTTP context will now be propagated if jobs:eval is called • The DBA CodeMirror and Jetty libraries have been updated Find the new version on our web site: https://basex.org/ Have fun, Christian

1 0

Running XQuery Update via apply Ant task
by Zimmel, Daniel 26 May '21

26 May '21

Hi, is there anyone using BaseX in an Apache Ant scenario? I have the following target for XQuery Updating some files (no database access), but I am too dumb to make an apply task that reads every file in a fileset. Usually you place the <srcfile/> where you need it to be in your external command, but unfortunately the BaseX command-line syntax won't allow this to be easily placed: the filename is supposed to follow directly suffixed to "-i" where I cannot use an element, of course. <target name="xquery_update_default"> <echo level="info" message="XQuery Update (Default): ${param.xquery-update-uri}"></echo> <apply executable="java" > <arg value="-cp"/> <arg value="BaseX95.jar"/> <arg value="org.basex.BaseX"/> <arg line="-u"/> <arg line="-w"/> <arg line="-c'set exporter omit-xml-declaration=no,indent=no'"/> <arg line="-b'path=${param.folder}'"/> <arg line="-i${dummy.xml}"/> <srcfile/> <fileset dir="../${dir.xquery}" includes="${param.xquery-update-uri}"/> </apply> </target> As a workaround, I set a dummy.xml for input and bind the current folder as a parameter and in my Query I can use file:list() which then is updating all files in the directory, but this makes the Query dependent on the parameter, and updates are obviously not written back unless all files have been processed in memory. I would prefer to have a standalone query operating only on the current document-uri (so I can better reuse it elsewhere). Can someone give me a hint if it is possible in plain Ant to apply a CCL-BaseX to any file in a given fileset? Other than that, BaseX performs well as a file processor (if you ignore the time related to file handling). Thanks, Daniel

1 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk