BaseX-Talk

basex-talk@mailman.uni-konstanz.de

13 participants
5244 discussions

distinct-values and type coercion
by Marco Lettere 19 May '20

19 May '20

Dear all, after installing Basex 9.3.3 one application of ours started failing in a particular functionality. We tracked it down to the following example code: let $in := <json type="object"> <source type="object"> <reference>Object/20383920-5bb1-4397-8b51-b752863acddf</reference> </source> </json> let $s as xs:string* := distinct-values($in/source/reference/string()) return $s This code now returns the following error: [XPTY0004] Cannot treat xs:untypedAtomic* as xs:string*: distinct-values($in_0/element(source)/element(reference)). Whereas before it was automatically casting to xs:string now it seems that the type coercion in the let clause is too restrictive. This happens only with the distinct-values applied by the way. Is it correct now or was it before? For the moment we solved by removing the type enforcement in the let clause. Thank you for the clarification. Regards, Marco.

2 1

Full-text index: searches for common words in another node. Does it take a lot of time?
by Sebastian Guerrero 19 May '20

19 May '20

Hi everybody. I'm here again with my doubts. Thank you for your patience. ^^ I have a database of trademarks with a full-text index for two nodes: **:mark-identification,*:party-name*. [1] Where "*mark-identification*" contains the name of the trademark, and " *party-name*" contains the name of the owner of the trademark. I use the full-text index in order to search trademarks by its name, for example: *for $results in //case-file[case-file-header/mark-identification/text() contains text {'basex'}]* *return $results//mark-identification* returns all trademarks with "*basex*" on its name. It works like a thunderlight: 15ms to get 3 records among 2,134,434,598 nodes. Really a dream. [2] But, for example, if I change the searched text from "*basex*" by a common word in "*party-name*", for example, "*corporation*" ( has 1096187x occurrences on the full-text index as showed in [1], it's a very common word in owners of trademarks ): *for $results in //case-file[case-file-header/mark-identification/text() contains text {'corporation'}]* *return $results//mark-identification* It takes a long time to get 6,715 records: 62,000ms [3] If I search for "*live*" ( a common word for trademarks name, but not for owners names ) I get 5,875 records in 2,773 ms, which has not a relationship with the 62,000ms to get the 6k records for "*corporation*". [4] So... - Is this an expected behaviour? - Is there a way to specify which "section" of the full-text index should be used to perform the search? ( I don't know... maybe something similar to "*using stemming*" but "*using index 'mark-identification'*" ) Please apologize me if I'm asking by something not-logical, Best regards, Sebastian [1] https://imgur.com/uLla1Xt [2] https://imgur.com/Fkcvv2O [3] https://imgur.com/Hk71CNe [4] https://imgur.com/P72k574

2 3

Same query returns different amount of records
by Sebastian Guerrero 18 May '20

18 May '20

Hi everyone! it's me again. Here is my doubt: If I execute this query: * (# db:enforceindex #) { for $db in ('US00','US01','US02') for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file where $tmUS/case-file-header/mark-identification/text() contains text { 'apple' } return $tmUS/case-file-header/mark-identification/text() }* I get 4k results in 139ms from three databases of 90GB and 13M of records. It works like a charm. [01] But, if I include that query into a *for* and then into a *switch* ( I tried with *if-then-else* too ), the same query returns only 11 results in 107ms [02]: *declare namespace gb="http://www.ipo.gov.uk/schemas/tm <http://www.ipo.gov.uk/schemas/tm>";* *let $text := "apple"* *let $registries := ('US')* *for $registry in $registries* *return * * switch ($registry)* * case "US"* * return * * (# db:enforceindex #) { * * for $db in ('US00','US01','US02')* * for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file* * where $tmUS/case-file-header/mark-identification/text() contains text { $text }* * return $tmUS/case-file-header/mark-identification/text()* * }* * case "GB"* * return* * (# db:enforceindex #) {* * for $tmGB in db:open('GB')/gb:MarkLicenceeExportList/gb:TradeMark* * where $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text() contains text { $text }* * return $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text()* * }* * default return "Unknown registry code"* I noticed that removing the case option "GB" ( even if it's not evaluated ), it works fine and returns the 4k records [03]: *declare namespace gb="http://www.ipo.gov.uk/schemas/tm <http://www.ipo.gov.uk/schemas/tm>";* *let $text := "apple"* *let $registries := ('US')* *for $registry in $registries* *return * * switch ($registry)* * case "US"* * return * * (# db:enforceindex #) { * * for $db in ('US00','US01','US02')* * for $tmUS in db:open($db)/trademark-applications-daily/application-information/file-segments/action-keys/case-file* * where $tmUS/case-file-header/mark-identification/text() contains text { $text }* * return $tmUS/case-file-header/mark-identification/text()* * }* * default return "Unknown registry code"* What I'm missing here? is this the right behaviour? Best regards, Sebastian [01] https://imgur.com/o4RUUyO [02] https://imgur.com/533c0rI [03] https://imgur.com/mCb3qEe

2 2

BaseX 9.3.2: Performance Tweaks, Bug Fixes
by Christian Grün 15 May '20

15 May '20

Dear all, We are glad to provide you with a new BaseX 9.3.2 maintenance release: http://basex.org In preparation to version 9.4, we have introduced numerous small query optimizations that speed up path, predicate and simple map operations and will rewrite your queries for index access more often than before. Feel free to check out the full list of added rewritings and enhancements on Github: https://github.com/BaseXdb/basex/issues?q=is%3Aissue+is%3Aclosed Have fun with the new release, Christian BaseX Team

3 5

Storing XML messages
by Ramzi Hammouda 14 May '20

14 May '20

Hello BaseX team, Using Resful API, I'm trying to make POST method update BaseX database, I want to insert an xml node to an existing document calastone.xml in calastone database , but the node contains '<', you replied to a previous email that I should use fn:parse-xml to make this happen without error. I tried using the function fn:parse-xml, I had success with using it in BaseX GUI like this: let $message := fn:parse-xml('<Id>CTN55</Id>') return insert nodes $message as last into doc("calastone/calastone.xml") But when I tried to do the same with POST method from my application with using this xquery: string xquery = "<query><text>let $message:= fn:parse-xml('<Id>CTN58</Id>')" + "return insert nodes $message as last into doc(\"calastone/calastone.xml\")</text>" + "<variable name = 'message' value = fn:parse-xml('<Id>CTN58</Id>'))/></query>"; I get the error: "" (Line 1): Element type "variable" must be followed by either attribute specifications, ">" or "/>" Can you help on how to do this insertion? Thanks. P Respectons ensemble l'environnement. N'imprimez ce message que si n?cessaire. Let's respect the environment together. Only print this message if necessary.

2 1

Directory and files are neither a file or a directory on Basex 9.3.2 when read from Docker volume
by France Baril 14 May '20

14 May '20

Hi, Here is my issue. I create a new container with Basex 9.3.2 I add a volume ContentDBs under my basex directory ContentDBs has 2 directories and 1 files I run this code from an xqm: let $src-dir-items := file:list('ContentDBs') let $debug := file:append('debug-a.xml', 'count: ' || count($src-dir-items) || '
') let $dirs := for $i in $src-dir-items (: Bug items are neither a dir or a file !? Because volume from docker? :) let $debug := file:append('debug-a.xml', 'item: ' || $i || ' is dir: ' || file:is-dir($i) || '
') let $debug := file:append('debug-a.xml', 'item: ' || $i || ' is file: ' || file:is-file($i) || '
') return $i In the debug file, I get. - The count for items is 3 - For all items, is-dir and is-file are false. I get a similar error if I try to db:create from one of the folders, it seems to recognize that I have a folder, but it chokes on subfolders with: Resource 'js/' does not exist. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

I am confused how to specify multiple possible reponses in RestXQ with %rest:produces
by Omar Siam 12 May '20

12 May '20

Hi, Today someone on the exist-open mailing list pointed out how they interpret %rest:produces: If your function produces more types of responses you specify all mime types just the same as with %rest:consumes: %rest:poroduces("application/xml", "application/json", ...) That is as a list of possible reponses all in one annotation. The BaseX docs at https://docs.basex.org/wiki/RESTXQ#Content_Negotiation however are ambigous about this I think. There is an example there with just two %rest:produces annotations on two lines with only one mime type (and a qs value). I think that lead me to belief that to specify multiple possible responses of different mime types you repeat %rest:produces. Rereading the section these two example annotations could also ilustrate the use of %rest:produces in two different functions. Can you please clarify this if possible? Best regards Omar Siam

3 3

GUI "create db" file patterns are not sticky
by Graydon Saunders 12 May '20

12 May '20

This is a very small feature request. Everything else about the Create Database GUI is sticky -- when changed it stays changed -- EXCEPT the file patterns. Would it be possible to make the file patterns sticky as well? I often need to create a new database repeatedly since I'm using XQuery to test output from XSLT processes during development. Remembering to add all the file patterns is not excessively burdensome but I would like to not have to do it. Thanks! Graydon

3 4

Query optimizer bug with nested for? - java.lang.NullPointerException at Path.index(Path.java:673)
by Sebastian Guerrero 11 May '20

11 May '20

Hi everybody! Maybe it's a newbie issue, but I would like your comments. I'm writing a RESTXQ method to search among a couple of databases. ( >100 databases ) Some databases are split into a couple of parts due to the number of nodes. For example US: it's separated into US00, US01 and US02. So, my problem is: if I replace "*for $usPart in ('US00')*" by "*for $usPart in ('US00','US01',''US02)*" in *QUERY [A]*, I get this error: *Improper use? Potential bug? Your feedback is welcome:* *Contact: basex-talk(a)mailman.uni-konstanz.de <basex-talk(a)mailman.uni-konstanz.de>* *Version: BaseX 9.3.2* *Java: Oracle Corporation, 1.8.0_251* *OS: Windows 10, amd64* *Stack Trace: * *java.lang.NullPointerException* * at org.basex.query.expr.path.Path.index(Path.java:673)* * at org.basex.query.expr.path.Path.optimize(Path.java:157)* * at org.basex.query.expr.gflwor.For.toPredicate(For.java:220)* * at org.basex.query.expr.gflwor.GFLWOR.optimizeWhere(GFLWOR.java:532)* * at org.basex.query.expr.gflwor.GFLWOR.optimize(GFLWOR.java:109)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:100)* * at org.basex.query.expr.Extension.compile(Extension.java:45)* * at org.basex.query.expr.SwitchGroup.compile(SwitchGroup.java:40)* * at org.basex.query.expr.Switch.compile(Switch.java:60)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:96)* * at org.basex.query.expr.gflwor.ForLet.compile(ForLet.java:43)* * at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:90)* * at org.basex.query.scope.MainModule.comp(MainModule.java:81)* * at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114)* * at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105)* * at org.basex.query.QueryContext.compile(QueryContext.java:312)* * at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79)* Using "*for $usPart in ('US00')*" it works without any problem. With one element there is no problem, with two or more it fails. Any ideas about what I'm doing wrong? Here is the *QUERY [A]* ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- declare namespace gb="http://www.ipo.gov.uk/schemas/tm"; let $text:="christian" let $registries:=('GB','US') let $results := for $registry in $registries return switch ($registry) case "US" return (# db:enforceindex #) { for $usPart in ('US00') for $tmUS in db:open($usPart)/trademark-applications-daily/application-information/file-segments/action-keys/case-file where $tmUS/case-file-header/mark-identification/text() contains text {$text} using stemming return <trademark><ipo>US</ipo><text>{$tmUS/case-file-header/mark-identification/text()}</text></trademark> } case "GB" return (# db:enforceindex #) { for $tmGB in db:open('GB')/gb:MarkLicenceeExportList/gb:TradeMark where $tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text() contains text {$text} return <trademark><ipo>GB</ipo><text>{$tmGB/gb:WordMarkSpecification/gb:MarkVerbalElementText/text()}</text></trademark> } default return "" return <result> <total>{count($results)}</total> <trademarks> { for $result in $results return $result } </trademarks> </result> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Regards, Sebastian

2 7

repeatedly full-text marking the same text node
by Graydon Saunders 11 May '20

11 May '20

Hello -- Is there some way to iterate full-text matches to mark up in the node every found member of a sequence of phrases? I have a use case where I have a long list of phrases which may appear in the content set; if they do appear in the content set, these should be marked. The order of the list is significant; the longest phrases should be marked first. The idea would be to iterate through the list, marking up the node with any matches. However, so far as I can tell, full text only works directly on a database node. If I try to pass the node in a function, I get "No database node" errors from attempting full-text operations. (Making a copy of the DB with a full text index, applying the changes, updating the indexes, and continuing seems possible but also inherently inefficient.) Is there a straightforward way to do this that I'm missing? Thanks! Graydon

5 8

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk