- BaseX-Talk - mailman.uni-konstanz.de

Unescaping revritten element name
by Mauro Mugnaini 11 Apr '20

11 Apr '20

Hi all, After parsing strings in XML with direct representation (e.g. with CSV and JSON module parsing) the specific entries are represented via elements and their names are rewritten. In particular (as per documentation): "underscores are rewritten to two underscores (__), and characters that are not valid in element names are rewritten to an underscore and the character’s four-digit Unicode.” It is possible to convert back the element’s node name with an XQuery function present in some module? Regards, Mauro

2 2

Write output using proc:execute
by Tim Thompson 09 Apr '20

09 Apr '20

Hello, Is it possible to redirect output from a system command within the proc:execute function? I would like to do something like: proc:execute("echo", ("hello!", "> hello.txt")) but the ">" does not seem to be recognized. Thanks in advance, Tim -- Tim A. Thompson Discovery Metadata Librarian Yale University Library

2 2

Issue - Data Access out of bounds
by Arjan Loeffen 08 Apr '20

08 Apr '20

Dear BaseX people, Got this message and lost my database contents. Any clue on what may have happened? Using BaseX 8.5.3. I know, you'll suggest upgrading, but still, ... 08:46:43.905 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-jobs-regression 08:46:43.990 127.0.0.1:51534 admin 400 Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.5.3 Java: Oracle Corporation, 1.8.0_202 OS: Windows 10, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - table size: 3033 - first/next pre value: -1/-1 - #total/used pages: 0/0 - accessed page: -1 (0 > -1] at org.basex.util.Util.notExpected(Util.java:62) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:455) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:293) at org.basex.query.value.node.DBNode.<init>(DBNode.java:52) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:209) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:82) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:139) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:48) at org.basex.core.Command.run(Co... 86.87 ms 08:46:43.997 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-models 08:46:44.010 127.0.0.1:51534 admin 404 Database 'imvertor-models' is being updated, or update was not completed. 12.85 ms 08:46:44.013 127.0.0.1:51534 admin REQUEST [POST] http://localhost:8984/rest/imvertor-models-regression 08:46:44.085 127.0.0.1:51534 admin 400 Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.5.3 Java: Oracle Corporation, 1.8.0_202 OS: Windows 10, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - table size: 27452 - first/next pre value: -1/-1 - #total/used pages: 0/0 - accessed page: -1 (0 > -1] at org.basex.util.Util.notExpected(Util.java:62) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:455) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:293) at org.basex.query.value.node.DBNode.<init>(DBNode.java:52) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:209) at org.basex.build.Builder.parse(Builder.java:73) at org.basex.build.DiskBuilder.build(DiskBuilder.java:82) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:139) at org.basex.core.cmd.OptimizeAll.run(OptimizeAll.java:48) at org.basex.core.Command.run(C... 72.26 ms arjan -- *Arjan Loeffen* Armatiek BV & Armatiek Solutions BV 06-12918997

2 2

One of the map element causes SEPM0017 error
by Arkadiusz Bok 06 Apr '20

06 Apr '20

Hi, I'm trying to run one of unchanged code example from book "XQuery: Search Across a Variety of XML Data 2nd Edition" from publisher O'Reilly Media. |(: XQuery by Priscilla Walmsley (c) 2016 Priscilla Walmsley:) | |(:Example 13-4 Serialization parameters in a map :) xquery version "3.1"; declare namespace prod = "http://datypic.com/prod"; let $map := map { "method": "xml", "version": "1.0", "indent": true(), "cdata-section-elements": (xs:QName("prod:desc"),xs:QName("prod:name")), "use-character-maps": map { "«":"<%", "»":">%" } } let $element := <prod:name>Fleece Pullover</prod:name> return serialize($element,$map) | I'm using BaseX 9.3.2 to do this. But when I'm trying to run code, I get error: |Stopped at C:/Users/Arek/AppData/Local/Temp/example1304.xqy, 16/17: [SEPM0017] item() expected, xs:QName+ found: (Q{http://datypic.com/prod}desc, Q{http://datypic.com/prod}name) | When i remove 9 line with /cdata-section-elements/ element, code runs. Whether is it problem with XQuery implementation or with code? ||||

2 2

Problem with attribute parsing?
by Peter Villadsen 06 Apr '20

06 Apr '20

Hello I was doing some experiments and I ended up with this: let $c := <Class Source='{ttt'></Class> return $c/@Source When this is compiled in the BaseX GUI app, an error message ensues: Error: Stopped at ... /file3, 1/30: [XPST0003] Expecting '}', found '''. Query: let $c := <Class Source='{ttt'></Class> return $c/@Source Query plan: <QueryPlan compiled="false" updating="false"/> Surely that is not correct? If I add a } there, everything is fine: let $c := <Class Source='{ttt}'></Class> return $c/@Source I don't think there is an XML requirement forcing escaping start brace ('{') inside an attribute value? I know that XQuery supports <X A='{...}' /> where the inside of the {} is evaluated to give the value for the A attribute, but the example above is not XQuery, just an XML literal. I am sure I would have noticed this if it were a general problem. Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

2 1

EXPath package dependencies
by Clark, Ash 01 Apr '20

01 Apr '20

Hello, I’m trying to define the dependencies for a general-purpose EXPath package, one which I plan to use in both eXist-db and BaseX. So far I’ve got this in expath-repo.xml*: <dependency processor="basex"/> <dependency processor="http://exist-db.org" semver-min="4.0.0"/> Based on the spec, I gather that `//dependency/@processor` is supposed to be non-exclusive. However, when I try to install the package into BaseX, I get the error “Package version is not supported.” Is this a bug? Is there something else I should do? Warmly, Ash * https://github.com/NEU-DSG/wwp-public-code-share/blob/counting_robot/counti… Ashley M. Clark (she/her) XML Applications Developer Digital Scholarship Group Northeastern University Libraries as.clark(a)northeastern.edu (617) 373-5983

1 0

Re: [basex-talk] How to apply array:for-each on an array of arrays?
by Martin Honnen 31 Mar '20

31 Mar '20

On 31.03.2020 18:32, Ben Engbers wrote: > Hi, > > For (my personal) clarity, I have split up the original function in two > parts: > > declare function local:step_one($nodes as node()*) as array(*)* > { > let $text := for $node in $nodes > return $node/text() => > tokenize() => distinct-values() > let $idf := $text => > tidyTM:wordCount_arr() > return $idf > }; > > In local:step_one(), I first create a sequence with the distinct tokens > for each $node. All the sequences are joined in $text. > I then call wordCount_arr to count the occurences of each word in $text: > > declare function tidyTM:wordCount_arr( > $Words as xs:string*) > as array(*) { > for $w in $Words > let $f := $w > group by $f > order by count($w) descending > return ([$f, count($w)]) > } ; > > I would say that tidyTM:wordCount_arr returns a sequence of arrays but I > am not certain if I have specified the correct return-type? Reading the code I agree that the return type seems to be a sequence of arrays but therefore I wonder why you don't get a similar error as later on with declaring array(*) and not array(*)* > Calling local:step_one(tidyTM:remove_Stopwords($nodes, "Stp", $Stoppers)) > returns: > ["probleem", 703] > ["opgelost.", 248] > .... > > I had hoped that calling the following local:wordFreq, would add the > idf to each element but instead I get an error > > declare function local:wordFreq_idf($nodes as node()*) as array(*) > { > let $count := count($nodes) > let $idf := local:step_one($nodes) > let $result := for-each( $idf, > function($z) {array:append ($z, math:log($count div $z(2) ) ) } ) > return $result > }; > [XPTY0004] Cannot promote (array(xs:anyAtomicType))+ to array(*): $idf > := ([ "probleem", 703 ], [ "opgelost.", 248 ], ...). The message tries to tell you that the declared return type array(*) is a single array while the function returns a (non-empty) sequence of arrays so using declare function local:wordFreq_idf($nodes as node()*) as array(*)* would remove that error. To insert the third value into each array I think you want let $result := $idf ! array:append(., math:log($count div .(2) ))

2 1

How to apply array:for-each on an array of arrays?
by Ben Engbers 31 Mar '20

31 Mar '20

Hi, In textmining, the 'idf' or inverse document frequency is defined as idf(term)=ln(ndocuments / ndocuments containing term). I am working on a function that should return this idf. This function: declare function local:wordFreq_idf($nodes as node()*) as array(*) { let $count := count($nodes) let $text := for $node in $nodes return $node/text() => tokenize() => distinct-values() let $idf := $text => tidyTM:wordCount_arr() return $idf }; returns: ["probleem", 703] ["opgelost.", 248] ["dictu", 235] ["opgelost", 217] ["medewerker", 193] ... For "probleem", the idf should be calculated as ln($count/703). Since there are 1780 nodes this would result in 0.929011751. I tried to exten the 'let $idf' line with: => array:for-each(function($idf) {array:append($idf, math:log($count div $idf[2]) )}) which should result in ["probleem", 703, 0.929011751] but no mather what I do, every time I get this error: [XPTY0004] Cannot promote (array(xs:anyAtomicType))+ to array(*): ([ "probleem", 703 ], [ "opgelost.", 248 ], ...). Is it possible to apply array:for-each on an array of arrays? Ben

4 7

collection('/test-db-1/bib')//Q{}libro versus collection('/test-db-1/bib')//libro
by Martin Honnen 30 Mar '20

30 Mar '20

Using BaseX 9.3.2, why does a query collection('/test-db-1/bib')//Q{}libro return 6 items while collection('/test-db-1/bib')//libro gives 0 items? If I run collection('/test-db-1/bib')//Q{}libro, collection('/test-db-1/bib')//libro the info window shows Compiling: - rewrite fn:collection([uri]) to document-node() item: collection("/test-db-1/bib") -> db:open-pre("test-db-1", 12000002) - merge steps: descendant::element(libro) - rewrite fn:collection([uri]) to document-node() item: collection("/test-db-1/bib") -> db:open-pre("test-db-1", 12000002) - remove step without results: element(libro) - rewrite iter step to empty sequence: element(libro) -> () - rewrite cached path to empty sequence: db:open-pre("test-db-1", 12000002)/descendant-or-self::node()/() -> () - rewrite expression list to iter path: (db:open-pre("test-db-1", 12000002)/descendant::element(libro), ()) -> db:open-pre("test-db-1", 12000002)/descendant::element(libro) Optimized Query: db:open-pre("test-db-1", 12000002)/descendant::element(libro) Query: collection('/test-db-1/bib')//Q{}libro, collection('/test-db-1/bib')//libro Result: - Hit(s): 6 Items - Updated: 0 Items - Printed: 1455 b - Read Locking: test-db-1 - Write Locking: (none)

2 2

Re: [basex-talk] serialize with SerialMethod.XML
by jfrm.maurel＠gmail.com 30 Mar '20

30 Mar '20

Hi Christian, Le 30/03/2020 à 15:51, Christian Grün a écrit : > You should always close instances of classes that inherit the > Closeable interface. Thank you for the tip. I will change my code. Regards. -- Jean-François MAUREL PIMECA http://www.pimeca.com

1 0