- BaseX-Talk - mailman.uni-konstanz.de

Automatically generating test cases. Hidden feature?
by Marc van Grootel 13 Jan '16

13 Jan '16

Hi, Been a long time since posting. Work is very busy recently. Luckily for me a lot of it involves XQuery ;-) I am elaborating some examples [1] that show off the use of my Origami [2] library. The most promising ones I will turn in to blog posts or a wiki at some point. Recently I've been reading a bit about generative testing (or property-based testing) and libraries like Haskell's QuickCheck. I hope to be able to show that we can use such techniques in combination with RelaxNG and the concepts that Eric van der Vlist describes in Examplotron [3] to mutate XML instances guided by a schema that I can then turn into automatically generated tests. It's still early days and time is limited but I did stumble onto something interesting that I wanted to share here. If you already use similar techniques I would be very interested to hear about it. I was contemplating if it was possible to create anonymous unit test functions that I can invoke with generated test input. So, a bit to my amazement, the following works: let $equals := %unit:test function($a,$b) { unit:assert-equals($a,$b, 'Not equal') } return $equals(4,3) This function raises the unit:UNIT0001 exception with the message "Item 1: 3 expected, 4 returned". Cool! So if this is possible can we also catch a failure and turn it into data? let $equals := %unit:test function($a,$b) { unit:assert-equals($a,$b, 'Not equal') } return try { $equals(4,3) } catch * { <error> <code>{ $err:code }</code> <description>{ $err:description }</description> <value>{ $err:value }</value> <module>{ $err:module }</module> <line-number>{ $err:line-number }</line-number> <column-number>{ $err:column-number }</column-number> </error> } This too works and produces an XML fragment recording the failure. Very cool! <error> <code>unit:UNIT0001</code> <description>Item 1: 3 expected, 4 returned.</description> <value>Not equal</value> <module>.../origami-examples/check/demo.xq</module> <line-number>23</line-number> <column-number>24</column-number> </error> I am not sure if this a hidden or an intentional feature of the BaseX unit module. I sure hope that it doesn't go away in future releases as I intend to leverage this in an alternative testing module. BaseX, the gift that keeps on giving, thanks to all that make it possible. --Marc [1] https://github.com/xokomola/origami-examples [2] https://github.com/xokomola/origami [3] http://examplotron.org/

3 3

minor issue in the project-view of BaseX-GUI with error marking
by Rob Stapper 13 Jan '16

13 Jan '16

Hi, I found that when a directory contains both a program- and a module-file with the same name but with different extensions ( .xq and .xqm) both file are marked as erroneous in the project-view if only one file, on my case the module-file, is indeed erroneous and the other file is ok. Regards, Rob Stapper PS. It is my unittest-directory that contains both program- and module-files.

2 4

XML embedded in JSON
by E. Wray Johnson 13 Jan '16

13 Jan '16

We have JSON that has string/text values which are XML. Is there a way o have the XML as sub-elements value and not be encoded/escaped string? Wray Johnson

2 1

XQUF 3.0, MIXUPDATES
by Hans-Juergen Rennau 13 Jan '16

13 Jan '16

Dear BaseX team, version 3.0 of the XQuery Update Facility (XQUF) allows expressions to perform an updating operation *and* return a value (e.g. [1]). Presently, BaseX supports probably only version 1.0 of the XQUF, so the mixing of update and value creates an error - and option MIXUPDATES equal "true" does not change this.: Query:=============================== declare option db:mixupdates 'true'; 100, insert node <elem/> into * ================================>Stopped at C:/projects/act/updateQuery.xq, 5/1: [XUST0001] List expression: all expressions must be updating or return an empty sequence. In my opinion, the possibility to mix updating and value construction is very important, as otherwise it is impossible to develop versatile tools which may, dependent on call parameters, either return a result or perform an update. So my Q U E S T I O N is - are there already plans to support XQUF 3.0 - or as a first step the mixing of update and value - soon? Would be phantastic! Cheers,Hans-Jürgen [1] http://www.w3.org/TR/xquery-update-30/#id-comma-expr"The operand expressions of the comma expression are evaluated,and the XDMinstances and pending update lists returned areconcatenated in operand order. Pending update lists are concatenatedby the upd:mergeUpdates operation."

2 2

XML Commands
by E. Wray Johnson 12 Jan '16

12 Jan '16

How do you execute XML commands from the BaseX GUI? Why can't multiple XML commands be executed from the BaseXClient.java? How can database options (e.g. autooptimize) be changed from the GUI without opening the database and locking it?

2 1

Adding basex-talk to markmail
by Joe Wicentowski 12 Jan '16

12 Jan '16

Hi all, I wasn't able to find basex-talk in markmail.org - a fantastic site for searching mailing list archives. Would the list owners/administrators consider submitting this list to markmail? Information about this can be found at http://markmail.org/docs/feedback.xqy. Best, Joe

2 1

Fulltext Stemming
by kleist 12 Jan '16

12 Jan '16

Hi all, with query options: contains text "grün" all using diacritics sensitive using stemming using language 'German' I'll get: "grüne", "grüner", "Grüns" etc. But I also get "Gruß", "Grüße", "grüßen" or something like "Gruner" (Eigenname) Does the stemming have problems with german umlaute and "ß"? with query options: contains text "grün" all using stemming using language 'German' same results, but less. Why is that? The indexes of the database are the following: Indexes Up-to-date: true TEXTINDEX: true ATTRINDEX: true FTINDEX: true TEXTINCLUDE: ATTRINCLUDE: FTINCLUDE: LANGUAGE: German STEMMING: true CASESENS: true DIACRITICS: true STOPWORDS: UPDINDEX: false AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 INDEXSPLITSIZE: 0 FTINDEXSPLITSIZE: 0 Optimized Query is the following: Optimized Query: let $hits_137 := ft:mark((db:open-pre("kleist-searchindex",147544), ...)/(((descendant::tei:s union descendant::tei:l)))[descendant::text() contains text "grün" all using diacritics sensitive using stemming using language 'German']) return element div { (element p { ("grün") }, element p { (count($hits_137)) }, element ul { (for $hit_139 in $hits_137 return element li { ($hit_139/descendant-or-self::node()/ancestor::tei:TEI/descendant-or-self::node()/tei:classCode[position() = 1]/string(), $hit_139) }) }) } Best, Günter

2 1

group-by behaviour for clustering XML fragments
by Hondros, Constantine (ELS-AMS) 11 Jan '16

11 Jan '16

Hello all, I'm using BaseX to cluster a set of millions of small XML fragments which look something like this: <affiliation> <organization>Institut für Organische Chemie der Universität Heidelberg</organization> <country iso-code="DEU"/> </affiliation> I need to cluster based on fragment similarity - so taking into account elements, attributes and text nodes. If I use the entire XML fragment as a grouping key, something like this: for $a at $c in db:open('DB')/item/*/affiliation group by $val := $a ... then will the grouping be equivalent to the functionality of the deep-equal function? First results seem to suggest this, but I want to make sure that grouping is not done on text node value alone or anything like that. Incidentally, BaseX is simply unbelievably fast at executing this - a million fragments clustered and written out to another DB in 16 seconds on a laptop. My congratulations on an amazing product. Regards, Constantine ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

3 3

Strange behaviour on db:add inside restxq
by Marco Lettere 11 Jan '16

11 Jan '16

Hi all, We've run into a strange issue that we never experienced beforehand even if it's something we should have done thousands of time. Consider storing a resource sent through a RestXQ POST directly to a database. The restxq module module namespace o = "test"; (:sendMessage: Send a new message:) declare %rest:path('test/savemsg') %rest:POST('{$body}') %rest:consumes("application/xml") function o:save-message($body as document-node()) { db:add('hereiam', $body, 'saved.xml') }; The client request: http:send-request( <http:request method="POST" href="http://localhost:8984/test/savemsg"> <http:body media-type="application/xml"> <a> <b/> </a> </http:body> </http:request> ) The resource gets stored into the DB with all the extra text nodes containing white spaces (codepoints 10 and 32) something like: <a> <b/> </a> That's pretty strange because if I PUT the resource through Basex REST interface it doesn't create the spaces and the same if I directly db:add the resource. We noticed this oddity on BaseX 8.3.1 and could verify it on a Basex 8.2 and 8.1.1 as well. It works neatly on an older 7.9 version we still have around The applies same if the resource is sent through curl or Chrome Postman. What are we doing wrong? Thanks. Marco.

2 6

Lookups and arrows
by Tim Thompson 10 Jan '16

10 Jan '16

Hello, I'm testing some XQuery 3.1 features against a JSON-LD[1] document and had a few questions. In the JSON-LD format, the "@" symbol has special semantics in key names, but seems to cause problems with the 3.1 lookup operator. For example: json-doc("http://lae.princeton.edu/catalog/0bp35.jsonld")("@context") works as expected, but json-doc("http://lae.princeton.edu/catalog/0bp35.jsonld")?@context throws an error: [XPST0003] No specifier after lookup operator: '@'. Also, when using the "=>" operator, should it be possible to perform a lookup on the last expression in a chain, if that expression returns a map? For example: json-doc("http://lae.princeton.edu/catalog/0bp35.jsonld")("@context") evaluates to "http://iiif.io/api/presentation/2/context.json" and json-doc("http://lae.princeton.edu/catalog/0bp35.jsonld")("@context") => json-doc() returns another map object. So, how would one achieve this: json-doc(json-doc("http://lae.princeton.edu/catalog/0bp35.jsonld ")("@context"))("@context") using the arrow operator? Thanks, Tim [1] http://www.w3.org/TR/json-ld/ -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

3 5