August 2020 - BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Starten Unit Test Module in XQuery
by Markus Schmid 20 Aug '20

20 Aug '20

Hi Christian thank you for the response. The solution is good (far better than code generating .bat files ..). I slightly modified the solution in order to run the same testsuites with different testdata in one script: declare function test:runtests() { for-each( map:keys($test:dbset), function($k) { test:runtest($test:dbset($k)) } ) }; declare function test:runtest($databases) { let $testdata := $databases/@data let $name := $databases/@name let $dummy := trace(concat('runtest for testdata : ‘,$name)) let $args := ('-cp','C:\Arbeit\Tools\BaseX932\basex\BaseX.jar','org.basex.BaseX','-b',concat('{mytests}data=',$testdata),'-o',concat('C:\Arbeit\Tasks\UnitTests\TestResult',$name,'.xml'),'-t','C:\Arbeit\Tasks\UnitTests\TestModules\') return ( try {proc:system('java',$args)} catch * { } ) }; let $result := test:runtests() return() Using the try / catch block is important here else the script stops when the first test failure occurs. Markus > Am 20.08.2020 um 09:10 schrieb Christian Grün <christian.gruen(a)gmail.com>: > > Hi Markus, > >> Ist es möglich, ein Unit Test Module (https://docs.basex.org/wiki/Unit_Module#Query) über ein XQuery Script zu starten und die Testausgabe in ein File umzuleiten? > > As you’ve already noted, unit tests must always be started outside an > XQuery expression. The reason is that sequentially executed unit tests > may have come with all kinds of side effects which go beyond the scope > of a single query. > > The following solution doesn’t necessarily distinguish itself through > elegance, but you could launch a second BaseX instance with the > Process Module [1] and convert the string output to an XML document > via fn:parse-xml: > > let $args := ('-cp', '/path/to/basex.jar', 'org.basex.BaseX', '-t', > '/path/to/tests') > let $result := proc:system('java', $args) > return parse-xml($result) > > This way, your tests will be run in an independent BaseX context. If > you invoke the function from the directory in which your BaseX > instance and the tests reside, you can omit the absolute paths > (/path/to/). > > Hoppe this helps, > Christian > > [1] https://docs.basex.org/wiki/Process_Module#proc:system

1 0

Starten Unit Test Module in XQuery
by Markus Schmid 20 Aug '20

20 Aug '20

Hi Ist es möglich, ein Unit Test Module (https://docs.basex.org/wiki/Unit_Module#Query) über ein XQuery Script zu starten und die Testausgabe in ein File umzuleiten? (Ich kenne nur die Möglichkeiten, das Module über das TEST Kommando und die Command line unter Angabe der -t Option zu starten). Danke für die Antwort. Markus Schmid

2 1

Can't serialize entities to XML
by Andreas Mixich 18 Aug '20

18 Aug '20

Hi, a REST API returns data in JSON, which I have requested via the http-client's `http:send-request#1` function with the following code: 1. let $data := local:get-article($token, concat($local:ahost, $link))/json 2. let $response := json:serialize($data, map{'format':'xquery'}) 3. => json:parse(map{'format':'xquery'}) 4. let $child := $response(2)?data?children(1)?data 5. return $child?body_html BaseX returns the JSON XML-encoded (see line 1), so I serialize once into JSON (line 2), then to XQuery Map (line 3). In line 4 I return data, that can look like this: <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p> In the further process I would like this to become proper XHTML. I tried all the different `fn:serialize#2` parameters. Either the data stays the same or it gets re-entitized. I also tried `html:parse#1` but get the error: [html:parse] Line 1: No text allowed before root element. I also tried casting to `xs:normalizedString` or using `fn:normalize-space#1` to no avail, before the `html:parse#1` As last I tried document { $child?body_html } which did not change anything in the output. If I do this, however: let $data := ' <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p>' return $data I get this: <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p> So my question is: How can I serialize this into XHTML (de-entitze it)? Thanks. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 4

Yaml serialization
by Marco Lettere 17 Aug '20

17 Aug '20

Dear BaseX team, just out of curiosity, could you imagine what kind of effort it would be to provide YAML as another serialization method for BaseX in addition to XML, HTML, JSON, CSV? The datamodel seems pretty close to the JSON one so maybe a very similar transformation to XML could be implemented ... Ciao, Marco.

6 11

Fuzzy is not applied in full-text search
by Lam Hong Thu 17 Aug '20

17 Aug '20

Hi all, I have a problem searching with "contains text" in content of a document using fuzzy. The results which are found with ft:search can not be found again using "contains text". After making some tests I found out 1. Query: 'Commission abc' contains text 'Commissioning' using fuzzy Result: true Optimized Query: "Commission abc" contains text "Commissioning" using fuzzy using language "English" 2. Query: let $query := 'Commissioning' return 'Commission abc' contains text {$query} using fuzzy Result: false Optimized Query: "Commission abc" contains text "Commissioning" Why the optimized query in the 2. case does not contain "using fuzzy" any more? What could I do so that "using fuzzy" is applied there? I use baseX-GUI of version 9.4.1 Thank you in advanced. Thu

2 1

Understanding PUL, seeing modified result
by Ben Pracht 17 Aug '20

17 Aug '20

Hi, I'm a bit more familiar with a SQL database like Oracle than BaseX, though I did cut my teeth on MarkLogic. MarkLogic from what I've read seems to handle updates differently than BaseX. I'm working through examples I found from the website, but wanted to adapt them for my own understanding. I believe every time I have the copy keyword, it's creating a copy of variable and applies one or more modfiications to that copy. Because the original isn't changed, it's called "non-updating". For instance copy $c := <peace/> modify ( insert node element german { 'Friede'} into $c, insert node attribute guid {'asdf'} into $c ) return $c the original node <peace/>, even if it were a variable would not be touched. However, insert node element german { 'Friede'} into <peace/> Takes the <peace/> element, modifies it and returns the modified form. Or at least it does not complain. I ran SET WRITEBACK on and set MIXEDUPDATES before starting these examples. Unfortunately, the insert above just returns an empty set. I *think* it puts it into some PUL list, not unlike a set of transactions to be applied. These modifications seem to be invisible to subsequent queries, even in the same session (unlike a SQL database wherein the same session would see the modifications). How can I get these changes flushed so I can see and use the modified result? Separately, if I do haver an insert or some other modification, what's the syntax if I wanted to add a for, let order by or other FLOWR keyword? Kind Regards, Ben Pracht 919.809.2439 ben.pracht(a)gmail.com

2 1

Basex huge performance hit in linux (Basex query execution is too slow in linux)
by Nikhil Sethi 17 Aug '20

17 Aug '20

Hi Basex Team, We are facing a huge performance hit in linux machine while using basex, its working smoothly in windows machine While executing any query : -> windows machine takes around 4 to 15 millisec -> On linux machine same query takes around 120 to 150 millisec During some application operation execution we are selecting/inserting the xml nodes in different docs in basex and there are around 13000 xml nodes which needs to be selected/imported in this operation. Linux => rhel or cents of Based on the logs of query execution we have analysed and found : Windows worst case(15 ms) query execution time => 13000 x 15ms => 65000ms => 65 sec = around 1 min Linux average case(130 ms(120+150)/2) query execution time => 13000 x 130ms => 1690000ms => 1690 sec = around 28 min to execute same operation we are using BaseX941.zip ZIP Package eg queries : for $alias in collection(mydbname)//* where (($alias/@id="4249f0807da81000a734525400c54430018") and ($alias/@deleted="false") and ($alias/object-type/@uid="com.MyObjectName")) return $alias or insert node <myxmlNode>…….</myxmlNode> into (for $alias in doc('MyDoc') return $alias) I am using basex with java code to get the result System.setProperty("user.home", db_dir); BaseXXQDataSource ds = new BaseXXQDataSource(); ds.setProperty("serverName", "localhost"); ds.setProperty("port", "1984"); ds.setProperty("databaseName", "mydbname"); XQConnection2 connection = (XQConnection2) ds.getConnection("admin", "myDbPassword"); XQStaticContext xqsc = connection.getStaticContext(); xqsc.setScrollability(XQConstants.SCROLLTYPE_SCROLLABLE); connection.setStaticContext(xqsc); XQPreparedExpression expr = connection.prepareExpression(query); XQResultSequence result = expr.executeQuery(); XQSequence scrollableCopy = connection.createSequence(result); getting result from the xqsequnce for 13000 queries is taking another 10 mins Node node = scrollableCopy.getNode() we have tried to increase xms and xmx in basexserver but it didn't help, Can you please suggest any solution/configuration required for linux machine to increase the performance. Thanks, Nikhil

2 5

In search for "basexgui.vbs"
by Andreas Mixich 12 Aug '20

12 Aug '20

Hi, I had a file "basexgui.vbs", which would start the BaseX GUI without opening a console, but upon last installation it got overwritten. I do not find it, neither here, in the list, nor with Google, overall. Does anybody have this? Thanks! -- Minden jót, all the best, Alles Gute, Andreas Mixich

2 2