- BaseX-Talk - mailman.uni-konstanz.de

Error: Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist.
by Srikumar Choudhury 21 Aug '20

21 Aug '20

Hi Christian, Why I am getting below error message, even though 0601904f80007547.xml file exist in database. if we will open the corresponding database using basexgui.bat(i.e., open "JunitDocbaseDB" database in GUI), then xqPreparedExpr.executeQuery() java api is returning proper 0601904f80007547.xml data(see below log), otherwise throwing same below error message. How I can resolve this issue or it is bug? BXCE001 - Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Open basex.bat: ================= > XQUERY db:open('JunitDocbaseDB', '6301904f80000114/0601904f80007547.xml')  <testSuiteConfig version="2.0"> <testSuiteEnv> <paths> <path type="input" value="../data"/> </paths> </testSuiteEnv> <package name="com.documentum.test.xhive_integration.uc_1.uc_1_1"> <test name="TC_1_1_1" className="TC_1_1_1"/> </package> </testSuiteConfig> Query executed in 12.59 ms. > XQUERY for $article in doc('6301904f80000114/0601904f80007547.xml') return $article Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Run same xquery from java program: ================================== XQPreparedExpression xqPreparedExpr = null; XQResultSequence resultSeq = null; String xQuery = "for $article in doc('6301904f80000114/0601904f80007547.xml') return $article"; xqPreparedExpr = m_conn.prepareExpression(xQuery); resultSeq = xqPreparedExpr.executeQuery(); Log: ==== [13:17:10.034] TRACE: XQConnection-1.prepareExpression(String) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.034] TRACE: XQConnection-1.prepareExpression(String, XQStaticContext) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.035] TRACE: XQPreparedExpression-1.executeQuery() invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:17:10.036] TRACE: XQPreparedExpression-1.executeQuery(), raw XQuery resolved to: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article javax.xml.xquery.XQException: BXCE001 - Stopped at ., 1/20: [FODC0002] Resource 'C:/Srikumar/Software/BaseX/BaseX941/basex/bin/6301904f80000114/0601904f80007547.xml' does not exist. Run same xquery using above same java program:(after opening basexgui.bat and open "JunitDocbaseDB" database in GUI) ============================================== log: ==== [13:22:49.313] TRACE: XQConnection-2.prepareExpression(String) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.313] TRACE: XQConnection-2.prepareExpression(String, XQStaticContext) invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.315] TRACE: XQPreparedExpression-1.executeQuery() invoked, with the raw XQuery of: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.315] TRACE: XQPreparedExpression-1.executeQuery(), raw XQuery resolved to: for $article in doc('6301904f80000114/0601904f80007547.xml') return $article [13:22:49.318] DEBUG: XQPreparedExpression-1.close() invoked. Finished executing xquery with query Start iterating through the xquery results for query 0 Result :  <testSuiteConfig version="2.0"> <testSuiteEnv> <paths> <path type="input" value="../data"/> </paths> </testSuiteEnv> <package name="com.documentum.test.xhive_integration.uc_1.uc_1_1"> <test name="TC_1_1_1" className="TC_1_1_1"/> </package> </testSuiteConfig> Thanks, Srikumar

2 16

multi-line queries in the command line client
by Bill Osmond 21 Aug '20

21 Aug '20

Hi all, First, thanks for making BaseX! I'm in the process of learning it (and XQuery) after an ill-fated attempt to coerce complicated XML data into a relational database, and I'm optimistic about the prospects of success. But there is one thorn in my side: it seems like xquery commands have to all be on a single line when run from the command line client. Multiple lines/indentation goes a long way towards helping me mentally structure the queries I'm (trying to) run, but it seems I have to join them together on a single line in order to actually run them. I've tried the standard \ character with no luck, and I couldn't find anything in the documentation about it. Is there any solution, or is that just the way it is? Thanks, Bill

2 2

problems using Archive module with certain zip files
by Lizzi, Vincent 20 Aug '20

20 Aug '20

Hello, I'm using BaseX in several file conversion projects that involve unpacking a zip file using the Archive module, modifying the files that are found inside with the File module and XSLT module, and creating new zip file(s) using the Archive module again. BaseX is very useful for these kinds of transformations and makes it quick to develop a transformation complete with unit tests. I'm running in to 2 kinds of problems with certain zip files and getting the following error messages from the Archive module. 1. When attempting to extract certain zip files archive:extract-to() or archive:entries() produce this error message "Operation failed: only DEFLATED entries can have EXT descriptor." The zip files that produce this error can be extracted using another program such as 7zip, which might be better at handling variations in the structure of some zip files. 2. When attempting to create a zip file larger than about 2 Gb. After extracting a zip file larger than about 2 Gb using archive:extract-to (which works), when trying to create a new zip file file:write-binary($newZip, archive:create-from($tempDir)) produces a stack trace that begins with: java.lang.ArrayIndexOutOfBoundsException: Maximum array size reached. at org.basex.util.Array.checkCapacity(Array.java:322) at org.basex.util.Array.newCapacity(Array.java:313) at org.basex.util.Array.newCapacity(Array.java:301) at org.basex.io.out.ArrayOutput.write(ArrayOutput.java:32) at java.base/java.io.OutputStream.write(OutputStream.java:157) at java.base/java.util.zip.DeflaterOutputStream.deflate(DeflaterOutputStream.java:253) at java.base/java.util.zip.DeflaterOutputStream.write(DeflaterOutputStream.java:211) at java.base/java.util.zip.ZipOutputStream.write(ZipOutputStream.java:332) at java.base/java.io.FilterOutputStream.write(FilterOutputStream.java:108) at org.basex.query.func.archive.ZIPOut.write(ZIPOut.java:44) at org.basex.query.func.archive.ArchiveCreate.add(ArchiveCreate.java:138) I'm currently using BaseX version 9.4.1 and Java 64-bit openjdk version "11.0.7" 2020-04-14. This might be a bug in BaseX handling of zip files. Is there any solution or workaround? Thanks, Vincent ______________________________________________ Vincent M. Lizzi Head of Information Standards | Taylor & Francis Group 530 Walnut St., Suite 850, Philadelphia, PA 19106 E-Mail: vincent.lizzi(a)taylorandfrancis.com Phone: 215-606-4221 Web: www.tandfonline.com Taylor & Francis is a trading name of Informa UK Limited, registered in England under no. 1072954 "Everything should be made as simple as possible, but not simpler." Information Classification: General

2 1

Re: [basex-talk] Starten Unit Test Module in XQuery
by Markus Schmid 20 Aug '20

20 Aug '20

Hi Christian thank you for the response. The solution is good (far better than code generating .bat files ..). I slightly modified the solution in order to run the same testsuites with different testdata in one script: declare function test:runtests() { for-each( map:keys($test:dbset), function($k) { test:runtest($test:dbset($k)) } ) }; declare function test:runtest($databases) { let $testdata := $databases/@data let $name := $databases/@name let $dummy := trace(concat('runtest for testdata : ‘,$name)) let $args := ('-cp','C:\Arbeit\Tools\BaseX932\basex\BaseX.jar','org.basex.BaseX','-b',concat('{mytests}data=',$testdata),'-o',concat('C:\Arbeit\Tasks\UnitTests\TestResult',$name,'.xml'),'-t','C:\Arbeit\Tasks\UnitTests\TestModules\') return ( try {proc:system('java',$args)} catch * { } ) }; let $result := test:runtests() return() Using the try / catch block is important here else the script stops when the first test failure occurs. Markus > Am 20.08.2020 um 09:10 schrieb Christian Grün <christian.gruen(a)gmail.com>: > > Hi Markus, > >> Ist es möglich, ein Unit Test Module (https://docs.basex.org/wiki/Unit_Module#Query) über ein XQuery Script zu starten und die Testausgabe in ein File umzuleiten? > > As you’ve already noted, unit tests must always be started outside an > XQuery expression. The reason is that sequentially executed unit tests > may have come with all kinds of side effects which go beyond the scope > of a single query. > > The following solution doesn’t necessarily distinguish itself through > elegance, but you could launch a second BaseX instance with the > Process Module [1] and convert the string output to an XML document > via fn:parse-xml: > > let $args := ('-cp', '/path/to/basex.jar', 'org.basex.BaseX', '-t', > '/path/to/tests') > let $result := proc:system('java', $args) > return parse-xml($result) > > This way, your tests will be run in an independent BaseX context. If > you invoke the function from the directory in which your BaseX > instance and the tests reside, you can omit the absolute paths > (/path/to/). > > Hoppe this helps, > Christian > > [1] https://docs.basex.org/wiki/Process_Module#proc:system

1 0

Starten Unit Test Module in XQuery
by Markus Schmid 20 Aug '20

20 Aug '20

Hi Ist es möglich, ein Unit Test Module (https://docs.basex.org/wiki/Unit_Module#Query) über ein XQuery Script zu starten und die Testausgabe in ein File umzuleiten? (Ich kenne nur die Möglichkeiten, das Module über das TEST Kommando und die Command line unter Angabe der -t Option zu starten). Danke für die Antwort. Markus Schmid

2 1

Can't serialize entities to XML
by Andreas Mixich 18 Aug '20

18 Aug '20

Hi, a REST API returns data in JSON, which I have requested via the http-client's `http:send-request#1` function with the following code: 1. let $data := local:get-article($token, concat($local:ahost, $link))/json 2. let $response := json:serialize($data, map{'format':'xquery'}) 3. => json:parse(map{'format':'xquery'}) 4. let $child := $response(2)?data?children(1)?data 5. return $child?body_html BaseX returns the JSON XML-encoded (see line 1), so I serialize once into JSON (line 2), then to XQuery Map (line 3). In line 4 I return data, that can look like this: <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p> In the further process I would like this to become proper XHTML. I tried all the different `fn:serialize#2` parameters. Either the data stays the same or it gets re-entitized. I also tried `html:parse#1` but get the error: [html:parse] Line 1: No text allowed before root element. I also tried casting to `xs:normalizedString` or using `fn:normalize-space#1` to no avail, before the `html:parse#1` As last I tried document { $child?body_html } which did not change anything in the output. If I do this, however: let $data := ' <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p>' return $data I get this: <div class="md"><p>Welcome everyone from <a href="/r/all">r/all</a>! Please remember:</p> So my question is: How can I serialize this into XHTML (de-entitze it)? Thanks. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 4

Yaml serialization
by Marco Lettere 17 Aug '20

17 Aug '20

Dear BaseX team, just out of curiosity, could you imagine what kind of effort it would be to provide YAML as another serialization method for BaseX in addition to XML, HTML, JSON, CSV? The datamodel seems pretty close to the JSON one so maybe a very similar transformation to XML could be implemented ... Ciao, Marco.

6 11

Fuzzy is not applied in full-text search
by Lam Hong Thu 17 Aug '20

17 Aug '20

Hi all, I have a problem searching with "contains text" in content of a document using fuzzy. The results which are found with ft:search can not be found again using "contains text". After making some tests I found out 1. Query: 'Commission abc' contains text 'Commissioning' using fuzzy Result: true Optimized Query: "Commission abc" contains text "Commissioning" using fuzzy using language "English" 2. Query: let $query := 'Commissioning' return 'Commission abc' contains text {$query} using fuzzy Result: false Optimized Query: "Commission abc" contains text "Commissioning" Why the optimized query in the 2. case does not contain "using fuzzy" any more? What could I do so that "using fuzzy" is applied there? I use baseX-GUI of version 9.4.1 Thank you in advanced. Thu

2 1

Understanding PUL, seeing modified result
by Ben Pracht 17 Aug '20

17 Aug '20

Hi, I'm a bit more familiar with a SQL database like Oracle than BaseX, though I did cut my teeth on MarkLogic. MarkLogic from what I've read seems to handle updates differently than BaseX. I'm working through examples I found from the website, but wanted to adapt them for my own understanding. I believe every time I have the copy keyword, it's creating a copy of variable and applies one or more modfiications to that copy. Because the original isn't changed, it's called "non-updating". For instance copy $c := <peace/> modify ( insert node element german { 'Friede'} into $c, insert node attribute guid {'asdf'} into $c ) return $c the original node <peace/>, even if it were a variable would not be touched. However, insert node element german { 'Friede'} into <peace/> Takes the <peace/> element, modifies it and returns the modified form. Or at least it does not complain. I ran SET WRITEBACK on and set MIXEDUPDATES before starting these examples. Unfortunately, the insert above just returns an empty set. I *think* it puts it into some PUL list, not unlike a set of transactions to be applied. These modifications seem to be invisible to subsequent queries, even in the same session (unlike a SQL database wherein the same session would see the modifications). How can I get these changes flushed so I can see and use the modified result? Separately, if I do haver an insert or some other modification, what's the syntax if I wanted to add a for, let order by or other FLOWR keyword? Kind Regards, Ben Pracht 919.809.2439 ben.pracht(a)gmail.com

2 1

Basex huge performance hit in linux (Basex query execution is too slow in linux)
by Nikhil Sethi 17 Aug '20

17 Aug '20

Hi Basex Team, We are facing a huge performance hit in linux machine while using basex, its working smoothly in windows machine While executing any query : -> windows machine takes around 4 to 15 millisec -> On linux machine same query takes around 120 to 150 millisec During some application operation execution we are selecting/inserting the xml nodes in different docs in basex and there are around 13000 xml nodes which needs to be selected/imported in this operation. Linux => rhel or cents of Based on the logs of query execution we have analysed and found : Windows worst case(15 ms) query execution time => 13000 x 15ms => 65000ms => 65 sec = around 1 min Linux average case(130 ms(120+150)/2) query execution time => 13000 x 130ms => 1690000ms => 1690 sec = around 28 min to execute same operation we are using BaseX941.zip ZIP Package eg queries : for $alias in collection(mydbname)//* where (($alias/@id="4249f0807da81000a734525400c54430018") and ($alias/@deleted="false") and ($alias/object-type/@uid="com.MyObjectName")) return $alias or insert node <myxmlNode>…….</myxmlNode> into (for $alias in doc('MyDoc') return $alias) I am using basex with java code to get the result System.setProperty("user.home", db_dir); BaseXXQDataSource ds = new BaseXXQDataSource(); ds.setProperty("serverName", "localhost"); ds.setProperty("port", "1984"); ds.setProperty("databaseName", "mydbname"); XQConnection2 connection = (XQConnection2) ds.getConnection("admin", "myDbPassword"); XQStaticContext xqsc = connection.getStaticContext(); xqsc.setScrollability(XQConstants.SCROLLTYPE_SCROLLABLE); connection.setStaticContext(xqsc); XQPreparedExpression expr = connection.prepareExpression(query); XQResultSequence result = expr.executeQuery(); XQSequence scrollableCopy = connection.createSequence(result); getting result from the xqsequnce for 13000 queries is taking another 10 mins Node node = scrollableCopy.getNode() we have tried to increase xms and xmx in basexserver but it didn't help, Can you please suggest any solution/configuration required for linux machine to increase the performance. Thanks, Nikhil

2 5