June 2015 - BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Problem with xi:include - What is the correct href path?
by Kristian Kankainen 10 Jun '15

10 Jun '15

Hello! This is not the most appropriate place to ask, but I'd just like to get a hint of the overall feeling of it. Since the XInclude support is relied upon that of Java, is there any hope it will become complete some day? I'd be satisfied with answers like "I'm positive the support will be completed, but it might take some two years" or "the development seems stalled and probably nothing will happen if noone interested in it makes an effort". Thank you Kristian 08.06.2015 15:33, Christian Grün kirjutas: > Dear Asxetos, > > BaseX relies on the XInclude support of Java, which is (unfortunately) > incomplete. Your example works locally when removing the xpointer > attribute (but it will include the full bar.xml resource). > Aditionally, please note that local or relative XInclude reference > cannot be resolved with DBA, because the file to be embedded will not > be available to the database server. > > If you are interested in getting more background information, please > check out another discussion on this issue on the mailing list [1]. > > Hope this helps, > Christian > > [1] https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg06197.ht… > > > On Mon, Jun 8, 2015 at 2:17 PM, Asxetos <pure.asxetos(a)gmail.com> wrote: >> Hello, >> >> I would like your help getting the following to work. >> I have document 'foo.xml' : >> >> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> <?xml version="1.0" encoding="UTF-8"?> >> <?xml-model href="http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng" >> type="application/xml" >> schematypens="http://relaxng.org/ns/structure/1.0" ?> >> <TEI xmlns="http://www.tei-c.org/ns/1.0"> >> <teiHeader> >> <fileDesc> >> <titleStmt> >> <title>foo</title> >> </titleStmt> >> <publicationStmt> >> <ab></ab> >> </publicationStmt> >> <sourceDesc> >> <ab></ab> >> </sourceDesc> >> </fileDesc> >> </teiHeader> >> <text> >> <body> >> <div> >> <p>I am foo!</p> >> </div> >> <include xmlns="http://www.w3.org/2001/XInclude" href="bar.xml" >> xpointer="thebar"/> >> </body> >> </text> >> </TEI> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> >> >> and document 'bar.xml' : >> >> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> <?xml version="1.0" encoding="UTF-8"?> >> <?xml-model href="http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng" >> type="application/xml" >> schematypens="http://relaxng.org/ns/structure/1.0" ?> >> <TEI xmlns="http://www.tei-c.org/ns/1.0"> >> <teiHeader> >> <fileDesc> >> <titleStmt> >> <title>bar</title> >> </titleStmt> >> <publicationStmt> >> <ab></ab> >> </publicationStmt> >> <sourceDesc> >> <ab></ab> >> </sourceDesc> >> </fileDesc> >> </teiHeader> >> <text> >> <body> >> <div xml:id="thebar"> >> <p>I am bar!</p> >> </div> >> </body> >> </text> >> </TEI> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> >> >> Using the administration interface (http://localhost:8984/dba) >> I create a new databse, add bar.xml and then try to add foo.xml >> This is what I get: >> >> >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> HTTP ERROR 400 >> >> Problem accessing /dba/add. Reason: >> >> Stopped at /Users/Asxetos/basex/webapp/dba/databases/resources/add.xqm, >> 91/10: >> [FODC0002] "foo.xml" (Line 22): An include with href 'bar.xml'failed, >> and no fallback element was found. >> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - >> >> >> I am guessing that the href path is not correct. >> What should the value of the href attribute be? >> >> >> Thanks, >> Asxetos >> >> >> PS: notice the error message says "with href 'bar.xml'failed". It seems the >> 404 page template is missing a whitespace after the filename.

3 2

java.io.IOException: Stream Closed
by Ketill Fenne 10 Jun '15

10 Jun '15

Hi! >From time to time I see the following error: java.io.IOException: Stream Closed at java.io.RandomAccessFile.seek0(Native Method) at java.io.RandomAccessFile.seek(RandomAccessFile.java:557) at org.basex.io.random.TableDiskAccess.readBlock(TableDiskAccess.java:520) at org.basex.io.random.TableDiskAccess.readPage(TableDiskAccess.java:485) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:464) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:148) at org.basex.data.Data.kind(Data.java:307) at org.basex.query.value.node.DBNode$4.next(DBNode.java:349) at org.basex.query.expr.path.IterStep$1.next(IterStep.java:38) at org.basex.query.expr.path.IterStep$1.next(IterStep.java:32) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:58) at org.basex.query.expr.path.IterPath$1.next(IterPath.java:36) at org.basex.query.expr.gflwor.For$1.next(For.java:79) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:95) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.server.ServerQuery.execute(ServerQuery.java:130) at org.basex.api.client.LocalQuery.cache(LocalQuery.java:48) at org.basex.api.client.Query.more(Query.java:76) An example of how I query and iterate: DBResult dbResult = null; LocalQuery results = null; try { xPath = xPath.indexOf("/") == -1 ? "/" + xPath : xPath; String myQuery = "for $doc in (" + getContentCollectionQuery(PPSCONTENT_DATABASE_NAME) + " ) " + xPath + createNameCondition(name, PPSCONTENT_DATABASE_NAME) + createDateCondition(version) + " " + " return (data($doc/topic/@id))"; dbResult = runQuery(myQuery); results = dbResult.getXmlResults(); String topic = null; if (results.more()) { topic = results.next(); } return topic; } catch (QueryException e) { PPLogger.getInstance().error("Error in getTopicForDocWithName: " + e.getMessage()); return null; } catch (IOException e) { PPLogger.getInstance().error("Error in getTopicForDocWithName: " + e.getMessage()); return null; } finally { if (results != null) results.close(); if (dbResult != null) dbResult.close(); } The error occurs randomly, but is always "triggered" by "results.more()" and I am not able to reproduce it at will. Is there something wrong or missing in how I iterate the results? I am using BaseX8.2.1 on windows 7. Kind regards Ketill Fenne

2 2

DBA and long-running queries
by Kristian Kankainen 10 Jun '15

10 Jun '15

I want to add a big (150mb) xml file as a resource to my database. The machine is behind a reverse proxy, so the easiest way would be through the DBA. I have the file locally on the same machine I run Tomcat on, but when I run the db:add() query, I get a timeout (504 Gateway Time-out 504 Gateway Time-out nginx/1.2.1). Is there a way of circumventing this? Perhaps instead of running the db:add() straight from the DBA, I should have it as a function in my XQrepo and trigger it somehow? Kristian

2 1

Doc mistake for map:get() for NaN key
by Amanda Galtman 09 Jun '15

09 Jun '15

Hi, I think the following is a mistake in the doc, but before changing the wiki, I wanted to double-check. The documentation for map:get says, "If the supplied key is the xs:float or xs:double value NaN, the function returns an empty sequence." BaseX 8.1 returns the value that corresponds to the NaN key (if present). The software behavior seems correct to me. For example: INPUT let $mymap := map:entry(xs:double('NaN'),'abc') return map:get($mymap,xs:double('NaN')) OUTPUT abc Thanks, Amanda

2 1

BaseX 8.2.1
by Christian Grün 09 Jun '15

09 Jun '15

Dear all, BaseX 8.2.1 has been released today. It contains bug fixes and, additionally, some new DBA features: - Code highlighting (thanks, James Ball!) - New panel for up- and downloading files - Queries and files are now stored in a temporary directory You can also test some of the features that will officially be available with 8.3, such as RelaxNG validation (see http://docs.basex.org/index.php?search=8.3 for more information). Have fun, Christian

1 0

Function to throw an exception
by cmarchand＠oxiane.com 09 Jun '15

09 Jun '15

Hello, Before doing some updates, I want to check many things. If those checks fail, I want to throw an error, to allow the calling program be notified of the error. I do not want to avoid the updates, but really want to throw an error. Is there such a function ? Christophe

2 2

Re: [basex-talk] Using python to query BaseX server on localhost
by Christian Grün 08 Jun '15

08 Jun '15

Hi Werner, > I now want to query the database with BaseXClient.py using a list from > stdout from another script. How do I do that in python? Have you already tried the (few) examples we are providing (e.g. [1, 2])? > What I want to accomplish is use the variables in the list from the other > script to search through the XML files in BaseX and if the variables are > found in an XML file, text must be returned from within > "<name>example</name>" in the same file. I think we need more information on what you mean with "search through the XML files". Could you provide us the Python and XPath/XQuery snippets you have written so far? Best, Christian [1] https://github.com/BaseXdb/basex/blob/master/basex-api/src/main/python3/Que… [2] https://github.com/BaseXdb/basex/blob/master/basex-api/src/main/python3/Que…

1 0

Issue with UPDINDEX and db:replace (8.2.1 beta)
by James Ball 05 Jun '15

05 Jun '15

Hello, I’m running into some problems again with replacing documents when a database has updating indexes turned on. Basically I can add a certain number of documents and then replacing a document will cause an error. Unexpected error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.1 beta 0e44488 Java: Oracle Corporation, 1.8.0_31 OS: Mac OS X, x86_64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException And then I can’t add anything. Things I’ve tried: - turn off UPDINDEX: everything works correctly - use db:add instead of db:replace: everything works correctly From this I don’t think there’s anything wrong with my code, or the documents themselves but instead something is amiss in the logic for updating an index. But I’m not sure exactly where to look - the trace isn’t very detailed. I can’t narrow it down perfectly but I have managed to create a set of 5 messages (about 40kB) that will cause the error every time on my system. I can’t share these publicly but I can send them over privately for the purposes of testing if required. I’m happy to try to look a bit closer but I’m not sure what to look at and I think you have made some changes to the updating indexes in recent versions. Many thanks for your help, James To recreate the error I’m using RESTXQ with the following function: module namespace _ = 'push'; import module namespace Request = 'http://exquery.org/ns/request'; import module namespace functx = "http://www.functx.com”; declare %rest:POST("{$data}") %rest:path("/push") %updating function _:test($data) { let $odf := $data/OdfBody let $discipline := substring($odf/@DocumentCode,1,2) let $path := functx:pad-string-to-length($odf/@DocumentCode,"_",9) || functx:pad-string-to-length($odf/@DocumentSubcode,"_",10) || functx:pad-string-to-length($odf/@DocumentType,"_",30) || functx:pad-string-to-length($odf/@DocumentSubtype,"_",20) || functx:pad-string-to-length($odf/@FeedFlag,"_",1) || functx:pad-string-to-length($odf/@Language,"_",3) || ".xml" return ( if (db:exists("ODF-MIN-" || $discipline)) then ( db:replace("ODF-MIN-"||$discipline,$path,$data) (: db:add("ODF-MIN-"||$discipline,$data,$path) :) ) else ( db:create("ODF-MIN-"||$discipline,$data,$path,map { 'textindex': true(), 'attrindex':true(), 'updindex':true() }) (: db:create("ODF-MIN-"||$discipline,$data,$path) :) ) ) }; Delete the database if it exists then load the five files one at a time. I use this bash script to upload each file from a folder: #!/bin/bash # Usage: push all .xml files in the supplied directory (or single xml file) to server shopt -s nullglob echo $1 PASSED=$1 if [[ -d "$PASSED" ]]; then echo "Directory" FILES="$PASSED/*.xml" elif [[ -f "$PASSED" ]]; then if [[ ( $PASSED == *.xml ) || ( $PASSED == *.XML ) ]]; then FILES=$PASSED else echo "Not an XML file" exit 0 fi else echo "Not valid file or directory" exit 0 fi for f in $FILES do echo "Pushing file - $f" curl -X POST -H 'Content-Type:text/xml' --data @$f http://localhost:8984/push done

2 2

validate:xsd
by France Baril 02 Jun '15

02 Jun '15

Hi, The function returns incomplete error messages on 8.2. It makes it difficult to figure out what the problem is. *validate:xsd*(*$node*, *$staged-xsd*) returns: Stopped at /Users/archie/BX-Acc/webapp/Accounting_ValidationSchemas.xqm, 13/41: [bxerr:BXVA0001] Validation failed. "Fatal:The version is required i... I'd really like to see what ... stands for. Is it possible to get more complete messages? Regards, France -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

Catch a user event/work with triggers
by France Baril 02 Jun '15

02 Jun '15

Hi, I couldn't find documentation about catching events that occur on a db from an xquery module. What I am trying to achieve: Context: Writers create content in XML Oxygen and are connected through the data source which uses WebDAV. 1. A writer modifies an .xml file and saves the changes. An event that can be caught by an xquery function is triggered. 2. My xquery function adds an @id to all elements that don't have one and saves the document again. There is a way to differenciate users 'replace' from query 'replace' so that if an event is triggered again here, we will not loop indefinitely. I know you are working on triggers, but I'm not sure it applies to this use case. Can this currently be done? Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2