September 2015 - BaseX-Talk - mailman.uni-konstanz.de

Enabling MIXUPDATES in basexhttp
by Wiemer, Sebastian 22 Sep '15

22 Sep '15

3 3

Outputting large output
by buddyonweb-software＠yahoo.com 21 Sep '15

21 Sep '15

I am using BaseX to transform some an XML documents into another XML layout.When the incoming document gets large, run out of memory. I've bumped up memory in the JVM and that worked. However, what if there was a really large document? Is there a way to redirect the outputso that instead of the results stored in memory they are sent to disk somewhere (whether to a fileon the file system or even back into BaseX - destination doesn't quite matter). Thanks.

2 4

Opening a database outside of the BaseX directory
by buddyonweb-software＠yahoo.com 21 Sep '15

21 Sep '15

OK, I've been working with BaseX for a little while with some great success. But I am now putting some 'glue' code together and I have a simple task that I am struggling with (believe it or not) Having an issue opening up a database (using just the BaseX jar file). I execute XQuery (inside Java program) and I try specifying the path to the database (e.g. /home/somedirectory/basex/data/MyDB). However whenever I use the full path to get the database, it can't find it. I execute the program locally (without the full path) and everything works just fine! I've tried using db:open() and collection(). Any advice - and sorry for such a simple question. I'm sure I am overlooking something both simple and silly. Thanks again

2 2

validate:rng compact
by Andy Bunce 21 Sep '15

21 Sep '15

Is there an issue with compact RelaxNG compact validation where the schema is supplied as a xs:string, containing the resource in its string representation [1]? let $rnc:="start = element book { page+ } page = element page { text }" return validate:rng(<book><page/></book>,*$rnc*,true()) Error: [FODC0002] Resource .../start = element book { page+ } page = element page { text }' does not exist. If the schema is not XML It looks like it is always treating it as a file path. /Andy [1] http://docs.basex.org/wiki/Validation_Module#RelaxNG_Validation

2 1

Fwd: Re : Basex Query Optimization Support
by Adi Babu 18 Sep '15

18 Sep '15

Dear Team, I am facing performance issue taking long time to execute the Xquery in Basex(Client Server architecture), can you please guide me to optimize the query performance. Below are the statistics & Basex server hardware specifications. Statistics : ------------- Total Records count : 6000000 Fetch count : 10000 Hits Parallel hits : 100 Time Taking : 750 seconds Architecture : Client Server Architecture Hardware Specifications of Basex Sever : ---------------------------------------------------------- Operating System : Red Hat Enterprise Linux 64bit OS Version : Linux 2.6.32 Hard Disk : 500 GB Memory Capacity : 16 GB Ram Processor Family : Intel (R) Xeon(R) CPU E5 -2680 V2 Processor Speed : 2.80 GHz Physical Processors : 8 Virtual Processors/cores : 4 Server Version : basex 7.9 Note : I have attached the sample xml data and Xquery . Thanks & Regards Adi

4 9

array:for-each issue
by Andy Bunce 18 Sep '15

18 Sep '15

Hi, Using 8.2.3 (and the latest beta) this code seems to be invoking the JSON serializer. I don't understand why. declare function local:wrap2($doc,$x as xs:integer*){ $doc }; let $b:=doc("file.xml") return array:for-each([1],local:wrap2($b,?)) And if file.xml is <doc> <p style="prior"/> <p style="target"/> <p style="later"/> </doc> Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.3 beta 89201d1 Java: Oracle Corporation, 1.8.0_45 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.Token.eq(Token.java:619) at org.basex.io.serial.json.JsonNodeSerializer.finishOpen(JsonNodeSerializer.java:145) at org.basex.io.serial.Serializer.prepare(Serializer.java:524) at org.basex.io.serial.Serializer.openElement(Serializer.java:229) at org.basex.io.serial.Serializer.node(Serializer.java:437) at org.basex.io.serial.Serializer.node(Serializer.java:176) at org.basex.io.serial.StandardSerializer.node(StandardSerializer.java:99) at org.basex.io.serial.json.JsonNodeSerializer.node(JsonNodeSerializer.java:89) at org.basex.io.serial.Serializer.serialize(Serializer.java:126) at org.basex.io.serial.StandardSerializer.serialize(StandardSerializer.java:84) at org.basex.io.serial.json.JsonSerializer.serialize(JsonSerializer.java:57) at org.basex.io.serial.json.JsonSerializer.serialize(JsonSerializer.java:76) at org.basex.io.serial.json.JsonSerializer.function(JsonSerializer.java:120) at org.basex.io.serial.AdaptiveSerializer.function(AdaptiveSerializer.java:78) at org.basex.io.serial.Serializer.serialize(Serializer.java:128) at org.basex.io.serial.AdaptiveSerializer.serialize(AdaptiveSerializer.java:63) at org.basex.query.value.Value.serialize(Value.java:223) at org.basex.core.cmd.AQuery.query(AQuery.java:85) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:472) at org.basex.gui.GUI.access$4(GUI.java:425) at org.basex.gui.GUI$7.run(GUI.java:412)

2 3

Different result in BaseX 8.1 vs. 8.2.3 for path starting with slash
by Amanda Galtman 18 Sep '15

18 Sep '15

Hi, While debugging a query, I noticed a difference in behavior between BaseX 8.1 and BaseX 8.2.3. I boiled it down to this short example, which I hope is understandable even if you don't have my database at hand. for $node in collection("DocLibrary")//chapter return $node/ends-with(/book/title,'Examples') In version 8.2.3, all the results are false, which is unexpected. In version 8.1, I get a mix of true and false values, which is what I expect based on the documents in the database. The XQuery 3.0 and 3.1 specs say the following in the "Path Expressions" section: A "/" at the beginning of a path expression is an abbreviation for the initial step (fn:root(self::node()) treat as document-node())/ (however, if the "/" is the entire path expression, the trailing "/" is omitted from the expansion.) The effect of this initial step is to begin the path at the root node of the tree that contains the context node. If I make the substitution mentioned in the spec, for $node in collection("DocLibrary")//chapter return $node/ends-with((fn:root(self::node()) treat as document-node())/book/title,'Examples') then I get expected results in both BaseX 8.1 and BaseX 8.2.3. Do my unexpected results with 8.2.3 arise from a bug? Perhaps the syntax is not that intuitive in either case (my real query is generated rather than coded by hand, so normally no human needs to look at it), but I still wanted to pose this question in case there is a bug. Thanks, Amanda

2 2

Re: [basex-talk] XSD 1.1
by Christian Grün 17 Sep '15

17 Sep '15

Hi Alex (cc to the list), Your feedback was very helpful. And I've finally learnt more about XML Schema 1.1 validation, which is now available in the new snapshot [1]. I have also completely revised the documentation on our Validation Module [2]. Looking forward to your feedback on your first tests, Christian [1] http://files.basex.org/releases/latest/ [2] http://docs.basex.org/wiki/Validation_Module#XML_Schema_Validation

2 1

Db creation
by meumapple 17 Sep '15

17 Sep '15

Hi, I am trying to open a collection of files where some of them contain character entity references like – which are not declared in the document and so make basex crash if I use collection() If I use file:read-text for each file and then put this functioni in file:write, the saved text will show < > instead of < and >: why? Moreover, if I create a database from the GUI and select the option "skip corrupt", the database is created. However if I follow instruction here http://docs.basex.org/wiki/Parsers In order to add single files to a db usind db:add and precede the query with declare option db:skipcorrupt 'true', the files are not added because I get an error message due to the not well-formed xml. I have tried to declare other db options in the same way but they seem not be read. Giuseppe

3 6

Database corruption
by France Baril 16 Sep '15

16 Sep '15

Hi, Once in a while, when saving a file that is not well formed from Oxygen, instead of just getting a raw file in the server, we end up with a corrupted database. It's not a constant occurrence meaning that it doesn't happen all the time, but we were able to get what we think is a relevant error message. We think saving 310.mot.com:8984/webdav/en-us/topics/legal-privacy-modular.xml while it wasn't well formed is what caused the issue. local:8984/webdav/en-us/topics/legal-privacy-modular.xml [qtp1977419222-62] INFO com.bradmcevoy.http.HttpManager - PUT :: http://~ local:8984/webdav/en-us/topics/legal-privacy-modular.xml - http://~ local:8984/webdav/en-us/topics/legal-privacy-modular.xml [qtp1977419222-64] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-65] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-62] WARN com.bradmcevoy.http.http11.PutHandler - parent exists bu t is not a collection resource: /webdav/en-us/topics [qtp1977419222-61] WARN com.bradmcevoy.http.http11.PutHandler - parent exists bu t is not a collection resource: /webdav/en-us/topics java.lang.NullPointerException java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-62] WARN com.bradmcevoy.http.http11.PutHandler - Your resource fa ctory returned a resource with a different name to that requested!!! Requested: webdav returned: - resource factory: class org.basex.http.webdav.BXResourceFact ory java.lang.NullPointerException [qtp1977419222-61] WARN com.bradmcevoy.http.http11.PutHandler - Your resource fa ctory returned a resource with a different name to that requested!!! Requested: webdav returned: - resource factory: class org.basex.http.webdav.BXResourceFact ory java.lang.NullPointerException java.lang.NullPointerException [qtp1977419222-61] ERROR com.bradmcevoy.http.StandardFilter - process [qtp1977419222-62] ERROR com.bradmcevoy.http.StandardFilter - process java.lang.NullPointerException at java.text.SimpleDateFormat.parse(Unknown Source) at java.text.DateFormat.parse(Unknown Source) at org.basex.util.DateTime.parse(DateTime.java:66) at org.basex.http.webdav.impl.WebDAVService.timestamp(WebDAVService.java :120) at org.basex.http.webdav.impl.WebDAVService.createDb(WebDAVService.java: 269) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:77) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:1) at org.basex.http.webdav.BXCode.eval(BXCode.java:37) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:79) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:1) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:261) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:249) at com.bradmcevoy.http.http11.PutHandler.process(PutHandler.java:175) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684 ) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java :503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.jav a:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl er.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl er.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java: 429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle r.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle r.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper .java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abstrac tHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpC onnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.conten t(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnecti on.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEn dPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEnd Point.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo l.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool .java:543) at java.lang.Thread.run(Unknown Source) java.lang.NullPointerException at java.text.SimpleDateFormat.parse(Unknown Source) at java.text.DateFormat.parse(Unknown Source) at org.basex.util.DateTime.parse(DateTime.java:66) at org.basex.http.webdav.impl.WebDAVService.timestamp(WebDAVService.java :120) at org.basex.http.webdav.impl.WebDAVService.createDb(WebDAVService.java: 269) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:77) at org.basex.http.webdav.BXRoot$3.get(BXRoot.java:1) at org.basex.http.webdav.BXCode.eval(BXCode.java:37) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:79) at org.basex.http.webdav.BXRoot.createCollection(BXRoot.java:1) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:261) at com.bradmcevoy.http.http11.PutHandler.findOrCreateFolders(PutHandler. java:249) at com.bradmcevoy.http.http11.PutHandler.process(PutHandler.java:175) at com.bradmcevoy.http.StandardFilter.process(StandardFilter.java:52) at com.bradmcevoy.http.FilterChain.process(FilterChain.java:40) at com.bradmcevoy.http.HttpManager.process(HttpManager.java:228) at org.basex.http.webdav.WebDAVServlet.run(WebDAVServlet.java:43) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:684 ) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java :503) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.jav a:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandl er.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandl er.java:1086) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java: 429) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandle r.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandle r.java:1020) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.j ava:135) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper .java:116) at org.eclipse.jetty.server.Server.handle(Server.java:370) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(Abstrac tHttpConnection.java:494) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpC onnection.java:982) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.conten t(AbstractHttpConnection.java:1043) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:865) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnecti on.java:82) at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEn dPoint.java:696) at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEnd Point.java:53) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPoo l.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool .java:543) at java.lang.Thread.run(Unknown Source) [qtp1977419222-49] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-64] INFO com.bradmcevoy.http.HttpManager - GET :: http://~ local:8984/webdav/AppResources/dtds/catalog.xml - http:// ~local:8984/webdav/AppResources/dtds/catalog.xml [qtp1977419222-55] INFO com.bradmcevoy.http.HttpManager - PROPFIND :: http://~local:8984/webdav/html-review/ - http://~local:8984/webd av/html-review/ -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 3