BaseX-Talk

basex-talk@mailman.uni-konstanz.de

1 participants
5245 discussions

Scaling and Jsoniq
by Ben Pracht 02 Jan '19

02 Jan '19

Hi, I'm sorry if this was covered earlier, but I haven't seen it in a Google search. First, are there any support plans for scaling outwards? I know MarkLogic has splits clusters into multiple enodes and dnodes. But the idea is that there isn't one central bottleneck for requests. Second, I read about Jsoniq and was intrigued by it. It seemed like it supported JSON without requiring an XML intermediary. Having good JSON support would really help with frameworks like Angular or React. I really love Basex overall though and think it's underrated for what it can do. Regards, Ben

4 3

basic xquery
by thufir 02 Jan '19

02 Jan '19

How can I run this xquery: fetch:xml("http://books.toscrape.com/", map { 'parser': 'html', 'htmlparser': map { 'html': false(), 'nodefaults': true() } }) from basex using Java? I can run that xquery from the GUI. thanks, Thufir

2 1

update:output() update:cache()
by Dieter Zanzinger 02 Jan '19

02 Jan '19

I do not exactly understand, for which purpose update:output() is meant. Does anybody have an example, where one can see, how it works? (There is no example in the docs.) (I am searching for a way, to run a update-expression on a database and give the altered nodes as result back to the restq-user in one query. The update:output() or update:cache() - expression sounded like they do something similar… At present, i am helping me with a copy/modify/return-solution and am giving back the altered result, before I actually write back the result-node of the previous to the db. But I am searching for a more intuitive way to get this result). Sincerly Dieter

2 1

Serving Static Content from Tomcat
by Shaun Flynn 01 Jan '19

01 Jan '19

Hello there, I am using BaseX 9.1.1 inside a Tomcat server trying to build a webapp using RESTXQ. I have studied the DBA xqm files, and see that there is static content delivered to the generated login page, located in dba/static folder. When I try to replicate this in my app, I get 404 errors saying the resource can not be found in the Developer Tools of Opera. Below is my .xqm file. The resources in question are in bold and underlined. What am I doing wrong? module namespace scheduleGui = "www.tt.co.uk/schedule"; import module namespace path = "www.tt.co.uk/path" at "DFSPath.xqm"; (: Produces a simple HTML form for entering origin and destination to produce a path :) declare %output:method("html") %rest:path("/rail/a2b") function scheduleGui:welcome() { <html> <head> * <script type="text/javascript" src="static/jQuery3.1.1.js"></script>* * <script type="text/javascript" src="static/simplePost.js"></script>* </head> <body> <h1>Paths</h1> <table> <tr> <td> Origin </td> <td> <input type="text" id="origin" value="" size="8" /> </td> </tr> <tr> <td> Destination </td> <td> <input type="text" id="destination" value="" size="8" /> </td> </tr> <tr> <td> </td> <td> <input type="submit" value="Go!" id="findPath" /> </td> </tr> </table> <div id="displayArea"> </div> </body> </html> }; declare %rest:POST %rest:form-param("origin","{$origin}", "") %rest:form-param("destination","{$destination}", "") %output:method("html") %rest:path("/rail/a2bp") function scheduleGui:a2b($origin, $destination) { if($origin != "") then (<p> Find path from {$origin} to {$destination} </p>), <ul> { for $path in path:DFSSpec($origin, $destination, "up") return <li>{$path}</li> } </ul> };

1 1

Re: [basex-talk] 9.1.1: Relative path resolution fails with non-ascii characters
by Christian Grün 21 Dec '18

21 Dec '18

Hi Alex (cc to the list), This might be an OS-specific problem (I tried to reproduce the problem with Windows and Ubuntu, but I didn’t succeed). Which operating system are you using, and what’s the default encoding of your file system? > '../xqm/path:frequently used paths.xqm'; This is actually an invalid path in XQuery, as spaces should be encoded via %20. BaseX accepts it anyway, at least in version 9 (we might change that in future). Maybe you’ll generally encounter less issues if you use standard URI characters in your file paths. But as soon as I’ll manage to reproduce the encoding problem you encountered, I’ll be happy to have a closer look at it. Feel free to provide me with a minimal step-by-step procedure; maybe I missed something. Saludos, Christian On Fri, Dec 21, 2018 at 5:28 AM Alex R. Loayza <arx.inbox(a)gmail.com> wrote: > Hello Christian, > > I have encountered an issue in BaseX 9.1.1 after migrating from 8.5.3. It > seems to be a character encoding problem. > > In many queries, I import a module with a relative path: > > import module namespace path = 'http://myns' at '../xqm/path:frequently > used paths.xqm'; > > While this worked fine in 8.5.3, in 9.1.1 I get the following error > message: > > If I substitute the absolute path to the module for the relative path, > > import module namespace path = 'http://myns' at > '/home/arx/devWorks/otherProjects/almacén/procRep/xqy/xqm/path:frequently > used paths.xqm'; > > ...the import again succeeds. This tells me that the code resolving the > relative path in 9.1.1 is having problems with non-ascii characters: the > *é* in this case, which is changed to *?* in the resolved path. > > I see no way to fix this myself. Is this is a bug, or is there some > workaround? > > Cheers, > > Alex > > > --------------------------- > From: Christian Grün <christian.gruen(a)gmail.com> > <christian.gruen(a)gmail.com> > To:Alex R. Loayza > Cc:BaseX > Dec 20 at 3:36 AM > Hi Alex, > > All changes in the 9.0 storage layout are backward compatible. If you > update your database, it will be optimized incrementally. > > Breaking changes in BaseX will be documented explicitly. For example, if > you have written a lot of XQuery code, you may need to update some > BaseX-specific function calls. You will find those changes in the docs by > searching for "9.0" or "9.1". > > Hope this helps, > Christian >

1 0

possible basex 9.1.1 bug in java binding exception handling
by Mark McSweeny 21 Dec '18

21 Dec '18

Hello, I am seeing a possible bug during exception-handling while using Java binding in BaseX version 9.1.1. The problem can be illustrated by the following minimal working example query: Q{java.lang.String}new*java.lang.String(()) This is equivalent to the Java expression "new String(null)". "null" is not valid for this constructor so an exception is thrown. In version 9.1, I see the expected error: [XPTY0004] String.new(empty-sequence()): java.lang.NullPointerException. In version 9.1.1, I get message suggesting a potential bug along with a full stack trace: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk@... Version: BaseX 9.1.1 Java: Oracle Corporation, 1.8.0_92 OS: Windows 10, amd64 Stack Trace: java.lang.NullPointerException at org.basex.util.Util.className(Util.java:70) at org.basex.query.func.java.JavaEval.type(JavaEval.java:203) at org.basex.query.func.java.JavaEval.types(JavaEval.java:188) at org.basex.query.func.java.JavaEval.execError(JavaEval.java:149) at org.basex.query.func.java.DynJavaConstr.eval(DynJavaConstr.java:78) at org.basex.query.func.java.JavaCall.value(JavaCall.java:70) at org.basex.query.func.java.JavaCall.iter(JavaCall.java:63) at org.basex.query.scope.MainModule.iter(MainModule.java:118) at org.basex.query.QueryContext.iter(QueryContext.java:335) at org.basex.query.QueryContext.cache(QueryContext.java:613) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:112) at org.basex.core.cmd.AQuery.query(AQuery.java:103) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:429) at org.basex.gui.GUI.lambda$4(GUI.java:372) at java.lang.Thread.run(Thread.java:745) The stack trace suggests that the error is occurring while the system is assembling the error message. It generates a string describing the Java arguments: https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… ... but when it tries to determine the type of "null": https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… ... it incurs a NullPointerException while calling "null.getClass()": https://github.com/BaseXdb/basex/blob/9.1.1/basex-core/src/main/java/org/ba… I hope this report is helpful. Take care, Mark Mark McSweeny Development Team Lead t: 403-648-4602 + 4602 e: mark.mcsweeny(a)aucerna.com Learn more about Aucerna www.3esi-enersight.com/blog/palantir-solutions Confidentiality Notice: The information transmitted herein may contain confidential, proprietary and/or privileged material which belongs to Aucerna and is only for the intended addressee(s). Any unauthorized review, distribution or other use of this information is prohibited. Finally, the recipient should check this email and any attachments for the presence of viruses. The organization accepts no liability for any damage caused by any virus transmitted by this email. If you received this email in error, please contact us at (403) 270-3270 or by return email and delete this email and any copies immediately. v&7.11.1989&$

2 1

Re: [basex-talk] possible basex 9.1.1 bug in java binding exception handling
by Mark McSweeny 20 Dec '18

20 Dec '18

The character in the example query between "new" and "java" was meant to be the "middle dot character" (&#xB7), not an asterisk: Trying again... and hoping it gets through the various mailers :) Q{java.lang.String}new·java.lang.String(())

1 0

Migrating Data
by Alex R. Loayza 20 Dec '18

20 Dec '18

Hello, I want to upgrade from 8.5.3 to 9.1.1, but I'm unsure if the data format is compatible. In the changelog for 9.0, I find that regarding storage there has been the following change: "Improved database compression (short strings, whitespaces)" Does this mean that the old data format is incompatible? If so, how to migrate the data? Is there some documentation page detailing compatibility of data formats across BaseX versions? I'm been unable to find it. An upgrade guide would be a welcome addition to the docs! Best regards, Alex

2 1

BaseX/GUI using all memory
by Rick Graham 17 Dec '18

17 Dec '18

Greetings, First of all, thank you very much for BaseX. It has made many of my assignments this semester doable, more enjoyable, and better. Using it, I could demonstrate database features at scale where only toy minimal examples were required. The source of most of my data has been NIST's National Vulnerability Database <https://nvd.nist.gov/vuln/data-feeds> and the Mitre curated Common Weakness Enumeration Lists <https://cwe.mitre.org/data/downloads.html>. Using BaseX, I found and reported to NIST some errors in the CVE database and the errors have since been fixed. I'm sure there are many more fixes and enhancements possible with the CVE database. I almost exclusively use BaseX/GUI (version 9.0.2, then 9.1, and now 9.1.1) on Fedora Linux. I do have some issues using BaseX/GUI and I am hoping that some improvements can be made. Eventually, BaseX/GUI uses all of it's allocated memory. Even after increasing the max memory to 3.5GB, eventually it is all used and BaseX/GUI essentially freezes. Any operation that freezes, executes quickly and completely after quitting/killing BaseX/GUI and then restarting. It seems that some memory just never gets freed as I develop different XQuery routines in the Editor, run them, save them to files, click in various places on the Map Visualization, run XQuery on the Input Bar, etc. Sometimes closing the database frees the memory, mostly it doesn't. Once I think memory was freed when I saved a file in the Editor. The Java error messages all seem to relate to running out of memory. Hitting the "GC" button never seems to help. I don't have a specific sequence of actions that eventually consumes all the memory. An example database that will demonstrate this memory consumption is composed of NVD-CVE-1.0-2018 <https://nvd.nist.gov/feeds/json/cve/1.0/nvdcve-1.0-2018.json.zip> and CWE Comprehensive View <https://cwe.mitre.org/data/xml/views/2000.xml.zip>. The database takes about 109 MB and has about 5.25 million nodes. Just viewing the Visualization Map, clicking around, and running/editing queries like this will eventually use all the memory. let $cwe := distinct-values > ( > for $c in //cve//problemtype__data//value > return > tokenize($c, "-")[last()] > ) > for $c in $cwe > where > empty(//Weakness_Catalog[contains(@Name, "CWE-2000")]//Weakness[@ID = $c]) > and > empty(//Weakness_Catalog[contains(@Name, > "CWE-2000")]//Related_Weakness[@CWE_ID = $c]) > order by number($c) > return > $c `java -version` reports: openjdk version "1.8.0_191" > OpenJDK Runtime Environment (build 1.8.0_191-b12) > OpenJDK 64-Bit Server VM (build 25.191-b12, mixed mode) I will gladly provide any additional info that may help to diagnose these symptoms, etc. Thanks and best regards. RG

2 3

BaseX 9.1.1
by Christian Grün 17 Dec '18

17 Dec '18

Hi all, we are glad to provide you with version 9.1.1 of BaseX! It’s actually more than just a maintenance release: XQuery: - Comprehensive rewritings of positional predicates and functions - Higher-order functions: Improved type inference - Improved rewriting of context-based and/or nested predicates Java Bindings: - Faster access to and evaluation of Java functions and variables - Improved pre-selection of function candidates at compile time - Better error messages (incl. function arity and similar names) DBA: - Settings: user-defined pattern for ignoring log entries - Login: pass on URL query strings Minor improvements: - Import: detect epub files as ZIP archives - Digest Authentication: No delay after first request - GUI, Preferences: user-defined choice of XML suffixes The new version is online: http://basex.org/ Looking forward to your feedback as usual. Have a nice time, Christian

4 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk