March 2018 - BaseX-Talk - mailman.uni-konstanz.de

Global locks
by Andy Bunce 11 Feb '19

11 Feb '19

Running the following in the GUI (8.6.5) ``` let $db:="BEP" return count(collection($db)) ``` The info windows shows $db is inlined Compiling: - inline $db_0 - pre-evaluate collection("BEP") to document-node() sequence - pre-evaluate count((db:open-pre("BEP",0), ...)) to xs:integer - simplify gflwor Optimized Query: 9193 All good. Submitting a job ``` let $q:='let $db:="BEP" return count(collection($db))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` returns: <job id="job90" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.007S" reads="(global)" writes="(none)">let $db:="BEP" return count(collection($db))</job> Note @reads="(global)" But ``` let $q:='count(collection("BEP"))' return jobs:eval($q,(),map{"cache":true()})!(jobs:wait(.),jobs:list-details(.)) ``` <job id="job92" type="ScheduledXQuery" state="cached" user="admin" duration="PT0.006S" reads="BEP" writes="(none)">count(collection("BEP"))</job> Note @reads="BEP" Is this correct and/or of any consequence? /Andy

2 8

BaseX 9.0: The Spring Edition!
by Christian Grün 01 Nov '18

01 Nov '18

Dear BaseX aficionados, We are very happy to announce the release of BaseX 9.0! The new version of our XML database system and XQuery 3.1 processor includes some great new features and a vast number of minor improvements and optimizations. It’s both the usage of BaseX in productive environments as well as the valuable feedback of our open source users that make BaseX better and better, and that allow and motivate us to keep going. Thanks to all of you! Along with the new release, we invite you to visit our relaunched homepage: http://basex.org/. Java 8 is now required to run BaseX. The most prominent features of Version 9.0 are: XQUERY - Comprehensive extensions in the internal XQuery optimizer framework - Dynamic hash joins rewritings of general comparisons - Register query jobs as persistent services - Process very large CSV files via the new CSV 'xquery' format - Update Module: higher-order functions for performing updates - Unified static typing, including maps, arrays and function items - COPYNODE: Lightweight copying of XML fragments - ENFORCEINDEX: Enforce rewriting for index access STORAGE - Improved database compression (short strings, whitespaces) WEB APPLICATIONS - Permissions layer: Unified definition of RESTXQ access patterns - RESTXQ: Full support for client- and server-side quality factors - REST: Run BaseX command scripts - Web server upgrade to Jetty 9 REPOSITORIES - Combined packaging mechanism (XQuery and Java) - Java Packaging: Bundling of additional libraries DISTRIBUTIONS - Revised detection and configuration of BaseX home directory - Windows executable: better detection of Java libraries DBA: BASEX DATABASE ADMINISTRATION - Improved editing and evaluation of XQuery modules - Revised file, session and job management More details can be found on our homepage. We are looking forward to your feedback. Enjoy and have fun, Christian, BaseX Team

7 8

query is not using attribute index with function
by andre weber 09 Apr '18

09 Apr '18

Hi, with the new Version 9 I have encountered a strange performance issue: - Running a simple xpath-query is fast, as it is using the attribute-index. Execution time: 59.19 ms - Putting the same simple xpath-query into a function results in a very poor performance. No use of the attribute-index here. Execution time: 12578.55 ms There where no issues with that in the previous Versions 8.x Here’s the setup… xquery version "3.1"; declare function local:slow_query_here() as node()* { prof:time( db:open("mars","data“)/sec[ @isin = "FR0000125338" ] ) (: 12578.55 ms :) }; let $fast_query_here := prof:time( db:open("mars","data“)/sec[ @isin = "FR0000125338" ] ) (: 59.19 ms :) return local:slow_query_here() Here’s the query plan… <QueryPlan compiled="true" updating="false"> <GFLWOR type="element()*"> <Let type="element()*"> <Var name="$fast_query_here" id="0" type="element()*"/> <ProfTime name="time(value[,label])" type="element()*"> <CachedPath type="element()*"> <ValueAccess index="attribute" type="attribute()*"> <IndexStaticDb name="mars" database="mars"/> <Str type="xs:string">FR0000125338</Str> </ValueAccess> <IterStep axis="self" test="*:base_isin" type="attribute()*"/> <CachedStep axis="parent" test="*:option" type="element()*"> <CachedPath> <IterStep axis="parent" test="*:option_list" type="element()*"/> <IterStep axis="parent" test="*:finance" type="element()*"/> <IterStep axis="parent" test="document-node()" type="document-node()*"/> </CachedPath> </CachedStep> </CachedPath> </ProfTime> </Let> <ProfTime name="time(value[,label])" type="element()*"> <CachedPath type="element()*" database="mars"> <DBNode database="mars" pre="0" type="document-node()"/> <IterStep axis="descendant" test="*:option_list" type="element()*"/> <IterStep axis="child" test="*:option" type="element()*"> <CmpSimpleG op="=" type="xs:boolean" size="1"> <CachedPath type="attribute()?"> <IterStep axis="attribute" test="*:base_isin" type="attribute()?"/> </CachedPath> <Str type="xs:string">FR0000125338</Str> </CmpSimpleG> </IterStep> </CachedPath> </ProfTime> </GFLWOR> </QueryPlan> Any idea what’s causing the performance drop? Thank you for your thoughts! Andre

2 2

Installation problème in Windows 10
by reda chbihi 06 Apr '18

06 Apr '18

Hi everybody, I'm trying to install BaseX90 on my machine (with Windows 10) and it's tell me that I have to install Java before ! I have already installed Java 9, and configure JAVA_HOME and JRE_HOME and the message continue to show up !!! Thank you Regards Mohammed Reda CHBIHI LOUHDI Département Maths-Info FSAC Casablanca Laboratoire LR2I -- UH2

2 5

Python client issue
by Andrey Fedosenko 04 Apr '18

04 Apr '18

session = BaseXClient.Session('localhost', 1984, 'admin', 'admin') session2 = BaseXClient.Session('localhost', 1984, 'admin', 'admin') session2.execute("check database") query = session.query("collection('database')") for code, item in query.iter(): //some item modification session2.replace("{}.xml".format(item_path), modified_item) The execution of the script stops after the first iteration. How can I read and change data in a single cycle? FYI: for a small database, this works correctly.

2 3

web.xml changed in BaseX 90 to servlet 4.0
by Stefania Axo 04 Apr '18

04 Apr '18

hi I downloaded the latest version of BaseX 9.0 I try to deploy on my WebSphere Liberty (WebSphere Application Server V16.0.0.2 )and got an error because the version of the servlet is now 4.0. CWWKZ0002E: An exception occurred while starting the application BaseX. The exception message was: java.lang.IllegalStateException: com.ibm.wsspi.adaptable.module.UnableToAdaptException: com.ibm.ws.javaee.ddmodel.DDParser$ParseException: CWWKC2262E: The server is unable to process the 4.0 version and the http://xmlns.jcp.org/xml/ns/javaee namespace in the /WEB-INF/web.xml deployment descriptor on line 6. BaseX 8.67 web.xml had <web-app xmlns="http://java.sun.com/xml/ns/javaee" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd" version="2.5"> Basex 9.0 web.xml has <web-app xmlns="http://xmlns.jcp.org/xml/ns/javaee" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://xmlns.jcp.org/xml/ns/javaee http://www.oracle.com/webfolder/technetwork/jsc/xml/ns/javaee/web-app_4_0.x… " version="4.0"> I set on the BaseX 90 web.xml the old version of the servlet and that seemed to work. I am not sure if i will encounter other problems though. is the setting necessary in basex 9.0? or am i ok to downgraded for BaseX 90 ? thanks Stefania

2 3

child node problem
by Giuseppe Celano 04 Apr '18

04 Apr '18

Hi All, Thanks for this new release, which looks great! I have found a problem though (see error message below), when running a query like: for $ee in collection("my-path-to-files") where $ee//case[./aspect-values[@sign = "yes"]] return $ee This works in version 8.6.7. The problem seems to be [./aspect-values[@sign = "yes"]]: if I change it in [//aspect-values[@sign = "yes"]] it works fine also in 9.0. Any idea? Thanks. Best, Giuseppe ERROR MESSAGE Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.0 Java: Oracle Corporation, 1.8.0_151 OS: Mac OS X, x86_64 Stack Trace: java.lang.ClassCastException: org.basex.query.value.item.Dummy cannot be cast to org.basex.query.value.node.DBNode at org.basex.query.expr.path.InvDocTest.get(InvDocTest.java:56) at org.basex.query.expr.path.Path.index(Path.java:692) at org.basex.query.expr.path.Path.optimize(Path.java:174) at org.basex.query.expr.path.Path.optimize(Path.java:180) at org.basex.query.expr.path.Path.compile(Path.java:157) at org.basex.query.expr.gflwor.Where.compile(Where.java:53) at org.basex.query.expr.gflwor.Where.compile(Where.java:1) at org.basex.query.expr.gflwor.GFLWOR.compile(GFLWOR.java:101) at org.basex.query.scope.MainModule.comp(MainModule.java:83) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:114) at org.basex.query.QueryCompiler.compile(QueryCompiler.java:105) at org.basex.query.QueryContext.compile(QueryContext.java:299) at org.basex.query.QueryProcessor.compile(QueryProcessor.java:79) at org.basex.core.cmd.AQuery.query(AQuery.java:78) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.gui.GUI.exec(GUI.java:427) at org.basex.gui.GUI.lambda$4(GUI.java:370) at java.lang.Thread.run(Thread.java:748) Compiling: - pre-evaluate fn:collection([uri]) to document-node() sequence: collection("/Users/mycomputer/Documents/... -> (db:open-pre("documents", 0), ...) - rewrite cached path to = operator: *:aspect-values -> (*:aspect-values/@*:sign = "yes") - rewrite cached path to = operator: *:aspect-values -> (*:aspect-values/@*:sign = "yes") - rewrite descendant-or-self step(s) - apply attribute index for "yes" Optimized Query: for $ee_0 in (db:open-pre("documents", 0), ...) where $ee_0/descendant-or-self::node()/descendant::*:case[(*:aspect-values/@*:sign = "yes")] return $ee_0 Query: for $ee in collection("/Users/mycomputer/Documents/act/03_p-valuesAfterReductionToPerfImp/documents") where $ee//case[./aspect-values[@sign = "yes"]] return $ee Universität Leipzig Institute of Computer Science, Digital Humanities Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano(a)informatik.uni-leipzig.de E-mail: giuseppegacelano(a)gmail.com Web site 1: http://www.dh.uni-leipzig.de/wo/team/ Web site 2: https://sites.google.com/site/giuseppegacelano/

2 2

Maven repo 9.0
by Marc van Grootel 31 Mar '18

31 Mar '18

Hi, First of all congrats with the release of the Spring edition. Nice steady pace of quality updates. I wanted to test 9.0 by getting it via de Maven coordinates but noticed that 9.0 wasn't available from the basex Maven repo. Only 9.0-SNAPSHOT and 9.0.1-SNAPSHOT. Is it possible to also make 9.0 available from org.basex:basex-api:9.0 Maven coordinates? --Marc

3 4

Q: Is there a way to update a XML node with subelements
by Harald Freudenberger 30 Mar '18

30 Mar '18

Hello BaseX team I am about to implement a simple web application which displays some items and allows an user to edit one item. So my database is simple: data.xml: <items> <item> <id>1</id> <text>just some text</text> </item> <item> <id>2</id> <text>some other text</text> </item> </items> Now I want to add a new item to this database. For first evaluation I'll use curl to insert a new node with: curl -u admin:admin -i -X PUT -H "Content-Type: application/xml" -d "<item><id>9999</id><text>hello</text></item>" "http://localhost:8984/rest/data/items" The query to check if the new node has been inserted gives: curl -u admin:admin -i -X POST -H "Content-Type: application/xml" -d "<query xmlns='http://basex.org/rest'><text>//item</text></query>" "http://localhost:8984/rest/data" HTTP/1.1 200 OK Content-Type: application/xml; charset=UTF-8 Content-Length: 1416 Server: Jetty(8.1.18.v20150929) <item> <id>1</id> <text>just some text</text> </item> <item> <id>2</id> <text>some other text</text> </item> <item> <id>9999</id> <text>hello</text> </item> Fine. And now I'd like to try the edit an item. I start with fetching the item: curl -u admin:admin -i -X POST -H "Content-Type: application/xml" -d "<query xmlns='http://basex.org/rest'><text>//item[id='9999']</text></query>" "http://10.0.2.2:8984/rest/data" HTTP/1.1 200 OK Content-Type: application/xml; charset=UTF-8 Content-Length: 280 Server: Jetty(8.1.18.v20150929) <item> <id>9999</id> <text>hello</text> </item> Now I do some modifications: <item> <id>9999</id> <text>new text here</text> <newnode>a new node</newnode> </item> And then I want to write back this item with: curl -u admin:admin -i -X POST -H "Content-Type: application/xml" -d "<query xmlns='http://basex.org/rest'><text>replace node /data/items/item[id='9999'] with <item><id>8888</id></item></text></query>" "http://10.0.2.2:8984/rest/crypto" HTTP/1.1 400 Bad Request Content-Type: text/plain;charset=UTF-8 Content-Length: 104 Server: Jetty(8.1.18.v20150929) cvc-type.3.1.2: Element 'text' is a simple type, so it must have no element information item [children]. I tried <command> instead of <query> but the result is always the same. Am I doing something wrong here ? Is there a way to update a node with subelements in BaseX ? Please understand, I am C developer dealing with Linux kernel code most of the time so I am not really familiar with all the web application things. Thanks and regards Harald Freudenberger

2 1

Re: [basex-talk] SSL support for BaseX REST API
by Lizzi, Vincent 22 Mar '18

22 Mar '18

Forwarding to the list... ________________________________ From: Stefania Axo <stefy(a)us.ibm.com> Sent: Wednesday, March 21, 2018 10:05 PM To: Lizzi, Vincent Subject: Re: [basex-talk] SSL support for BaseX REST API ok i was able to set the property of not starting BaseXServer on both Jetty and WebSphere liberty in WEB-INF\web.xml <context-param> <param-name>org.basex.httplocal</param-name> <param-value>true</param-value> </context-param> on the documentation http://docs.basex.org/wiki/Options#HTTPLOCAL<http://docs.basex.org/wiki/Options#HTTPLOCAL> it says "If the option is set to false, the database server will be disabled. " is it the other way around? "If the option is set to true, the database server will be disabled. " thanks Stefania

1 0