June 2014 - BaseX-Talk - mailman.uni-konstanz.de

Full text score with or
by Andy Bunce 23 Nov '14

23 Nov '14

Hi, I want to score searches with multiple conditions e.g. let $data:=( <r><a>red apple</a></r>, <r><a>blue lagoon</a></r>, <r>fish and chips</r>) for $hit score $s in $data[ a contains text("red") or b contains text("fish")] return $s In 7.8.2 it always returns scores of zero. In version 7.6 it returns numbers like 0.6201145069582775 0.4528324252639413 Is this bug? Regards /Andy

2 3

stream binary responses from http:module
by Johan Mörén 10 Nov '14

10 Nov '14

Hi I have built a small client in XQuery that fetches zip files from another remote service using the http-module and stores them on disk with the help of the file-module. Some of the returned zip files are really large and BaseX seems to need to materialize the files in memory before writing them to disk resulting in out of memory errors for some files. Is there some way read the response in a more streamable fashion when using the http-module? I tried using the fetch:binary function successfully but i really need the more extended functionality of the http-module. #results in out of memory if the zip file is too large file:write-binary("file.zip", http:sendrequest(...)[2]) #works all the time. file:write-binary("file.zip", fetch:binary(...)) Regards, Johan

3 7

JSON or JSONML output formatting
by Zachary Pride 16 Jul '14

16 Jul '14

Hello, I've been playing with BaseX lately and all-in-all am very impressed. Something I'm wrestling with however is the JSON output options. I've got various web applications that would really be simplified by receiving JSON straight away for the obvious scripting benefits. The JSON method has been giving me a lot of grief, stipulating rules I'm not sure how to follow. right now I have an element that "is typed as string and cannot be nested." I've been able to get JSONML to output but the JSON is this morass of nested Arrays... Attributes seem to get transformed into Objects but elements/tags and their values are pushed into Arrays for some rationale - which I suppose is on purpose. My question is how can I get Objects for simple key:value properties from <tag>value</tag> 's. Are there options I'm not utilizing? Would it be feasible to transform the XML output to some middle form first - setting it up to become Objects, before serializing it to JSON? Thanks! Zach Pride Associate Software Engineer Ultra Electronics, ProLogic 1000 Green River Drive, Ste. 201 Fairmont, WV 26554 zachary.pride(a)ultra-prologic.com Tel: +1 304 333 2680 ext.308 www.ultra-prologic.com This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. Please consider the environment before printing this email.

4 4

Status of multipart
by Marco Lettere 08 Jul '14

08 Jul '14

Hello all, I would like to know what the status of multipart HTTP request currently is. I read from the docs that it's experimental but to me it feels like there's currently a regression (is there any working example?). I have some requests that were working correctly up to 7.6.1 AFAIR. From 7.8 on (including latest) I always get this error message when posting multipart requests: <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/> <title>Error 400 Stopped at .../restxq.xqm, 106/10: [experr:HC0004] Invalid request element: No body specified for http:part.</title> </head> <body> <h2>HTTP ERROR 400</h2> Problem accessing /multipart. Reason: <pre> Stopped at /home/lettere/Desktop/basex80/webapp/restxq.xqm, 106/10: [experr:HC0004] Invalid request element: No body specified for http:part.</pre> <hr /> Powered by Jetty:// [...] </body> </html> This is the entry point: declare %restxq:path("multipart/") %restxq:POST("{$message}") %restxq:consumes("multipart/form-data") %output:method('xml') function page:hello2($message) { <response> <title>Hello!</title> content <info>It seems you posted a message: { $message }</info> </response> }; and finally this is the HTTP request: POST /multipart HTTP/1.1 Host: localhost:9000 Connection: keep-alive Content-Length: 162 Cache-Control: no-cache Origin: chrome-extension://fdmmgilgnpjigdojojpjoooidkmcomcm User-Agent: Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/35.0.1916.153 Safari/537.36 Content-Type: multipart/form-data; boundary='bounds' Accept: */* Accept-Encoding: gzip,deflate,sdch Accept-Language: en-US,en;q=0.8,it;q=0.6 --bounds Content-Disposition: content Content-Type: application/xml <a/> --bounds Content-Disposition: metadata Content-Type: application/xml --bounds Thanks a lot, Marco.

2 4

Fwd: [homebrew] basex 7.9 (#30567)
by Jens Erat 30 Jun '14

30 Jun '14

For Mac users: I just bumped BaseX in Homebrew to the current stable version, which just got merged; the update is available by running `brew update && brew upgrade basex`. Regards, Jens -- Jens Erat [phone]: tel:+49-151-56961126 [mail]: mailto:email@jenserat.de [jabber]: xmpp:jabber@jenserat.de [web]: http://www.jenserat.de PGP: 350E D9B6 9ADC 2DED F5F2 8549 CBC2 613C D745 722B Anfang der weitergeleiteten Nachricht: > Von: Jack Nagel <notifications(a)github.com> > Betreff: Aw: [homebrew] basex 7.9 (#30567) > Datum: 30. Juni 2014 20:10:23 MESZ > An: Homebrew/homebrew <homebrew(a)noreply.github.com> > Kopie: JensErat <email(a)jenserat.de> > Antwort an: Homebrew/homebrew <reply+i-36812713-074b4b3bd0666d8347aeec3afda43592bb6e49e4-628441(a)reply.github.com> > > Closed #30567 via 98fffb2. > > — > Reply to this email directly or view it on GitHub. >

1 0

Java interop (java.net.URI) problem
by Marc van Grootel 29 Jun '14

29 Jun '14

Hola, So, this is my very first post here. I started my first 'serious' xquery project after doing xslt mostly for a long long time. Soon I hope to put something on github. I needed to parse information from a URL and thought I could use java.net.URI instead of doing the hairy URI string parsing myself. As far as I can see this should work according to the documentation. But it's not: declare namespace uri = "java.net.URI"; let $uri := uri:new('http://basex.org') return uri:get-host($uri) It gives me: [FORG0006] Invalid call of Java function: URI.getHost(xs:anyURI). Any idea what I'm doing wrong here? --Marc

2 4

BaseX 7.9: The Summer Edition
by Christian Grün 29 Jun '14

29 Jun '14

Dear subscribers, in the midst of summertime, we provide you with a great new version of BaseX, our XML database system and XQuery 3.0 processor! This is what you get: XQUNIT - Unit testing has been improved a lot. All test functions will now be evaluated separately; this way, updates can be performed within test. - with the new TEST command, all test modules in a specified directory can be evaluated. - tests can be invoked from within the GUI editor and project view. - on command-line, the -t flag can be used for the same purpose. RESTXQ - Custom HTTP methods can be defined via %rest:method - Error handling has been improved and aligned with try/catch REST - The "run" operation allows execution of server-side command scripts DATABASE MODULE - parsing options added to db:create, db:add and db:replace As usual, various minor bugs and inconsistencies have been fixed in the latest version; check out our documentation and the GitHub history for more details! The latest version is available at http://basex.org. We are looking forward to your feedback, Christian BaseX Team

2 4

BaseX 8.0 and millions of documents
by Fabrice Etanchaud 26 Jun '14

26 Jun '14

Dear all, Will BaseX 8.0 address the speed problem when it comes to replace a document in a several millions documents' collection ? Currently, I have to insert documents in a XML master document and then use XQuery update to replace them. Using replace would be so simple ! Best regards, Fabrice Questel/Orbit

2 1

How to prevent formatting of specific nodes
by Erdal Karaca 26 Jun '14

26 Jun '14

Hi, Using org.basex.io.serial.Serializer to serialize nodes from a DB, I want to be able to prevent formatting/indentation of specific nodes. For example: <body> <pre>test</pre> </body> When serializing something like that, the output will be: <body> <pre> test</pre> </body> The desired output would be: <body> <pre>test</pre> </body> I.e. the pre elements must not be indented. I only found this parameter for the serializer cdata-section-elements Which I guess would enclose the contents of the pre elements by CDATA: <body> <pre><![CDATA[test]]></pre> </body> Which would not be the desired output. Thanks!

2 3

URN as library module namespace
by Carl Leitner 26 Jun '14

26 Jun '14

Hi, I am trying to do a “REPO INSTALL” a library module which has a namespace which is an URN, urn:ihe:iti:csd:2013, but am receiving the error: [bxerr:BXRE0002] Namespace URI is invalid: 'urn:ihe:iti:csd:2013'. I noticed that URNs are not discussed here: http://docs.basex.org/wiki/Repository#URI_Rewriting Taking a look here: http://www.w3.org/TR/2014/REC-xquery-30-20140408/#doc-xquery30-ModuleDecl I don’t see anywhere where URNs are explicitly disallowed. Any suggestions would be appreciated. Cheers, -carl

3 2

StaticFunc expression: no updating expression allowed with db:add()
by Daum, Simon 26 Jun '14

26 Jun '14

Hi Arve - that solves my problem! Thanks a lot Regards Simon -----Ursprüngliche Nachricht----- Von: Arve Gengelbach [mailto:ag@basex.org] Gesendet: Mittwoch, 25. Juni 2014 22:42 An: Daum, Simon Cc: basex-talk(a)mailman.uni-konstanz.de Betreff: Re: [basex-talk] StaticFunc expression: no updating expression allowed with db:add() Hi, How about adding a %updating to the function's annotation: declare %updating function cmd:adToDb(...) {...} Hope this helps, Arve On 25 Jun 2014, at 20:30, Daum, Simon <simon.daum(a)tum.de> wrote: > Hi there, > > I have a question about the db:add() function if it is included in a xquery function which is installed as module in the repo. > > As I set up this function in a module > > declare function cms:addToDb($dbName as xs:string, > $rootNodeAndFileName as xs:string, $content) { > db:add($dbName, concat('<',$rootNodeAndFileName, '>', > $content ,'</',$rootNodeAndFileName, '>'), > concat($rootNodeAndFileName, ".xml")) }; > > > And call it from the GUI app I get: > [XUST0001] StaticFunc expression: no updating expression allowed. > > The error code say something about granting permissions but also states that "Permissions are only relevant in the client/server architecture: the Standalone Mode and the GUI is run with admin permissions." > Any tip from the BaseX'ers? > > Regards Simon > > > - - - - - - - - - > > Dipl.-Ing. Simon Daum > Lehrstuhl für Computergestützte Modellierung und Simulation Technische > Universität München Arcisstraße 21 > D-80290 München > > Tel: +49 89 289 25065 > Fax: +49 89 289 25051 > Web: www.cms.bv.tum.de > > - - - - - - - - -

1 0

Error XUST0001 for fold-left ?
by Maximilian Gärber 26 Jun '14

26 Jun '14

Hi, I just tried a previously (7.8-Snapshot) working application with 8.0-Snapshot and got: Stopped at /intersect-nodes.xqm, 22/13: [XUST0001] fn:fold-left(items,zero,function): all expressions must be updating or return an empty sequence. but there are no updates applied in this function (or ones calling this function): declare %public function _:intersect( $map as map(*)) as node()* { fold-left( map:keys($map), $_:ALL, function($s1, $key as item()*) { let $s2 := $map($key), $a1 := _:all($s1), $a2 := _:all($s2) return if($a1) then if($a2) then $_:ALL else $s2 else if($a2) then $s1 else $s1 intersect $s2 } ) Any ideas? Regards, Max

2 4

StaticFunc expression: no updating expression allowed with db:add()
by Daum, Simon 25 Jun '14

25 Jun '14

Hi there, I have a question about the db:add() function if it is included in a xquery function which is installed as module in the repo. As I set up this function in a module declare function cms:addToDb($dbName as xs:string, $rootNodeAndFileName as xs:string, $content) { db:add($dbName, concat('<',$rootNodeAndFileName, '>', $content ,'</',$rootNodeAndFileName, '>'), concat($rootNodeAndFileName, ".xml")) }; And call it from the GUI app I get: [XUST0001] StaticFunc expression: no updating expression allowed. The error code say something about granting permissions but also states that "Permissions are only relevant in the client/server architecture: the Standalone Mode<http://docs.basex.org/wiki/Standalone_Mode> and the GUI<http://docs.basex.org/wiki/GUI> is run with admin permissions." Any tip from the BaseX'ers? Regards Simon - - - - - - - - - Dipl.-Ing. Simon Daum Lehrstuhl für Computergestützte Modellierung und Simulation Technische Universität München Arcisstraße 21 D-80290 München Tel: +49 89 289 25065 Fax: +49 89 289 25051 Web: www.cms.bv.tum.de<http://www.cms.bv.tum.de> - - - - - - - - -

2 1

Running and accessing BaseX on OpenShift
by P.C. 24 Jun '14

24 Jun '14

Hello, I'm trying to use BaseX on the OpenShift PaaS. My setup: First, I have set up an application in Openshift. This application has a Tomcat 7 (JBoss EWS 2.0) cartridge. I deploy Web applications to it by sending the WAR with an SFTP client. I would like to start a BaseX server so that the servlets in this application can use it as clients. Then, I have successfully created a DIY (Do It Yourself) application by following the instructions outlined here: https://github.com/Quodatum/openshift-basex-quick-start Now, the BaseX server is running in my DIY gear, and I know it is working because I'm able to log into the gear via SSH, running BaseXClient via the remote console and connecting with the BaseX server. My question is, how do I connect to this server from my Tomcat application?

2 1

strip namespaces
by Daum, Simon 24 Jun '14

24 Jun '14

Hi there, is there possibility to strip xml namespaces during input via the c# client api. In the GUI there is a checkbox "strip namespaces" in the "new database" panel. I want to use this in a command like this: session.Execute(@"create db xObermayer E:\Dev\BaseX\04_Obermeyer.xml"); so I dont have to use the namespace stuff like in this query: var result = session.Execute("XQUERY declare namespace exp=\"urn:oid:1.0.10303.28.2.1.1\" ; declare namespace" + " doc=\"urn:oid:1.0.10303.28.2.1.3\"; declare namespace ifc=\"http://www.iai-tech.org/ifcXML/IFC2x2/FINAL\";" + " for $x in /doc:iso_10303_28/*/ifc:IfcRelContainedInSpatialStructure return $x"); Regards Simon - - - - - - - - - Dipl.-Ing. Simon Daum Lehrstuhl für Computergestützte Modellierung und Simulation Technische Universität München Arcisstraße 21 D-80290 München Tel: +49 89 289 25065 Fax: +49 89 289 25051 Web: www.cms.bv.tum.de<http://www.cms.bv.tum.de> - - - - - - - - -

2 1

Delivery reports about your e-mail
by mbigge＠hvc.rr.com 20 Jun '14

20 Jun '14

1 0

Mail System Error - Returned Mail
by youtubeer＠youtuber.com 20 Jun '14

20 Jun '14

Your message was not delivered due to the following reason(s): Your message could not be delivered because the destination server was unreachable within the allowed queue period. The amount of time a message is queued before it is returned depends on local configura- tion parameters. Most likely there is a network problem that prevented delivery, but it is also possible that the computer is turned off, or does not have a mail system running right now. Your message was not delivered within 8 days: Host 139.201.80.56 is not responding. The following recipients did not receive this message: <basex-talk(a)mailman.uni-konstanz.de> Please reply to postmaster(a)youtuber.com if you feel this message to be in error.

1 0

Returned mail: Data format error
by The Post Office 20 Jun '14

20 Jun '14

This message was not delivered due to the following reason: Your message could not be delivered because the destination computer was unreachable within the allowed queue period. The amount of time a message is queued before it is returned depends on local configura- tion parameters. Most likely there is a network problem that prevented delivery, but it is also possible that the computer is turned off, or does not have a mail system running right now. Your message could not be delivered within 8 days: Host 90.79.153.238 is not responding. The following recipients did not receive this message: <basex-talk(a)mailman.uni-konstanz.de> Please reply to postmaster(a)mailman.uni-konstanz.de if you feel this message to be in error.

1 0

Big XML file
by Erol Akarsu 20 Jun '14

20 Jun '14

I have about 9G xml file and like to process with basex. But I am getting out of memory erroe (with setting -Xmx7G). Yesterday, I was able to process like this where $rawProductsFile is the name of big xml file. XML file consists of "Products" elements and process them one by one and write result into a file. But today, it is out of memory exception. let $res := for $doc in fn:doc($rawProductsFile)//Products let $list:= for $tname in $tables let $rows := ($doc[fn:name() eq $tname]|$doc//table[@name eq $tname]) let $list2 := local:processOneProd ($tname,$rows,$tableMap) let $fw := file:append(fn:concat($tablesFolder,$tname,".xml"),$list2) return $fw return $list Which way is good to process large xml file like this, process each element one be one? I appreciate your help Erol Akarsu

2 4

Einzigartige Rezepte, die Körperfett schmelzen lassen
by Marie Koertig 19 Jun '14

19 Jun '14

To stop receiving these emails:http://mail0.metabolischabnehmen.biz/unsubscribe.php?M=95108&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo! Kochen kann schwierig sein, wenn man gerne Körperfett loswerden möchte; wir alle wissen das. Aber ich habe heute sehr gute Neuigkeiten für Sie! Ich empfehle Ihnen dringend, diese Tipps in der Küche umzusetzen, wenn Sie schlanker werden möchten, beim Kochen Zeit einsparen wollen und Ihren Gerichten einen ÜBERIRDISCHEN Geschmack verleihen möchten: Mein TOP-Rezeptbuch für den Abbau von Fett: http://www.metabolischabnehmen.biz <--- sehen Sie, wie lecker das ist In Kürze zusammengefasst: Was ist „metabolisches Kochen“? Vereinfacht gesagt, handelt es sich dabei um eine einzigartige Art der Zubereitung von Speisen, bei der Nährstoffe miteinander kombiniert werden, die insbesondere auf ein BESCHLEUNIGTES Dahinschmelzen von Körperfett ausgerichtet sind. Und das liebe ich ganz besonders am metabolischen Kochen: 1. Die Rezepte bedienen sich Nahrungsmitteln, welche eine hohe metabolische Thermoaufladung aufweisen; hierdurch werden mehr Kalorien auf schnellere Weise verbrannt, ohne Einschränkungen beim Geschmack hinnehmen zu müssen... 2. Diese Form des Kochens wurde speziell für den Kampf gegen das metabolische Anpassungsphänomen entwickelt: Dieses Phänomen tritt auf, wenn Sie eine Diät machen und dabei ganz plötzlich nicht mehr an Körperfett abnehmen! Die BESTEN Rezepte zum schnelleren Fettabbau: http://www.metabolischabnehmen.biz <--- megaleckere Rezepte, die das Körperfett nur so schmelzen lassen m.f.G, Marie Koertig

1 0

new booking 2014-06-18
by 船公司 18 Jun '14

18 Jun '14

Jeter Shipping (Guangzhou) Ltd.广州即达—全广州最大的散货拼柜庄家！即达船务专业拼箱20载，一直与外运仓和多家船公司有良好合作关系，代理遍布全球，直拼港口众多，船期稳船期多。固定有二截五开，四截二开。五截三开等。精品航线众多：东南亚、中东印巴、欧洲地中海、澳洲新西兰、美加。南非和巴拿马、墨西哥等船期非常好。目的港直接代理方便掌控物权和解决目的港清关事宜。（请您花一点点时间看一眼，也许会为您节省不少成本！感谢您的支持！）价格是死的，人是活的，我从来不奢求太多利润，你我都有的赚才是最好的，真诚希望与您实现双赢。用心做人，以诚待人。期待与您合作。请相信我。三大优势 1. 广州拼箱大庄家，操作专业、海运价格低、船期最稳 2. 报关实力强，可接仿牌、液体、粉末、食品等敏感货物 3. 一站式服务，可上门提货，代办各类出口证书、打托、贴唛等 | 目的港(Destination) | 海运费USD/CBM | 黄埔截关 | 黄埔开船 | T/T（天） | Carrier | | 迪拜（DUBAI） | 0 | 周二 | 周五 | 13 | YML/WHL | | 亚历山大(ALEXANDRIA) | 10 | 周二 | 周五 | 25 | CSCL | | 仁川（INCHON） | 0 | 周二 | 周五 | 5 | TSL | | 海防（HAIPHONG） | 1 | 周二 | 周五 | 5 | TSL | | 雅加达（JAKARTA） | 0 | 周二 | 周五 | 5 | WHL | | 鹿特丹（ROTTERDAM） | 0 | 周二 | 周五 | 23 | CSCL | | 安特卫普（ANTWERP） | 0 | 周二 | 周五 | 27 | CSCL | | 利哈佛尔（LE HAVRE） | 0 | 周二 | 周五 | 21 | CSCL | | 热那亚（GENOA） | 0 | 周二 | 周五 | 21 | YML | | 伊斯坦布尔（Istanbul） | 0 | 周一 | 周四 | 17 | YML | | 悉尼/墨尔本（SYD/MEL） | 0 | 周二 | 周五 | 13 | CSCL | | 奥克兰（AUCKLAND） | 5 | 周二 | 周五 | 18 | CSCL | | 多伦多（Toronto） | 55 | 周二 | 周五 | 25 | CSCL | | 温哥华（Vancouver） | 30 | 周二 | 周五 | 18 | CSCL | | 纽约（New York） | 10 | 周二 | 周五 | 25 | CSCL | 《《欢迎咨询全球港口价格》》最后恭祝各位生意兴隆，万事顺意！询价请发邮件到：344690306@qq.com/sales-15@jeter.com.cn 专做国际海运散货，海运价格低、通关实力强、可接仿牌，粉末，液体等敏感物品，附带服务好，提供散货一条龙运输服务。柜货：由于船东方面没有具体很固定的柜货价格，所以主要是看每个时期的不同价格有浮动，但可以肯定的一点，我们作为国际代理，绝对能够拿到市场的最低价格，因此有货的朋友来电咨询保证有惊喜让你们的利润空间完全打开~！各航线对应签约船东：南美线：ZIM 、EMC、 MSK船东非洲线：MSC、MSK、delmas 中东印巴：OOCL 、CSCL、WHL、HJ、APL 东南亚：YML、H-A、APL、玛丽亚、KMTC等多家近洋线船东欧洲线：CSCL YML等船东 --Tks./Best Regards ＾＿＾业务经理：彭家钊HerryPeng 13450363012 （手机） MSN: pjiazhao(a)hotmail.com QQ:344690306 ------------------------------------------------------------------------------ Jeter Shipping (Guangzhou) Ltd. 广州即达船务运输有限公司 (MOC-NY0446) Room 904-909.Glorious Tower,No.850 Dongfeng Road East,Guangzhou 510600 China 广州市东风东路850号锦城大厦904-909室邮编：510600 Mob:13450363012 Tel:020-87348545 Fax:020-87346274/5/6/7 Email：sales-15(a)jeter.com.cn 如不想收到此类邮件/或是重复多收，请来信告知，我将会及时处理，对此给您造成的不便还请谅解！=^_^=

1 0

Re: [basex-talk] How to run several commands in one post
by Christian Grün 18 Jun '14

18 Jun '14

Hi Arjan (cc to the list), >> But then it is also not possible to start-up some existing server side script that way? I've added another idea to the reopened GitHub issue [1]: we could extend the "run" operation [2] to also support command scripts. Christian [1] https://github.com/BaseXdb/basex/issues/559 [2] http://docs.basex.org/wiki/REST#Operations

1 1

Difference in query behavior between BaseX 7.7 beta and BaseX 7.8.2
by Srinivasan Muthu 17 Jun '14

17 Jun '14

We have been using BaseX 7.7 beta for a while and recently we switched to 7.8.2 and found two queries failed with the existing unit tests. After research, we found that the query is now getting compiled into a different optimized query (from 7.7) and results in evaluating a variable, even if that variable will never be used, as it is inside an IF condition for particular input. Here is the query: ------------------------------------------------------------------ declare function local:addPrefix($arg as element()?){ concat("prefix-", $arg) }; let $a := <a> 1 2 3 </a> let $prefixed-data:= <ele>{local:addPrefix($a/b)}</ele> return if (exists($a/c)) then ( $prefixed-data ) else ( 'no input data' ) ------------------------------------------------------------------ In BaseX 7.7beta the output is 'no input data' which is correct. Here $prefixed-data does not get evaluated in BaseX 7.7 beta, as exists($a/c) is FALSE. The optimized query in GUI also shows '$prefixed-data' variable removed. Here is the optimized query in BaseX 7.7 beta: *Compiling:* - rewriting for tail calls: Q{ http://www.w3.org/2005/xquery-local-functions}addPrefix - rewriting fn:exists($a/c) - inlining let $prefixed-data := element ele { (local:addPrefix($a/b)) } - removing variable $prefixed-data *Optimized Query: * declare function local:addPrefix($arg as element()?) { fn:concat("prefix-", $arg) }; let $a := element a { (element b { ("1") }, element b { ("2") }, element b { ("3") }) } return if($a/c) then element ele { (local:addPrefix($a/b)) } else "no input data" ------------------------------------------------------------------ In BaseX 7.8.2 the query throws an error. In 7.8.2, $prefixed-data gets evaluated even though the 'IF" condition is FALSE. See optimized query from GUI here: *Error:* Stopped at C:/source/perforce/PSODepot/health-analyzer/ha-rel504/libs/catalog/src/main/resources/analysis/vsphere/6.5/CO-001/file3, 1/18: [XPTY0004] Cannot treat item() sequence as element()?: (..., ..., ...). Compiling: - inlining Q{http://www.w3.org/2005/xquery-local-functions}addPrefix#1 - inlining let $arg_3 as element()? := $a_1/b - simplifying flwor expression - rewriting fn:exists($a_1/c) *Query:* declare function local:addPrefix($arg as element()?){ concat("prefix-", $arg) }; let $a := <a> 1 2 3 </a> let $prefixed-data:= <ele>{local:addPrefix($a/b)}</ele> return if (exists($a/c)) then ( $prefixed-data ) else ( 'no input data' ) *Optimized Query:* let $a_1 := element a { (element b { ("1") }, element b { ("2") }, element b { ("3") }) } let $prefixed-data_2 := element ele { (fn:concat("prefix-", ((: element()?, true :) $a_1/b))) } return if($a_1/c) then $prefixed-data_2 else "no input data" Query plan: <QueryPlan> <GFLWOR> <Let> <Var name="$a" id="1"/> <CElem> <QNm value="a" type="xs:QName"/> <CElem> <QNm value="b" type="xs:QName"/> <Str value="1" type="xs:string"/> </CElem> <CElem> <QNm value="b" type="xs:QName"/> <Str value="2" type="xs:string"/> </CElem> <CElem> <QNm value="b" type="xs:QName"/> <Str value="3" type="xs:string"/> </CElem> </CElem> </Let> <Let> <Var name="$prefixed-data" id="2"/> <CElem> <QNm value="ele" type="xs:QName"/> <FNStr name="concat(atom1,atom2[,...])"> <Str value="prefix-" type="xs:string"/> <TypeCheck type="element()?" function="true"> <IterPath> <VarRef> <Var name="$a" id="1"/> </VarRef> <IterStep axis="child" test="b"/> </IterPath> </TypeCheck> </FNStr> </CElem> </Let> <If> <IterPath> <VarRef> <Var name="$a" id="1"/> </VarRef> <IterStep axis="child" test="c"/> </IterPath> <VarRef> <Var name="$prefixed-data" id="2"/> </VarRef> <Str value="no input data" type="xs:string"/> </If> </GFLWOR> </QueryPlan> ------------------------------------------------------------------ We wanted to make sure that this is due to the way queries are executed differently now in BaseX 7.8.2 and not a bug in BaseX 7.8.2. Removing the unused variable makes sense for optimization purposes, so it looks like 7.7 was doing the right thing. Can you confirm please? Thanks, Srini

3 5

Die Wahrheit über Diabetes
by Karolin Hertzog 17 Jun '14

17 Jun '14

To stop receiving these emails:http://mail0.diabetesblog.biz/unsubscribe.php?M=75921&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo, Falls Sie unter Diabetes leide, dann könnte Ihnen dieser Artikel sehr behilflich sein: 3 Geheimnisse zum Fett verbrennen und Blutzucker verbessern: http://www.diabetesblog.biz Diese 3 Tipps sind einfach und Sie können diese „Geheimnisse“ sofort verwenden. Klicken Sie hier um den Artikel zu lesen: http://www.diabetesblog.biz mit freundlichen Grüßen, Karolin Hertzog

1 0

RESTXQ declare base-uri ".";
by Andy Bunce 17 Jun '14

17 Jun '14

Hi, It seems that in restxq mode relative paths for *declare base-uri* are resolved differently [1]. If I have -webapp --folder1 ---mod1.xqm (which has import module namespace xm='test' at 'mod2.xqm';) ---mod2.xqm The import works. If I add declare base-uri "."; to mod1. the import fails, running the same code not via restxq and it works. Is this intended behavior? /Andy [1] http://www.w3.org/TR/2014/REC-xquery-30-20140408/#id-base-uri-decl

2 7

Basex 404
by Lars Johnsen 16 Jun '14

16 Jun '14

I've recently run into a problem with basexserver/basexhttp. The host:8984 responds but seems to have lost contact with the webapp directory. Here is what is happening on 3 out of 5 installations (on linux - installed by unpacking the latest ziparchive), where one used to work as expected: 1) host:8984 do not display the restxq example, but is up and running 2) host:8984/rest shows the list of databases 3) host:8984/rest/run=script-name.xq gives 404 - no function matches request So the server appears to be connected to the database, but won't look at the webapp directory. Where is the best place to look for information? All the best, Lars

2 1

Strategies for "checkout" or explicit file locking
by Alister Pillow 16 Jun '14

16 Jun '14

Hi all, BaseX doesn’t appear to have explicit document-level access control (ownership and permissions). I understand that Write and Read locks are applied during queries - but these are not explicit and only apply during the course of the query. I wonder what strategies other people use to lock a file for “editing”, or “checkout” a file so that only a single user has access (in a multi-user environment). Does anyone manage more than a few users within one instance of BaseX? (e.g. more than 10) Thanks, Alister.

2 1

Multiple basex webapps in same Tomcat
by Marco Lettere 16 Jun '14

16 Jun '14

Hello all, in one of our use cases we have two basex (7.8.1) that run as standalone servers. They act mainly as service wrappers so we mainly use restxq and http client. Only one has a very limited access to the DB functionality. The pattern is that one of the two is called from a tomcat webapp installed on the same machine. It then calls the second which in turn calls another service on a different machine. All of the calls are HTTP. Anyway we have been asked to condense the installation into the same tomcat. I've been trying that but when I install multiple basex webapps I get strange conflicts in the RESTXQ engine. I was able to reproduce the issue just by exploding two wars (named bx1.war and bx2.war) into the tomcat. Then I've altered the "hello/{$world}" annotated example in restxq.xqm to return "hello world 1" and "Hello world 2". At that point whatever context I use in the browser (either bx1 or bx2) I always get "Hello world 2" as a return. I've tried changing the namespace of the module of restxq.xqm and also changing the servlet context for RESTXQ in bx2 but nothing changes. Could you provide me some hints on this? Thanks, Marco.

2 2

Efficiently using BaseX and JAXB
by Zachary DeLuca 10 Jun '14

10 Jun '14

Hello, I have a question about unmarshaling a query result into JAXB object(s). My database collection contains documents that all contain the same type of root element, let's call it Element1. Originally I was doing something like this (I know it's silly but it worked just fine for small data sets): String CLOSING_TAG = "</Element1>"; Context context = ... Unmarshaller um = ... String predicate1 = ... String predicate2 = ... String query = "//Element1[" + predicate1 + " and " + predicate2 + "]"; String result = new XQuery(query).execute(context); if (result != null && !result.isEmpty()) { ArrayList<Element1> elements = new ArrayList<>(); int index = -1; int beginIndex = 0; while ((index = result.indexOf(CLOSING_TAG, beginIndex)) != -1) { int endIndex = index + CLOSING_TAG.length(); String element1 = result.substring(beginIndex, endIndex); beginIndex = endIndex + 1; elements.add(((Element1) um.unmarshal(new ByteArrayInputStream(element1.getBytes())))); } // do something with the elements } But when I got into larger data sets (my DB collection is currently approx. 1GB total size and has just over 20k documents) this started to fail apparently due to trying to convert the entire result to a string at one time (out of memory error, despite setting -Xmx16384m). So I dig through the examples to find a better way and changed my code to this: ByteArrayOutputStream baos = new ByteArrayOutputStream(); Iter iter = null; Serializer ser = null; QueryProcessor proc = new QueryProcessor(query, context); iter = proc.iter(); ser = proc.getSerializer(baos); proc.close(); if (iter != null && ser != null) { ArrayList<Element1> elements = new ArrayList<>(); for(Item item; (item = iter.next()) != null;) { baos.reset(); ser.serialize(item); elements.add(((Element1) um.unmarshal(new ByteArrayInputStream(baos.toByteArray())))); } ser.close(); // do something with the elements } This appears to work fine but I am just wondering if there is a better/faster way to do it? At first glance, serializing to a ByteArrayOutputSream only to then turn around and use a ByteArrayInputStream to unmarshal with JAXB seems wasteful. Thanks for taking the time to read, Zach

2 4

BaseX Design
by Vaibhav Khare 07 Jun '14

07 Jun '14

Hi, I have a requirement to build XML repository where I will store millions of XML documents (size may vary) based on some unique Ids (one level path like - \10). For another operation, I need to compare the incoming XML document with the stored XML document for any changes. 1. Can any of you please let me know on how to implement this in BaseX? Apart from inserting the XMLs and comparing them with the incoming XML, there is no other query required. 2. Performance is the major criteria for this. Do you think BaseX will be able to handle this as the repository size grows? Also, is there a way to do batch processing of the above operations to improve performance? Thanks in advance, ~ VK

2 1

Wie ich meinen Tinnitus kuriert habe
by Jessica Neustadt 06 Jun '14

06 Jun '14

To stop receiving these emails:http://mail0.tinnitusdoktor.me/unsubscribe.php?M=76094&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo, Falls Sie oder jemand Ihrer Lieben an Tinnitus leidet, dann ist dies das wichtigste Schreiben, das Sie jemals gelesen werde. Wissen Sie, was die Ursachen für Tinnitus sind? Dieser GRATIS-Artikel wird Sie darüber aufklären: http://www.tinnitusdoktor.me Wachen Sie manchmal mitten in der Nacht auf und hören komische Geräusche? Ja, das kann wirklich angsteinflößend sein, vor allem, wenn Sie nicht wissen, wo diese Geräusche herkommen. Klicken Sie hier, um den Artikel zu lesen und herauszufinden, wie Sie Tinnitus kurieren können: http://www.tinnitusdoktor.me Mit freundlichen Grüßen, Christine Weiss

1 0

BaseX 7.8.2: The Spring Edition
by Christian Grün 06 Jun '14

06 Jun '14

Dear subscribers, today we are please to provide you with BaseX 7.8.2, the Spring Edition! This is what you can expect (find more details in our changelog): * GUI Editor: Efficiently sort large texts (Ctrl-U) * Storage, Updates: Faster processing of documents with namespaces * Database Module: alter, copy, create-backup, drop-backup, restore * Admin Module: new merge option, existing functions revised * XQuery Module: new evaluation options (memory, timeout, permissions) * XQuery: always show full stack trace (enforce it with INLINELIMIT=0) * XQuery Ester egg: calculating partial sums (little Gauss) * Client/Server architecture: reduce waiting time if password is wrong We invite you to get the latest version via http://basex.org, and we are interested in your feedback, Christian BaseX Team

3 5

mainmem bug?
by Marc 04 Jun '14

04 Jun '14

Hi, I try to use the mainmem flag because I use a temporally base to do some specific treatments and extract it after. But when I create the database it isn't! the easy script : --------------------- set mainmem true create db test list open test ------------------- the result : ------------------ MAINMEM: true Database 'test' created in 0.08 ms. name Resources Size Input Path --------------------------------------------------- baseCo 2 3742851 FichiersBase 5958 5357259729 FichiersBaseTest 5958 5205620197 3 database(s). Database 'test' was not found. -------------------- the infos : -------------- General Information: Version: 7.8 Used Memory: 1994 KB The main memory database doesn't exist anymore? Marc

3 5

Erfahren Sie die schockierende Wahrheit über Hefepilzinfektionen
by Claudia Kuster 03 Jun '14

03 Jun '14

To stop receiving these emails:http://mail0.pilzcandida.me/unsubscribe.php?M=189029&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo, Machen Sie sich selbst schlau zum Thema Candida-Infektionen. Dies ist der erste und wichtigste Schritt zur Heilung dieser schmerzhaften, äußerst lästigen und relativ gefährlichen chronischen Erkrankung. Übernehmen Sie selbst die Verantwortung für Ihre Gesundheit und Ihr Wohlergehen. Das Problem ist, dass ein Großteil der an einer Hefepilzinfektion leidenden Personen sich dafür entscheidet, es anderen zu überlassen , sich darum zu kümmern: Ärzte, Apotheker, Medikamente und rezeptfreie Arzneimittel. Ganz bewusst entscheiden sie sich dafür, für ihre Candida-Infektion, ihre eigene Gesundheit und ihren Körper KEINERLEI Verantwortung zu übernehmen. Klicken Sie hier und lesen Sie mehr dazu: http://www.pilzcandida.me Um TATSACHEN herauszufinden, wie Sie Ihre Hefepilzinfektion tatsächlich und dauerhaft, sozusagen mit der Wurzel und zu 100 % auf natürliche Weise beseitigen können und eine NACHHALTIGE Befreiung von mit Candida verbunden Symptomen erlangen, ohne dafür Ihr schwer verdientes Geld für frei verkäufliche Arzneimittel ausgeben zu müssen... Klicken Sie hier und erfahren Sie mehr: http://www.pilzcandida.me mit freundlichen Grüßen, Christin Strauss

1 0

Re: [basex-talk] [FORG0006] Unknown method:
by Christian Grün 02 Jun '14

02 Jun '14

Hi Erol (cc to the list), > That solved the issue! > Thanks for your help > > I like to know what is difference between xs:int and xs:integer ? Values of type xs:integer may be bigger than Java integers. You'll need BigInteger to accept these values in a Java function. Hope this helps, Christian

2 6

Fw: Increase Performence
by ChandraSekhar 02 Jun '14

02 Jun '14

Dear Team I have collection in gb's ,so I am sending one sample xml along with query.Please give me the tips for performance and please do the need full. Thanks & Regards Chandra Sekhar -----Original Message----- From: Christian Grün Sent: Wednesday, May 28, 2014 1:29 PM To: ChandraSekhar Subject: Re: Reg : Increase Performence Hi Chandra, we clearly need more information to give you hints. Did you e.g. check out the query compilation on the InfoView? Best, Christian PS: To get more information, please write to the basex-talk mailing list. On Wed, May 28, 2014 at 8:12 AM, ChandraSekhar <chandrasekhar.r(a)intense.in> wrote: > Dear Chirstian > > Earlier we are using 6.7 version now we are > migrating this into the latest version,compare to the 6.7 and 7.8.2,In > latest version performance was very high. > But when my collections are in GB'S(we are running the > query's on multiple collections) .Its taking long time and consuming > memory. > Is there any solution that we can handle like this cases. > > > Thanks & Regards > Chandra Sekhar > > -- > This message is for the intended recipient only. If you are not the > intended recipient you are notified that disclosing, copying, > distributing or taking any action in reliance on the contents of the > information is strictly prohibited. > __ -- This message is for the intended recipient only. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of the information is strictly prohibited. __

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk June 2014