- BaseX-Talk - mailman.uni-konstanz.de

xmldb api and child collections
by frans＠planet 27 Mar '11

27 Mar '11

Is it possible to create child Collections within a database through the XMLDB API? And is it possible to insert XMLResources in a child Collection through the XMLDB API? Regards, Frans

2 1

xmldb api and namespace handling
by frans＠planet 26 Mar '11

26 Mar '11

I'am accessing BaseX 6.5.1 through the XMLDB API. There are some issues with namespace handling when storing resources. Let me clarify that with some examples. First example I want to store the following as a resource: String example = "<?xml version=\"1.0\" encoding=\"UTF-8\" ?>" + "<tag xmlns=\"http://example.org\">" + "</tag>"; This yields <tag xmlns="http://example.org"/> in the GUI. So this is OK. Second example I want to store the following as a resource and INTPARSE = false: String example = "<?xml version=\"1.0\" encoding=\"UTF-8\" ?>" + "<tns:tag xmlns:tns=\"http://example.org\">" + "</tns:tag>"; This yields the following exception: org.xmldb.api.base.XMLDBException: "null" (Line 1): The prefix "tns" for element "tns:tag" is not bound Third example I want to store the following as a resource and INTPARSE = true: String example = "<?xml version=\"1.0\" encoding=\"UTF-8\" ?>" + "<tns:tag xmlns:tns=\"http://example.org\">" + "</tns:tag>"; This yields <tns:tag xmlnstns="http://example.org"/> in the GUI. The colon is missing in ' xmlnstns' . So this is not OK. Are the second and third examples bugs or should I change some setting to get a proper handling of namespaces? Regards, Frans

2 4

Fwd: BaseX REST Security
by Andreas Weiler 25 Mar '11

25 Mar '11

Forwarding to mailing-list. Anfang der weitergeleiteten E-Mail: > Von: Jan Vlčinský (CAD) <jan.vlcinsky(a)cad-programs.com> > Datum: 25. März 2011 14:46:47 MEZ > An: Andreas Weiler <andreas.weiler(a)uni-konstanz.de> > Betreff: Re: [basex-talk] BaseX REST Security > > Hi > Let me describe my vision of possible implementation. > Current REST communication would not declare anything about user and password in the xml documents being sent to server as request. > Web server (servlet container) would implement standard security protection to given url - either by means of basic or by means of digest authentication and possibly using https. > BaseX server would have to provide some method, how to let servlet check, that given credentials (username and password) are valid and servlet would use it to authenticate requests (thinking of using JAAS). > Servlet would also use username and password of the REST request to log into BaseX. > > Implementation for basic authentication would be relatively simple, as user provides full password and servlet can reuse it in logging into BaseX. > Using e.g. JAAS, BaseX would implement interface for authentication. > > With digest the situation is a bit more difficult as password from http request is probably unusable for logging into BaseX as it is already arriving somehow scrambled to the web server and reconstrucion is not possible (if I am correct). > Solutions could be > BaseX would have an option to reuse authenticated user and somehow reuse the available password data or simply trusting user, who logged into web server already. > At servlet there would be mapping from (authenticated) username to credentials of BaseX account (username and password). This would be used to log into BaseX. > Both options have some drawbacks and security risks, but we all know, security risk is general feature of almost any method. > The simplest solution could use basic authentication and rely on https encrypting open password over network. > > Just some ideas which came to my mind. > > With best regards > > Jan Vlčinský > > > 2011/3/25 Andreas Weiler <andreas.weiler(a)uni-konstanz.de> > Hi, > > in the BXJaxRX class, you can set String USER and String PASSWORD to use another user than the standard admin user. So each request will be executed/declined regarding these user permissions. > Currently it is not possible to send username/password with single requests to the server in the JAXRX mode. > > -- Andreas > > Am 25.03.2011 um 13:46 schrieb Евгений Хабаров: > > > When connection is made using Language Bindings, client need valid > > login/password to access database. > > When JAXRX is used - user authentication is NOT requested. > > Is it possible to protect JAXRX interface operations? > > _______________________________________________ > > BaseX-Talk mailing list > > BaseX-Talk(a)mailman.uni-konstanz.de > > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > > > -- > Ing. Jan Vlčinský > CAD programy > Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic > tel: +420-597 602 024; mob: +420-608 979 040 > skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com > http://cz.linkedin.com/in/vlcinsky >

3 4

BaseX REST Security
by Евгений Хабаров 25 Mar '11

25 Mar '11

When connection is made using Language Bindings, client need valid login/password to access database. When JAXRX is used - user authentication is NOT requested. Is it possible to protect JAXRX interface operations?

2 1

Serious bug? DB corrupted on Xquery replace
by Charles F. Munat 25 Mar '11

25 Mar '11

I have a database with a structure thus: /data/functions/seminars/seminar I wanted to add some new seminars to this list. I was working from a spreadsheet, which I converted to tab-separated values and then used regular expressions to rewrite each line as a <seminar/> element. I don't know to do multiple replaces in a single query, so I did this instead: let $seminars := /data/functions/seminars let $xs := $seminars/seminar return replace node $seminars with <seminars> {$xs} <seminar/> <seminar/> <seminar/> <seminar/> <seminar/> </seminars> This corrupted the database to the point where it was unusable. (First error was that there were multiple docs. Then I tracked it down to an index out of bounds error.) I had to switch to a back-up copy. I then tried simply inserting the seminars one at a time. This didn't work either. I backed up to BaseX 6.5 and tried again and everything worked perfectly. Have I done something dumb, or is there a problem here? Thanks! Chas.

2 1

Problems with xquery prefix namespace
by Isidro Vila Verde 24 Mar '11

24 Mar '11

Greetings, I am new here and this is my first post. I just start to work with Basex and I am trying to migrate from eXist-db. Until know everything runs well but... I am now facing a little problem. With the xquery bellow the result is not what I expect declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; let $col := collection('invoiceData/invoices') let $invoices := $col/*[not(saf:InvoiceType)] return $invoices This is the result (unexpected) <saf:Invoice xmlns:spi="http://serprest.pt/invoice1" xmlns:saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01" xsi:type="spi:invoiceType" xsi:schemaLocation="http://serprest.pt/invoice1 http://serprest.pt/invoice/invoice.xsd"> <saf:InvoiceNo>257</saf:InvoiceNo> <saf:InvoiceDate>2010-09-21</saf:InvoiceDate> <saf:InvoiceType>Factura</saf:InvoiceType>  [... some stuff deleted here ...] But if I use a wildcard instead of the namespace prefix the result is what is expected declare namespace saf="urn:OECD:StandardAuditFile-Tax:PT_1.00_01"; let $col := collection('invoiceData/invoices') let $invoices := $col/*[not(*:InvoiceType)] return $invoices This is (as expected) the result for the above query <collection xmlns:spi="http://serprest.pt/invoice1" xmlns="http://exist.sourceforge.net/NS/exist" name="/db/invoicingSystem/invoices" owner="admin" group="dba" mode="755" created="2011-02-17T23:15:07Z" version="1"> <resource type="XMLResource" name="1.xml" owner="admin" group="dba" mode="755" created="1970-01-01T01:00:00+01:00" modified="2010-07-27T13:29:12+01:00" filename="1.xml" mimetype="text/xml"/> [... some stuff deleted here ...] Of course, I can still use wildcards but the question is what is wrong with prefix? I am asking because I have a lot of queries using namespaces and now I have no confidence on the results. Thanks in advance Isidro

3 6

BaseX 6.6: XMLPrague Release
by Christian Grün 23 Mar '11

23 Mar '11

Dear all, we are particularly proud to announce the release of BaseX 6.6, which was released for the XMLPrague conference. It offers many new features, such as: -- full support for Higher Order Functions, introduced with XQuery 3.0 (dynamic function invocation, inlined functions, etc.), -- native support of the EXPath ZIP and HTTP specifications and other new XQuery modules, -- a new COPY Command to clone existing databases, -- revised CSV and text importers for different encoding and XML formats, -- additional XQuery 3.0 features (decimal-format and context item declarations, formatting functions, etc.), and -- numerous speedups, reduced memory consumption and stability fixes for XQuery and XQuery Update operations. Feel free to download our new release from http://basex.org, or check out our project page at GitHub for the latest sources. All the best, Christian BaseX Team, 2011

1 0

BaseX 6.6 Beta
by Christian Grün 22 Mar '11

22 Mar '11

Hi everyone, A little pre-announcement: BaseX 6.6 will be released tomorrow. As a major new feature, we now support the full range of Higher Order Functions features introduced with XQuery 3.0, such as dynamic function invocations or inlined functions [1][2]! A preview is available here: http://files.basex.org/releases/latest/ We'll soon include a little tutorial in our Wiki to present the major new features. Thanks to your feedback, we've also managed to fix a bug in our updating storage algorithms, which could be triggered by deleting large XML nodes from an existing database. Feedback is welcome, Christian [1] http://www.w3.org/TR/xpath-functions-30/#higher-order-functions [2] http://www.w3.org/TR/xquery-30 ___________________________ Christian Grün Uni KN, Box 188 78457 Konstanz, Germany http://www.inf.uni-konstanz.de/~gruen

1 0

XQFT and XQUF finalized
by Christian Grün 18 Mar '11

18 Mar '11

Dear members, a quick information to everyone: the XQuery Full Text and XQuery Update Facility specifications have just been finalized: http://www.w3.org/TR/xpath-full-text-10/ http://www.w3.org/TR/xquery-update-10/ This means that our XQFT and XQUF implementation won't be subject to sudden changes anymore. This doesn't apply to XQuery 3.0 yet; we continue doing our best, however, to support all features of the latest XQuery 3.0 working draft. Best, Christian -------- Forwarded Message -------- From: Ian Jacobs <ij(a)w3.org> [...] Dear Advisory Committee Representative, I am pleased to announce two new XQuery Recommendations: XQuery and XPath Full Text 1.0 http://www.w3.org/TR/2011/REC-xpath-full-text-10-20110317/ published by the XML Query Working Group [1] XQuery Update Facility 1.0 http://www.w3.org/TR/2011/REC-xquery-update-10-20110317/ published jointly by the XML Query and XSL Working Groups [2] The W3C Advisory Committee who responded to the calls for review ([3], [4]) supported the publication of the two documents as W3C Recommendations. There was a request that some minor issues arising during the review period be addressed, and this was done. There were no Formal Objections. Please join us in congratulating the groups for their achievement. For Tim Berners-Lee, Director; Ian Jacobs, Head of W3C Communications. [1] http://www.w3.org/XML/Query/ [2] http://www.w3.org/Style/XSL/ [3] http://lists.w3.org/Archives/Member/w3c-ac-members/2011JanMar/0017 [4] http://lists.w3.org/Archives/Member/w3c-ac-members/2011JanMar/0018 ====================================== XQuery and XPath Full Text 1.0 http://www.w3.org/TR/2011/REC-xpath-full-text-10-20110317/ ------ Abstract This document defines the syntax and formal semantics of XQuery and XPath Full Text 1.0, which is a language that extends XQuery 1.0 [XQuery 1.0: An XML Query Language (Second Edition)] and XPath 2.0 [XML Path Language (XPath) 2.0 (Second Edition)] with full-text search capabilities. ------ Status of this Document This is a Recommendation of the W3C. It was jointly developed by the W3C XML Query Working Group and the W3C XSL Working Group, each of which is part of the XML Activity. This document incorporates minor changes made against the Proposed Recommendation of 25 January 2011. Changes to this document since the Proposed Recommendation are detailed in J Change Log. A Java applet that parses XQuery and XPath Full Text 1.0 expressions is available at http://www.w3.org/2010/02/qt-applets/xquery10-fulltext/ . A Test Suite has been created for this document. Implementors are encouraged to run this test suite and report their results. The Test Suite can be found at http://dev.w3.org/cvsweb/2007/xpath-full-text-10-test-suite/ . An implementation report is available at http://dev.w3.org/2007/xpath-full-text-10-test-suite/PublicPagesStagingArea… . No substantive changes have been made to this specification since its publication as a Proposed Recommendation. Please report errors in this document using W3C's public Bugzilla system (instructions can be found at http://www.w3.org/XML/2005/04/qt-bugzilla) . If access to that system is not feasible, you may send your comments to the W3C XSLT/XPath/XQuery public comments mailing list, public-qt-comments(a)w3.org . It will be very helpful if you include the string “[FT]” in the subject line of your report, whether made in Bugzilla or in email. Please use multiple Bugzilla entries (or, if necessary, multiple email messages) if you have more than one comment to make. Archives of the comments and responses are available at http://lists.w3.org/Archives/Public/public-qt-comments/ . This document has been reviewed by W3C Members, by software developers, and by other W3C groups and interested parties, and is endorsed by the Director as a W3C Recommendation. It is a stable document and may be used as reference material or cited from another document. W3C's role in making the Recommendation is to draw attention to the specification and to promote its widespread deployment. This enhances the functionality and interoperability of the Web. This document was produced by groups operating under the 5 February 2004 W3C Patent Policy. W3C maintains a public list of any patent disclosures made in connection with the deliverables of the XML Query Working Group and also maintains a public list of any patent disclosures made in connection with the deliverables of the XSL Working Group; those pages also include instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains Essential Claim(s) must disclose the information in accordance with section 6 of the W3C Patent Policy. ====================================== XQuery Update Facility 1.0 http://www.w3.org/TR/2011/REC-xquery-update-10-20110317/ ------ Abstract This document defines an update facility that extends the XML Query language, XQuery. The XQuery Update Facility provides expressions that can be used to make persistent changes to instances of the XQuery 1.0 and XPath 2.0 Data Model. ------ Status of this Document This is a Recommendation of the W3C. It was developed by the W3C XML Query Working Group, which is part of the XML Activity. This document incorporates minor changes made against the Proposed Recommendation of 25 January 2011. Changes to this document since the Proposed Recommendation are detailed in [H Revision Log]. A Java applet that parses XQuery Update Facility 1.0 expressions is available at http://www.w3.org/2010/02/qt-applets/xquery10-update/. A Test Suite has been created for this document. Implementors are encouraged to run this test suite and report their results. The Test Suite can be found at http://dev.w3.org/2007/xquery-update-10-test-suite/ . An implementation report is available at http://dev.w3.org/2007/xquery-update-10-test-suite/results/ . No substantive changes have been made to this specification since its publication as a Proposed Recommendation. Please report errors in this document using W3C's public Bugzilla system (instructions can be found at http://www.w3.org/XML/2005/04/qt-bugzilla) . If access to that system is not feasible, you may send your comments to the W3C XSLT/XPath/XQuery public comments mailing list, public-qt-comments(a)w3.org . It will be very helpful if you include the string “[UPD]” in the subject line of your report, whether made in Bugzilla or in email. Please use multiple Bugzilla entries (or, if necessary, multiple email messages) if you have more than one comment to make. Archives of the comments and responses are available at http://lists.w3.org/Archives/Public/public-qt-comments/ . This document has been reviewed by W3C Members, by software developers, and by other W3C groups and interested parties, and is endorsed by the Director as a W3C Recommendation. It is a stable document and may be used as reference material or cited from another document. W3C's role in making the Recommendation is to draw attention to the specification and to promote its widespread deployment. This enhances the functionality and interoperability of the Web. This document was produced by a group operating under the 5 February 2004 W3C Patent Policy. W3C maintains a public list of any patent disclosures made in connection with the deliverables of the group; that page also includes instructions for disclosing a patent. An individual who has actual knowledge of a patent which the individual believes contains Essential Claim(s) must disclose the information in accordance with section 6 of the W3C Patent Policy. -- Ian Jacobs (ij(a)w3.org) http://www.w3.org/People/Jacobs/ Tel: +1 718 260 9447 -- Liam Quin - XML Activity Lead, W3C, http://www.w3.org/People/Quin/ Pictures from old books: http://fromoldbooks.org/ Ankh: irc.sorcery.net irc.gnome.org www.advogato.org

1 0

Using BaseX with Scripts
by Adrien Guillon 17 Mar '11

17 Mar '11

Hello BaseX community, I am writing a script to load a RDBMS with some information from large XML files (1GB). I am using BaseX and XQuery to process the files and generate appropriate data dumps for bulk loading the database. My ultimate goal is to write a couple BASH scripts that will just load up the database, however I need some advice on how to script BaseX. I would like to load the XML file, generate a couple indexes, run my queries, then delete the indexes. It does not look like BaseX is so easily scripted from the command line, unless I initially load the database or run a BaseX server. I have tried running BaseX just using doc() inside the XQuery but this takes forever... Ideally I would want to write as script like this: #!/bin/bash basex --generate-index --dbname="hello_world" file.xml basex --query qry.xml > result.xml basex --delete --dbname="hello world" Any suggestions on how I can do this? Thanks, AJ

2 3