- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] regarding web app. Development REST
by Arve Gengelbach 04 Jun '13

04 Jun '13

Hi Prakash, Perhaps this is interesting for other BaseX users aswell. Nice to hear our slides from the [BaseX User Meetup] at the recent XML Prague helped you. Did the [REST] article from our documentation help you? And regarding RESTXQ: Is there something you missed in the [RESTXQ] article? cheers Arve [BaseX User Meetup] http://files.basex.org/xmlprague2013/ [REST] http://docs.basex.org/wiki/REST [RESTXQ] http://docs.basex.org/wiki/RESTXQ Am 03.06.13 23:28, schrieb Prakash Thapa: > Hi Arve Gengelbach, > I found really nice slide about RESTXQ based web App. development in basex from http://files.basex.org/xmlprague2013/slides/Develop-RESTXQ-WebApps-with-Bas… which I was searching for long time. is there any link exact same format with REST not RESTXQ? git hub link would be great helpful. thank you > > regards > Prakash >

1 0

XML London 2013, 2 days left to register
by Charles Foster 03 Jun '13

03 Jun '13

Calling all XML Aficionados!, XML London is a 2 day XML conference which will be held in central London on the weekend of 15th-16th June. There is a great line up of speakers, with exciting talks about new developments in XML and related technologies, such as XQuery, XSLT, XProc, XForms, the Semantic Web and SPARQL! There will be a Social Dinner on the Saturday night which promises to be great fun with a DemoJam for entertainment!! The full conference programme is available here: http://xmllondon.com/programme.jsp A full conference pass costs just £249 + VAT. Additional Social Dinner tickets for spouses cost just £60 + VAT each. There are student conference passes available at a discounted rate as well as group booking discounts. There are 2 days left to register for the conference to get a guaranteed social dinner place. Our caterers reasonably require 7 days notice of both the delegate numbers and their dinner choices, whilst we may still take Conference registrations after 5th June, we cannot guarantee a Conference Dinner, nor a choice of dinner. Regards, Charles Foster XML London, Programme Committee

1 0

how to find a possibly corrupted node?
by Cerstin Elisabeth Mahlow 31 May '13

31 May '13

Hi, I have several databases basically consisting of several entries like this one: <entry> <lastChange>2013-04-30T08:20:00</lastChange> <user>marcel</user> <phraseme>Ad0190</phraseme> <annotated>no</annotated> <negation>?</negation> <genus>?</genus> <mediality>?</mediality> <meaning>?</meaning> <sentence>?</sentence> <question>?</question> <node>85750</node> <query>[text() contains text ('über' ftand 'den' ftand 'Hals' ftand 'kommen') distance at most 10 words]</query> <p>Gar gewiß hätte sie selbst der Teufel lebendig hingeführt, oder der Donner in die Asche gelegt, oder die Erde lebendig verschluckt, oder den wilden Thieren zum Raub worden, weil sie sich aber der Todten haben angenommen, so konnte sie kein zeitliches Unglück berühren. Nolite timere so fürchtet euch dann nicht, alle Liebhaber der armen Seelen im Fegfeuer, es kann euch so bald kein Unglück über den Hals kommen, die Todten helfen den Lebendigen.</p> <meta>?</meta> <semantics>?</semantics> <comment/> <merged>no</merged> <cite>?</cite> <sem>?</sem> <note/> </entry> For the web-application I run with ExtJS, I extract some data like the values for <user> etc. I also need the text stored in the <p> node, and I use the xquery stored in the <query> node as argument for ft:mark. So this part basically looks like this one: for $i at $p in //entry let $q := $i/query let $annotated := string($i/annotated) let $t := if ($i/p) then $i/p else $i/l let $ft :=concat("ft:mark($binding", $q, ")") let $bm := map{'$binding' := $t} return <div>{if ($annotated = "no") then xquery:eval($ft, $bm) else $t}</div> I get the query and the text and then apply the query to the text depending on the value for <annotation>. This works fine for most of the databases. However, for six or seven, I get a time-out, regardless of the size of the database. It works OK with DB consisting of several hundreds or only a dozen of such entries, but it does not work for the one I attach here as XML source (I created the DB via another xquery with whitespace chopping off and UPDINDEX ON, all indexes have been created. It is valid XML as far as I can see.) I tested it with the GUI, I use BaseX 7.7beta from April 24, with VM=-Xmx512m. If I change the return expression to: return <div>{if ($annotated = "no") then ($q, $t) else $t}</div> I get a result for all entries in about 35ms. And this query plan: Compiling: - simplifying descendant-or-self step(s) - converting descendant::*:entry to child steps - removing redundant $p as xs:integer cast. - atomic evaluation of ($annotated = "no") - inlining let $annotated := fn:string($i/annotated) - atomic evaluation of (fn:string($i/annotated) = "no") - removing variable $annotated - removing variable $ft - removing variable $bm - inlining let $q := $i/query - removing variable $q - inlining let $t := if($i/p) then $i/p else $i/l - removing variable $t Optimized Query: for $i at $p in document-node { "annotate-Ad0190.xml" }/*:root/*:entry return element div { (if((fn:string($i/annotated) = "no")) then ($i/query, if($i/p) then $i/p else $i/l) else if($i/p) then $i/p else $i/l) } Result: - Hit(s): 72 Items - Updated: 0 Items - Printed: 759 KB - Locking: local [annotate-Ad0190] Timing: - Parsing: 0.0 ms - Compiling: 1.14 ms - Evaluating: 34.44 ms - Printing: 7.8 ms - Total Time: 43.4 ms Query plan: <QueryPlan> <GFLWOR> <For> <Var name="$i" id="1"/> <at> <Var name="$p" id="0"/> </at> <IterPath> <DBNode name="annotate-Ad0190" pre="0"/> <IterStep axis="child" test="*:root"/> <IterStep axis="child" test="*:entry"/> </IterPath> </For> <CElem> <QNm value="div" type="xs:QName"/> <If> <CmpG op="="> <FNAcc name="string([item])"> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="annotated"/> </CachedPath> </FNAcc> <Str value="no" type="xs:string"/> </CmpG> <List> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="query"/> </CachedPath> <If> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="p"/> </CachedPath> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="p"/> </CachedPath> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="l"/> </CachedPath> </If> </List> <If> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="p"/> </CachedPath> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="p"/> </CachedPath> <CachedPath> <VarRef> <Var name="$i" id="1"/> </VarRef> <IterStep axis="child" test="l"/> </CachedPath> </If> </If> </CElem> </GFLWOR> </QueryPlan> For the original query, i.e., applying ft:mark, I only get a "Out of main memory error" after roughly 60000ms. I don't see any suspicious going here. Do you have any idea what might be the reason for the time out? All other information I extract are returned in less than 100ms, the ft:mark seems to be the issue. Is there any way I can find out which of the entries is causing the time out? Thanks in advance and best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Departement Sprach- und Literaturwissenschaften Fachbereich Deutsche Sprach- und Literaturwissenschaft Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net

1 0

Perl and BaseX question (add document to existing db)
by m4058＠aol.com 30 May '13

30 May '13

I'm trying to add a document to an existing dababase xmark. Any idea on how to do this with Perl? $session->execute("create db database"); (would like the existing database xmark in here) print $session->info()."\n"; # add document $session->add("world/World.xml"); Thanks Mark Shortt

2 1

namespaces and the doc() function: conflicting prefix bindings persist past their scope?
by C. M. Sperberg-McQueen 29 May '13

29 May '13

I'm having a puzzling experience with BaseX 7.6 running under Mac OS X 10.6.8. Consider the following document, in my file system as test.xml: <xsd:schema xmlns:xsd="http://www.w3.org/2001/XMLSchema"> <xsd:element name="back"/> <xsd:element name="body"> <xsd:annotation xmlns:xsd="http://www.w3.org/2000/10/XMLSchema"/> </xsd:element> <xsd:element name="bold"/> </xsd:schema> The query doc('.../test.xml')//xs:element returns not three elements, but just the first two. The third element is encountered after the prefix 'xsd' was temporarily rebound to a different namespace, and it is not recognized as being in the same namespace as the other 'element' elements. (Further investigation shows that the system believes it to be in namespace http://www.w3.org/2000/10/XMLSchema.) Some observations: - The behavior has nothing to do with the specific namespace or the fact that the XSD namespace is predefined; analogous behavior occurs with the following document: <a:a xmlns:a="http://example.com/a"> <a:b/> <a:b> <x xmlns:a="http://example.com/x"/> </a:b> <a:b/> </a:a> - If a database is built using the document just given, the query declare namespace foo = "http://example.com/a"; //foo:b returns two elements, not three. In my tests, it appeared not to matter whether I checked or unchecked the 'Use internal XML parser' box; I got two elements either way. - The behavior changes if the document is given literally in the query; the following query returns three {http://example.com/a}b elements, not two: declare namespace foo = "http://example.com/a"; let $doc := <a:a xmlns:a="http://example.com/a"> <a:b/> <a:b> <x xmlns:a="http://example.com/x"/> </a:b> <a:b/> </a:a> return $doc//foo:b Is this a bug, or am I doing something wrong? It looks as if something were going wrong in the XML parser's management of namespace bindings. Thanks for any light you can shed on the matter. In the short run I suppose I can try to revise my XSLT to suppress the unnecessary namespace rebindings. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 3

'http://apache.org/xml/features/xinclude' is not recognized.
by subbarao＠intense.in 28 May '13

28 May '13

Dear Basex, Does basex use any of the external xml parsers when it is running on some application server.In one of my server iam getting this exception org.basex.core.BaseXException: "file:/test/59813751_0.XML": Feature 'http://apache.org/xml/features/xinclude' is not recognized what might be the possible reasons for the above exception. Thanks & Regards Subbu

1 0

Upload non xml files to basex
by nestor vb 28 May '13

28 May '13

Hello everyone: I was just wondering if is it possible to upload another file types to basex, for instance upload an xml with the lyrics of a song an upload a sample mp3 for instance. Regards, Nestor

1 0

Re: [basex-talk] Storing and reading data - migrate from exist-db
by Christian Grün 27 May '13

27 May '13

Hi Bartosz (cc @basex-talk), if you want to cache your data in temporary files without losing synchronicity, you may take advantage of the (yet undocumented, but stable) locking options that have been introduced with BaseX 7.7. The following example query... declare option query:write-lock "file-io"; file:write-text("x.txt", '123') ...ensures that all other queries with a read-lock or write-lock option on the (arbitrarily chosen) "file-io" string, such as e.g.… declare option query:read-lock "file-io"; file:read-text("x.txt", '123') …will be queued until the query has been evaluated. Next, please note that XQuery demands that a doc() function in a query will always return the same document instance. In your example, this means that the second doc() function won’t repeatedly access the source file, but instead return the existing document node reference. You may surpass this by using fetch:text() or file:read-text() and parse-xml(): let $path := $path || '/index.xml' let $indexold := parse-xml(file:read-text($path))//index let $indexnew := <index>{ $indexold + 1 }</index> let $filewrite := file:write($path), $indexnew) let $index := parse-xml(file:read-text($path)) If you want to use pure XQuery (Update/3.0), however, you’ll have to split your query into several files, or you can use the helpful transform expression [1], which allows you to create updated main-memory instances, which can then be stored in databases or processed any other way. An example: copy $doc := parse-xml(file:read-text($path)) modify replace value of node $doc//index with $indexold + 1 return $doc As your problem is quite a frequent one, there’s some good chance that an upcoming version of XQuery Update will allow both updates and returned results in one query. I hope this gives you some inspiration, Christian [1] http://docs.basex.org/wiki/XQuery_Update#transform ___________________________ On Mon, May 27, 2013 at 12:44 PM, Bartosz Marciniak <marciniak.b(a)gmail.com> wrote: > Christan, > what I mean is reading updated data from db and then binding them to a > variable by let expression. > > > Initially, I tried to use file:write() function to store temporaty data in > the external file > using following solution: > > let $indexold := doc(concat($path , '/index.xml'))//index > let $indexnew := <index>{$indexold + 1}</index> > let $filewrite := file:write(concat($path , '/index.xml'), $indexnew, ()) > let $index := doc(concat($path , '/index.xml')) > > but I discoverd that the file:write() function is not synchronized. So I > tried to store temporary data in the db. > > > I hope I clearly presented the problem, if not please forget about that :-) > > > regards > Bartosz > > > > > > 2013/5/27 Christian Grün <christian.gruen(a)gmail.com> >> >> Hi Bartosz, >> >> ..what do you mean exactly with "the result"? >> >> Best, >> Christian >> >> > Christian, >> > thank you very much. This example works and explained a lot to me. >> > But could you just explain is it possible or not to evaluate further the >> > result? > >

1 0

invalid collection name?
by C. M. Sperberg-McQueen 27 May '13

27 May '13

Using the GUI interface to BaseX 7.2, when I select Database / Open and Manage ..., I get a list of the databases I have built over the time I've been using BaseX. When I try to open the collection named MEP.bigbooks, though, I get an error box saying "Name 'MEP.bigbooks' is invalid." In the "Manage Databases" dialog box, the information about the collection appears normal and plausible (at least, the size is about what I expect, and so on). It's only when I try to open the collection that I run into the error. I get similar errors on other collections which have . in their name; I do not get errors when opening other collections built (as far as I can remember) at the same time from the same data, if their name does not include a full stop. When I try renaming the collection without the full stop, I get the same error message. When I try to issue the command ALTER DATABASE MEP.bigbooks MEPbigbooks from the server command area of the GUI, I get a short syntax summary in the Query Info area complaining about the syntax of the command. When I replace MEP.bigbooks with MEP\.bigbooks and "MEP.bigbooks", I also get syntax errors. If I close the GUI and just rename the directory within my BaseXData directory, the database appears to open normally. I think I have two questions: Q1 is just renaming the directory a safe way (assuming no server is currently working with the data) to rename a collection? Should I do the same for all the other collections I have that don't currently open? I assume that if the 7.2 GUI won't let me rename them, it also will have trouble deleting them, so a related question is: is just deleting a sub-directory of BaseXData a safe way to delete a collection? Q2 Did the rules for names of collections change? Or is there some other cause? Speaking for myself, I guess that as a user I haven't thought much about what characters should be allowed in collection names, but I may have assumed that if they are not unrestricted, they would be restricted to being legal NCNames. I do kind of like using dots in names, so you can count this as one vote for relaxing the naming rules at some convenient moment. It's not a really important point, of course. best, Michael -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 2

Storing and reading data - migrate from exist-db
by Bartosz Marciniak 27 May '13

27 May '13

Hello, I'm trying to rewritte XQuery prepared for exist-db into baseX. I have a problem with storing data in the database. In exist-db xmldb:store() function returns a string and there is no problem to create let/return construct. Is it possible to create a similar solution in baseX? --- exist-db ----------------------------------------- xquery version "3.0"; declare function local:indexget() as item()* { let $index := doc('db/index.xml') return xs:integer($index/index/text()) }; declare function local:indexset($index as xs:integer) as xs:string? { let $newresource := xmldb:store('/db','index.xml', <index>{$index}</index>) return $newresource }; let $indexnew := local:indexget() + 1 let $newresource := local:indexset($indexnew) return local:indexget() ---------------------------------------------------- And these are baseX functions I wrote, but I don't know if is it possible to create solution similar to above? Can anyone help me solve this problem? ---- BaseX ---------------------------------------------- declare function local:indexget() as item()* { let $index := doc('/home/index.xml') return xs:integer($index/index/text()) }; declare %updating function local:indexset($index as xs:integer) { db:replace('index', 'index.xml', <index>{$index}</index>) }; (....) ------------------------------------------------------------ Regards Bartosz Marciniak

2 1