- BaseX-Talk - mailman.uni-konstanz.de

Embedded BaseX JaxRxServer started from Java desktop app.
by Huib Verwey 08 Jun '11

08 Jun '11

Hi, I'm trying to start a BaseX db instance from my Java desktop application using db = new JaxRxServer(); The log says: BaseX 6.6.2 [Server] Server is gestart. 2011-05-31 08:16:03.666:INFO::Logging to STDERR via org.mortbay.log.StdErrLog 2011-05-31 08:16:03.704:INFO::jetty-6.1.26 2011-05-31 08:16:03.881:INFO::Started SocketConnector@0.0.0.0:8984 JAX-RX Server is gestart And when a curl request is made the log says: 31-mei-2011 8:17:28 com.sun.jersey.api.core.PackagesResourceConfig init INFO: Scanning for root resource and provider classes in the packages: org.jaxrx.resource 31-mei-2011 8:17:28 com.sun.jersey.api.core.ScanningResourceConfig logClasses INFO: Root resource classes found: class org.jaxrx.resource.XMLResource class org.jaxrx.resource.JaxRxResource 31-mei-2011 8:17:28 com.sun.jersey.api.core.ScanningResourceConfig init INFO: No provider classes found. 31-mei-2011 8:17:28 com.sun.jersey.server.impl.application.WebApplicationImpl _initiate INFO: Initiating Jersey application, version 'Jersey: 1.6 03/25/2011 01:14 PM' I can connect to the server using bin/basexclient and it serves all the data from my local BaseX instance I have used before, but when I try to access the JaxRxServer using curl I get: HTTP/1.1 400 Bad Request Content-Type: text/plain Transfer-Encoding: chunked Server: Jetty(6.1.26) cvc-elt.1: Cannot find the declaration of element 'query'. Does anyone know what I need to do to get this working? I am running a maven project with dependencies on basex-6.6.2 and basex-api-6.6.2. Hartelijke groet, Huib Verweij. -- Drs. Huib Verweij Senior software developer - The Language Archive Max Planck Institute for Psycholinguistics P.O. Box 310 6500 AH Nijmegen The Netherlands t +31-24-3521911 e huib.verwey(a)mpi.nl<mailto:huib.verwey@mpi.nl> w http://www.mpi.nl/

4 12

downloading basex 6.6.2
by Godmar Back 08 Jun '11

08 Jun '11

On http://basex.org/products/download/zip-download/ it downloads http://files.basex.org/releases/6.6.2/BaseX662.zip but the link on the page points to http://files.basex.org/releases/6.6/BaseX66.zip Also, I really hate the "download should start automatically" option. I practically never sit in front of the computer on which I develop, so why you're sucking up my home bandwidth by trying to send a copy of .zip to my laptop is beyond me. A good alternative may be a green Download button like on Sourceforge or other sites. On a related note, I notice that BaseX server now has a startup script that requires three other jar files - are those needed? Why do I need, for instance, tagsoup when I'm not planning on parsing any HTML. - Godmar

2 2

basexserverstop script should accept arguments (-p, etc.)
by Godmar Back 08 Jun '11

08 Jun '11

> diff -u /tmp/x/bin/basexserverstop ./bin/basexserverstop --- /tmp/x/bin/basexserverstop 2011-03-21 16:23:06.000000000 -0400 +++ ./bin/basexserverstop 2011-06-08 03:53:58.000000000 -0400 @@ -7,4 +7,4 @@ BASEX=$PWD/../BaseX.jar # Run code -java -cp "$BASEX" org.basex.BaseXServer stop +java -cp "$BASEX" org.basex.BaseXServer ${1+"$@"} stop

1 0

bindings documentation missing
by Godmar Back 08 Jun '11

08 Jun '11

This page: http://docs.basex.org/wiki/Category:Bindings has no info. Linked from http://docs.basex.org/wiki/Main_Page - Godmar

2 2

"database locked" error on DROP DATABASE
by Godmar Back 08 Jun '11

08 Jun '11

Hi, I'm trying to delete an XML document by invoking 'execute("DROP DATABASE name")' using the Java binding, but I'm getting: Tue Jun 07 18:06:10 EDT 2011: Unexpected exception: java.io.IOException: Database 'feed_vsony7_at_vt_dot_edu_vijayfeed' is currently locked. java.io.IOException: Database 'feed_vsony7_at_vt_dot_edu_vijayfeed' is currently locked. at org.libx.libappdatabase.BaseXSessionSupport.execute(BaseXSessionSupport.java:71) There are no concurrent accesses to the database. I'm creating a document, then I'm successfully running a few XUpdate/XQuery's on it, then I attempt to delete it as part of a unit test. - Godmar ps: (I'm not issuing any "OPEN" commands. What does OPEN/CLOSE do, anyway?)

1 1

Small request on xquery ( how to put xml content in a attribute element )
by augras philippe 02 Jun '11

02 Jun '11

Hello, I'm using basex to manage numerous collection of xml structure , in the context of a migration program, i will transfer these structure to an external system , so i need to send them within an embedded attribut value ( of a xml ) : ex: BaseX current content is : <NodeX></NodeX> Remote DataBase ( not xml ) requieres : <Value title="FNX" value="<NodeX></NodeX>"> The XML source is translated to a litteral string ....but what is the function ( Cast ? ) responsible to operate the translation ? By the way , what is the reversed operation that read attribut to XML structure . Best Regards

3 2

Problem migrating from 6.5.1 to 6.6.3
by software developer 01 Jun '11

01 Jun '11

Hi, I had a pristine database created in 6.5.1, with subcollections in it - no database manipulation done since creating and populating it using JAX-RX. A visit to the JAX-RX URL for the database shows: <jax-rx:results> - <jax-rx:database name="MyData2" documents="48"> <jax-rx:document path="Production/AT/mydata.a.xml" nodes="1930"/> <jax-rx:document path="Production/AT/mydata.m.xml" nodes="28796"/> ... Without doing any manipulation, just replaced the 3 jar files (basex, basex-api, jax-rx) with 6.6.3 versions, and now I get: <jax-rx:database name="MyData2" documents="48"> <jax-rx:document path="Produc" nodes="tion/AT/mydata.a.xml"/> <jax-rx:document path="Produc" nodes="tion/AT/mydata.m.xml"/> ... What's happening?

2 2

Getting the document path in a collection using XQuery
by chas＠munat.com 30 May '11

30 May '11

Say I have a collection c with xml documents x.xml, y.xml, and z.xml and that I've added them using "to" so that they are found here: collection('c/x') ... Let's say that in each document I have a node <code/>, so in x.xml I have <code id='1'/>, in y.xml I have <code id='2'/>, etc. I can query across the documents to find the <code/> node with id = 2 pretty easily. But now that I've found it, I want to do further queries limiting myself to that document. In other words, I want to learn using XQuery that the <code/> node with id = 2 is in collection('c/y'). How can I do this? TIA, Chas.

2 1

Group by
by Erol Akarsu 28 May '11

28 May '11

I am having issue with "group by" operator. If I use it within another "group by", nested "group by" won't work as the following. $propvals in nested "group by" won't include grouped values. let $list := for $p in $prods//RECORD let $cid := $p/PROP[@NAME eq "SubCategoryId"]/PVAL let $allprops := $p/PROPGROUP/PROP let $propgprs := for $prop in $allprops let $propname := $prop/@NAME let $propvals := $prop/PVAL group by $propname order by $propname return <PROPVALS name="{$propname}">{$propvals}</PROPVALS> group by $cid order by $cid return <CID cidid="{$cid}">{$propgprs}</CID> Thanks On Fri, May 13, 2011 at 9:08 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Is there a way Basex server can send us JSON output instead of xml? > > Thanks > > On Wed, May 11, 2011 at 10:28 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > >> I am filtering one big xml db that 800Mb stored into basex db already. >> >> When I write filtered data into a file, I am getting out of memory. >> >> I know basex is generating result filtered document in memory before >> writing and facing memory error. >> >> Can basex write results block by block? >> >> Thanks >> >> >> On Wed, May 4, 2011 at 9:38 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >>> I tried to delete some nodes with "delete nodes .." xquery update >>> command. It actually did what was requested. >>> >>> I checked the database size that is still same as previous one. I know >>> the nodes deleted has a lot of data and I think database indexes would be >>> adjusted accordingly. >>> >>> Then, I exported database as xml file and recreated db. I can see it has >>> real size. >>> >>> My question is why DB is not adjusting indexes when nodes deleted? >>> >>> Thanks >>> >>> Erol Akarsu >>> >>> >>> On Fri, Apr 29, 2011 at 9:23 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >>> >>>> Hi, >>>> >>>> Have we thought on clustering basex servers so we can partition xml >>>> documents? >>>> >>>> Here, I am only interested in a global partitioning: >>>> >>>> Let's say if we have xml document like this, I would like to partition >>>> RECORDS content so that each host will have equal number of RECORD elements. >>>> Then, we need to aggregate results of individual hosts. >>>> Can we implement this simple clustering framework with Basex? >>>> >>>> >>>> <RECORDS> >>>> <RECORD> >>>> ..... >>>> </RECORD> >>>> <RECORD> >>>> ..... >>>> </RECORD> >>>> </RECORDS> >>>> >>>> On Mon, Apr 11, 2011 at 12:35 PM, Erol Akarsu <eakarsu(a)gmail.com>wrote: >>>> >>>>> Ok, >>>>> >>>>> I was able to run full text search with another XML Database. >>>>> >>>>> I am primarily interested in how Basex will play with big XML file >>>>> Wikipedia. >>>>> >>>>> Actually, Database create of wikipedia is fine. But when I add full tet >>>>> search and indexes for it, it always throws out of memory exception error. >>>>> >>>>> I have changed -Xmx with 6GB that is still not enough to generate >>>>> indexes for Wikipedia. >>>>> >>>>> Can you help me on how to generate indexes with a machine that case >>>>> 6GB for Basex process? >>>>> >>>>> Thanks >>>>> >>>>> Erol Akarsu >>>>> >>>>> >>>>> >>>>> On Sun, Apr 10, 2011 at 4:07 AM, Andreas Weiler < >>>>> andreas.weiler(a)uni-konstanz.de> wrote: >>>>> >>>>>> Hi, >>>>>> >>>>>> the following query could work for you: >>>>>> >>>>>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>>>>> for $i in doc("enwiki-latest-pages-articles")//w:sitename >>>>>> return $i[. contains text "Wikipedia"]/.. >>>>>> >>>>>> -- Andreas >>>>>> >>>>>> Am 09.04.2011 um 20:43 schrieb Erol Akarsu: >>>>>> >>>>>> Hi >>>>>> >>>>>> I am having difficulty in running full text operators. This script >>>>>> gives siteinfo below >>>>>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>>>>> let $d := fn:doc ("enwiki-latest-pages-articles") >>>>>> return ($d//w:siteinfo)[1] >>>>>> >>>>>> But return $d//w:siteinfo[w:sitename contains text 'Wikipedia'] does >>>>>> NOT give same node >>>>>> Why "contains" ft operator behave incorrectly? I remember it was >>>>>> working fine. I just dropped and recreated database and turn all indexes. >>>>>> Can you help me? >>>>>> Query info is here: >>>>>> >>>>>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/ >>>>>> "; >>>>>> Compiling: >>>>>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>>>>> - adding text() step >>>>>> - optimizing descendant-or-self step(s) >>>>>> - removing path with no index results >>>>>> - pre-evaluating (())[1] >>>>>> - binding static variable $res >>>>>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>>>>> - binding static variable $d >>>>>> - adding text() step >>>>>> - optimizing descendant-or-self step(s) >>>>>> - removing path with no index results >>>>>> - simplifying flwor expression >>>>>> Result: () >>>>>> Timing: >>>>>> - Parsing: 0.46 ms >>>>>> - Compiling: 0.42 ms >>>>>> - Evaluating: 0.17 ms >>>>>> - Printing: 0.1 ms >>>>>> - Total Time: 1.15 ms >>>>>> Query plan: >>>>>> <sequence size="0"/> >>>>>> >>>>>> >>>>>> >>>>>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" >>>>>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> >>>>>> <sitename>Wikipedia</sitename> >>>>>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>>>>> <generator>MediaWiki 1.17wmf1</generator> >>>>>> <case>first-letter</case> >>>>>> <namespaces> >>>>>> <namespace key="-2" case="first-letter">Media</namespace> >>>>>> <namespace key="-1" case="first-letter">Special</namespace> >>>>>> <namespace key="0" case="first-letter"/> >>>>>> <namespace key="1" case="first-letter">Talk</namespace> >>>>>> <namespace key="2" case="first-letter">User</namespace> >>>>>> <namespace key="3" case="first-letter">User talk</namespace> >>>>>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>>>>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>>>>> <namespace key="6" case="first-letter">File</namespace> >>>>>> <namespace key="7" case="first-letter">File talk</namespace> >>>>>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>>>>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>>>>> <namespace key="10" case="first-letter">Template</namespace> >>>>>> <namespace key="11" case="first-letter">Template talk</namespace> >>>>>> <namespace key="12" case="first-letter">Help</namespace> >>>>>> <namespace key="13" case="first-letter">Help talk</namespace> >>>>>> <namespace key="14" case="first-letter">Category</namespace> >>>>>> <namespace key="15" case="first-letter">Category talk</namespace> >>>>>> <namespace key="100" case="first-letter">Portal</namespace> >>>>>> <namespace key="101" case="first-letter">Portal talk</namespace> >>>>>> <namespace key="108" case="first-letter">Book</namespace> >>>>>> <namespace key="109" case="first-letter">Book talk</namespace> >>>>>> </namespaces> >>>>>> </siteinfo> >>>>>> >>>>>> On Mon, Apr 4, 2011 at 7:31 AM, Erol Akarsu <eakarsu(a)gmail.com>wrote: >>>>>> >>>>>>> I imported wikipedia xml into basex and tried to search it. >>>>>>> >>>>>>> But searching it takes longer. >>>>>>> >>>>>>> I tried to search one element that is first child of whole document >>>>>>> and it took 52 sec. >>>>>>> I know the XML file is very big 31GB. How can I optimize the search? >>>>>>> >>>>>>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>>>>>> >>>>>>> let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo >>>>>>> return $d >>>>>>> >>>>>>> Database info: >>>>>>> >>>>>>> > open enwiki-latest-pages-articles >>>>>>> Database 'enwiki-latest-pages-articles' opened in 778.49 ms. >>>>>>> > info database >>>>>>> Database Properties >>>>>>> Name: enwiki-latest-pages-articles >>>>>>> Size: 23356 MB >>>>>>> Nodes: 228090153 >>>>>>> Height: 6 >>>>>>> >>>>>>> Database Creation >>>>>>> Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml >>>>>>> Time Stamp: 03.04.2011 12:29:15 >>>>>>> Input Size: 30025 MB >>>>>>> Encoding: UTF-8 >>>>>>> Documents: 1 >>>>>>> Whitespace Chopping: ON >>>>>>> Entity Parsing: OFF >>>>>>> >>>>>>> Indexes >>>>>>> Up-to-date: true >>>>>>> Path Summary: ON >>>>>>> Text Index: ON >>>>>>> Attribute Index: ON >>>>>>> Full-Text Index: OFF >>>>>>> > >>>>>>> >>>>>>> >>>>>>> Timing info: >>>>>>> >>>>>>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/ >>>>>>> "; >>>>>>> Compiling: >>>>>>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>>>>>> - optimizing descendant-or-self step(s) >>>>>>> - binding static variable $d >>>>>>> - removing variable $d >>>>>>> - simplifying flwor expression >>>>>>> Result: element siteinfo { ... } >>>>>>> Timing: >>>>>>> - Parsing: 1.4 ms >>>>>>> - Compiling: 52599.0 ms >>>>>>> - Evaluating: 0.28 ms >>>>>>> - Printing: 0.62 ms >>>>>>> - Total Time: 52601.32 ms >>>>>>> Query plan: >>>>>>> <DBNode name="enwiki-latest-pages-articles" pre="5"/> >>>>>>> >>>>>>> >>>>>>> >>>>>>> Result of query: >>>>>>> >>>>>>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" >>>>>>> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> >>>>>>> <sitename>Wikipedia</sitename> >>>>>>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>>>>>> <generator>MediaWiki 1.17wmf1</generator> >>>>>>> <case>first-letter</case> >>>>>>> <namespaces> >>>>>>> <namespace key="-2" case="first-letter">Media</namespace> >>>>>>> <namespace key="-1" case="first-letter">Special</namespace> >>>>>>> <namespace key="0" case="first-letter"/> >>>>>>> <namespace key="1" case="first-letter">Talk</namespace> >>>>>>> <namespace key="2" case="first-letter">User</namespace> >>>>>>> <namespace key="3" case="first-letter">User talk</namespace> >>>>>>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>>>>>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>>>>>> <namespace key="6" case="first-letter">File</namespace> >>>>>>> <namespace key="7" case="first-letter">File talk</namespace> >>>>>>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>>>>>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>>>>>> <namespace key="10" case="first-letter">Template</namespace> >>>>>>> <namespace key="11" case="first-letter">Template talk</namespace> >>>>>>> <namespace key="12" case="first-letter">Help</namespace> >>>>>>> <namespace key="13" case="first-letter">Help talk</namespace> >>>>>>> <namespace key="14" case="first-letter">Category</namespace> >>>>>>> <namespace key="15" case="first-letter">Category talk</namespace> >>>>>>> <namespace key="100" case="first-letter">Portal</namespace> >>>>>>> <namespace key="101" case="first-letter">Portal talk</namespace> >>>>>>> <namespace key="108" case="first-letter">Book</namespace> >>>>>>> <namespace key="109" case="first-letter">Book talk</namespace> >>>>>>> </namespaces> >>>>>>> </siteinfo> >>>>>>> >>>>>>> >>>>>>> >>>>>>> Thanks >>>>>>> >>>>>>> Erol Akarsu >>>>>>> >>>>>>> >>>>>> _______________________________________________ >>>>>> BaseX-Talk mailing list >>>>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >> >

2 6

Re: [basex-talk] Basic query
by Wiard Vasen 27 May '11

27 May '11

Hi Christian, Thank you for looking at the query. You are always a great help! The result I am looking for is the total number of occurences. Because there is such a large repository of letters. With this number I am able to say that the word 'zonnebloemen' occurs 30 times in all documents. For example. I thought this could be accomplished with a small alteration of this query. If you see a solution that would be great, otherwise I just count them by hand. Regards, Wiard 2011/5/26 Christian Grün <christian.gruen(a)gmail.com> > Hi Wiard, > > finally a quick answer; the result seems correct to me, as the term > "zonnebloemen" occurs in three of the documents that you sent to me. > I've attached the result below; which result would you have expected? > > Christian > > > <document uri="file:/G:/XML/brievenvangogh/let001.xml"/> > <document uri="file:/G:/XML/brievenvangogh/let002.xml"/> > <document uri="file:/G:/XML/brievenvangogh/let003.xml"/> > <document uri="file:/G:/XML/brievenvangogh/let004.xml"/> > <document uri="file:/G:/XML/brievenvangogh/let266.xml"> > <hit score="0.2953945291203477" count="1"> > <ab xmlns="http://www.tei-c.org/ns/1.0" rend="indent">Verder > maakte ik nog een studie van een<lb n="28" xml:id="l-28"/>hofje met > een bleek & zonnebloemen.<anchor n="4" xml:id="note-o-4"/> > </ab> > </hit> > </document> > <document uri="file:/G:/XML/brievenvangogh/let653.xml"> > <hit score="0.2953945291203477" count="1"> > <ab xmlns="http://www.tei-c.org/ns/1.0" rend="indent">Ik heb een > studie van een tuin<c type="kk">/</c>haast een meter breed.<lb n="18" > xml:id="l-18"/>op den voorgrond klaprozen & andere roode bloemen > in groen.<lb n="19" xml:id="l-19"/>dan een vak<hi > rend="ital">blaauwe</hi>klokken<c type="kp">_</c>Dan een vak<lb n="20" > xml:id="l-20"/>oranje en geele afrikanen<c type="kk">/</c>dan witte en > geele<lb n="21" xml:id="l-21"/>bloemen en eindelijk op den achtergrond > rose en lilas<lb n="22" xml:id="l-22"/>en nog scabiosas<c > type="kk">/</c>donkerviolet<c type="kk">/</c>en roode geraniums en > zonnebloemen<lb n="23" xml:id="l-23"/>en een vijgeboom en laurier rose > en een wingerd<c type="kp">_</c>Aan ’t eind zwarte<lb n="24" > xml:id="l-24"/>cypressen tegen lage witte huisjes met oranje dak – en > een fijn<lb n="25" xml:id="l-25"/>groenblaauwe strook lucht.<anchor > n="1" xml:id="note-o-1"/> > </ab> > </hit> > </document> > <document uri="file:/G:/XML/brievenvangogh/let740.xml"> > <hit score="1" count="1"> > <hi xmlns="http://www.tei-c.org/ns/1.0" rend="ital">Zonnebloemen</hi> > </hit> > </document> > > > > On Wed, May 25, 2011 at 11:21 PM, Christian Grün > <christian.gruen(a)gmail.com> wrote: > > Hi Wiard, > > > > sorry for the delay; my todo list is long today, but I'll try to give > > you some feedback soon (if not someone else is faster..). > > > > Christian > > ___________________________ > > > > On Wed, May 25, 2011 at 8:56 PM, Wiard Vasen <wiard.vasen(a)gmail.com> > wrote: > >> Hi Christian, > >> Did I throw to much over the fence? > >> Regards, > >> Wiard > >> > >> 2011/5/25 Wiard Vasen <wiard.vasen(a)gmail.com> > >>> > >>> Hi Christian, > >>> I hereby send you several xml-files containing the term 'zonnebloemen'. > >>> The first four documents(266,653,667,740) are with this term. > >>> The last four(1,2,3,4) don't have the term. > >>> Thanks for looking at my problem! > >>> Regards, > >>> Wiard > >>> > >>> 2011/5/25 Christian Grün <christian.gruen(a)gmail.com> > >>>> > >>>> Hi Wiard, > >>>> > >>>> > I get the number of all documents as the number of hits. > >>>> > And what I want is the number of documents containing the term > >>>> > 'zonnebloemen'. > >>>> > Last time you had a solution for the number of hits in one specific > >>>> > document. > >>>> > I hope you have a solution for this problem. > >>>> > >>>> Could you provide us with a little document that allows us to > >>>> reproduce the problem? > >>>> > >>>> Thanks, > >>>> Christian > >>> > >> > >> > > >

2 6