- BaseX-Talk - mailman.uni-konstanz.de

Help on BaseX commands
by Christian Grün 06 May '11

06 May '11

Dear all, we have improved our documentation on the BaseX database commands: http://docs.basex.org/wiki/Commands The next version of BaseX will be released in just a few days. Enjoy, Christian ___________________________ Christian Grün BaseX Team Uni KN, Box 188 78457 Konstanz, Germany http://www.inf.uni-konstanz.de/~gruen

1 0

Concurrency with the server API under high load
by Jason Klassen 05 May '11

05 May '11

Hi, I'm seeking some help on the best way to use BaseX in a highly concurrent environment. We're using the server API to interact with a BaseX 6.6 server and noticing some very odd behavior when 100+ threads use clientsession concurrently to access the same db. Looking at the BaseX logs I get some correct lines like: 01:19:21.101 [127.0.0.1:33153] OPEN Async_StressTestDB_Med 01:19:22.301 [127.0.0.1:33274] XQUERY insert node <record><contentChannel><String>data2</String></contentChannel><String>v alue goes here618</String></record> into for $db in collection('Async_StressTestDB_Med')/records return $db But then I also get lines like: 01:19:21.105 [127.0.0.1:33161] OPEONP EANs yAnscy_nSct_rSetsrseTsessTteDsBt_DMBe_dM Error: Stopped at line 1, column 6: Unknown command 'OPEONP'; try "help". 01:19:21.112 [127.0.0.1:33156] OOPPEENN AAssyynncc__SSttrreessssTTeessttDDBB__MMeedd Error: Stopped at line 1, column 8: Unknown command 'OOPPEENN'; try "help". 01:19:23.065 [127.0.0.1:33642] XQXERY insYrt ninserde <tr ecord><code nrecord><ctnteneChanntChannel><etl><Strirg>data2i/Strg>datng><a/2content C/Striang>nnel><Stcintenng>value Channeloes hereString>va<uStrine>< goecord>esn hert152o foring></rec rd>$db in collectiono'Async_ tressTestDor ddb in 'ollec/recoion('As nc_SteressTestDu_Med')/n $dbecords return $db Error: Stopped at line 1, column 6: Unknown command 'xqxery'; did you mean 'xquery'? The issue seems to happen when calling clientSession.execute(...) because I can verify that the command string being passed to execute is correct even when the log executes a mangled command. I believe 2 problems are happening to us. 1. A collection in clientSession is not thread safe when storing the commands passed to it. 2. BaseX is write locking the db on concurrent inserts. I understand the need for that but the wiki on Transaction Management implied that there was a queue where requests would wait if isolation could not be guaranteed. This sounded automatic. Are there any steps I need to take to enable the Transaction Management Queue? Below is the JUnit 4 test setup we're using to find the errors, generally I run 1 test at a time to observe and limit side effects. The BaseX GUI is closed while the tests run. I've also attached the full BaseX logs generated by running the tests but if they get removed I can easily email them upon request. How can the problem can be resolved? Thanks, Jason import org.junit._ import Assert._ import scala.util.Random import scala.concurrent.ops._ import scala.actors.Actor._ import org.basex.core.BaseXException import org.basex.core.cmd._ import org.basex.server.ClientSession import scala.xml._ class MockBaseXXMLStore { val dbHost = "localhost" val dbPort = "1984" val dbUser = "admin" val dbPwd = "admin" var _clientSession: Option[ClientSession] = None def clientSession: ClientSession = { _clientSession match { case Some(cs) => cs case None => { val cs = new ClientSession(dbHost, dbPort.toInt, dbUser, dbPwd) _clientSession = Some(cs) cs } } } def insertUpdate(xmlCollStr: String)(xmlElemStr: String): Unit = { val srvrRspStrm = new java.io.ByteArrayOutputStream() try { clientSession.setOutputStream(srvrRspStrm) clientSession.execute(new Open(xmlCollStr)) val insertTemplate = ( "insert node %NODE% into " + "for $db in collection('%COLLNAME%')/records return $db" ); val insertQry = insertTemplate.replace( "%NODE%", xmlElemStr ).replace( "%COLLNAME%", xmlCollStr ) try { clientSession.execute(new XQuery(insertQry)) } catch { case e: BaseXException => { } } } catch { case e: BaseXException => { val recordsElem = <records> {XML.loadString(xmlElemStr)} </records> clientSession.execute(new CreateDB(xmlCollStr)) clientSession.execute(new Add(recordsElem.toString)) } } finally { srvrRspStrm.close() } } } class BaseXTest { val rand = new Random() @Test //Success: 1 created def insertUpdate = { val db = new MockBaseXXMLStore db.insertUpdate("MockBaseXXMLStoreTestDB")("<record><contentChannel><Str ing>data2</String></contentChannel><String>value goes here" + rand.nextInt + "</String></record>") } @Test //Success: 100 and 1000 created def stressInsertUpdate = { val db = new MockBaseXXMLStore println("starting small") for (i <- 1 to 100) { db.insertUpdate("StressTestDB_Small")("<record><contentChannel><String>d ata2</String></contentChannel><String>value goes here" + i + "</String></record>") } println("starting med") for (i <- 1 to 1000) { db.insertUpdate("StressTestDB_Med")("<record><contentChannel><String>dat a2</String></contentChannel><String>value goes here" + i + "</String></record>") } } @Test //Fail: 0 and 184 created def stressInsertUpdateAsync = { val db = new MockBaseXXMLStore println("async starting small") for (i <- 1 to 100) { spawn { db.insertUpdate("Async_StressTestDB_Small")("<record><contentChannel><St ring>data2</String></contentChannel><String>value goes here" + i + "</String></record>") } } println("async starting med") for (i <- 1 to 1000) { spawn { db.insertUpdate("Async_StressTestDB_Med")("<record><contentChannel><Stri ng>data2</String></contentChannel><String>value goes here" + i + "</String></record>") } } } @Test //fail 4 and 0 created def stressInsertUpdateActor = { val db = new MockBaseXXMLStore println("async starting small") for (i <- 1 to 100) { actor { db.insertUpdate("Actor_StressTestDB_Small")("<record><contentChannel><St ring>data2</String></contentChannel><String>value goes here" + i + "</String></record>") } } println("async starting med") for (i <- 1 to 1000) { actor { db.insertUpdate("Actor_StressTestDB_Med")("<record><contentChannel><Stri ng>data2</String></contentChannel><String>value goes here" + i + "</String></record>") } } } }

3 8

collections in 6.5.1
by C. M. Sperberg-McQueen 05 May '11

05 May '11

Thanks to Christian Grün's prompt response to my question about attributes, I upgraded to Basex 6.5.1 the other day. And I've run into an unexpected behavior. I have several versions of the Unicode database in XML (the Unicode consortium started shipping XML versions with 5.1.0, and I've created XML documents with the information I need for all the earlier versions); they are all in directory ~/2011/Unicode. But when I ask to create a new database in the GUI, giving that directory as the path and accepting the default pattern of *.xml, the only document in the resulting database appears to be the small schemas.xml file that nXML mode placed in one of the subdirectories of ~/2011/Unicode when I edited an XSLT stylesheet there. What I was expecting was that all the XML documents in that subtree of the file directory would be added -- I think that was the behavior in earlier versions. Has something changed? Or have I gotten out of practice and done something wrong? I hope this is clear; I can try to explain further if needed. Thanks! -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

3 6

delete nodes ..
by Erol Akarsu 04 May '11

04 May '11

I tried to delete some nodes with "delete nodes .." xquery update command. It actually did what was requested. I checked the database size that is still same as previous one. I know the nodes deleted has a lot of data and I think database indexes would be adjusted accordingly. Then, I exported database as xml file and recreated db. I can see it has real size. My question is why DB is not adjusting indexes when nodes deleted? Thanks Erol Akarsu On Fri, Apr 29, 2011 at 9:23 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Hi, > > Have we thought on clustering basex servers so we can partition xml > documents? > > Here, I am only interested in a global partitioning: > > Let's say if we have xml document like this, I would like to partition > RECORDS content so that each host will have equal number of RECORD elements. > Then, we need to aggregate results of individual hosts. > Can we implement this simple clustering framework with Basex? > > > <RECORDS> > <RECORD> > ..... > </RECORD> > <RECORD> > ..... > </RECORD> > </RECORDS> > > On Mon, Apr 11, 2011 at 12:35 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > >> Ok, >> >> I was able to run full text search with another XML Database. >> >> I am primarily interested in how Basex will play with big XML file >> Wikipedia. >> >> Actually, Database create of wikipedia is fine. But when I add full tet >> search and indexes for it, it always throws out of memory exception error. >> >> I have changed -Xmx with 6GB that is still not enough to generate indexes >> for Wikipedia. >> >> Can you help me on how to generate indexes with a machine that case 6GB >> for Basex process? >> >> Thanks >> >> Erol Akarsu >> >> >> >> On Sun, Apr 10, 2011 at 4:07 AM, Andreas Weiler < >> andreas.weiler(a)uni-konstanz.de> wrote: >> >>> Hi, >>> >>> the following query could work for you: >>> >>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> for $i in doc("enwiki-latest-pages-articles")//w:sitename >>> return $i[. contains text "Wikipedia"]/.. >>> >>> -- Andreas >>> >>> Am 09.04.2011 um 20:43 schrieb Erol Akarsu: >>> >>> Hi >>> >>> I am having difficulty in running full text operators. This script gives >>> siteinfo below >>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> let $d := fn:doc ("enwiki-latest-pages-articles") >>> return ($d//w:siteinfo)[1] >>> >>> But return $d//w:siteinfo[w:sitename contains text 'Wikipedia'] does NOT >>> give same node >>> Why "contains" ft operator behave incorrectly? I remember it was working >>> fine. I just dropped and recreated database and turn all indexes. Can you >>> help me? >>> Query info is here: >>> >>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> Compiling: >>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>> - adding text() step >>> - optimizing descendant-or-self step(s) >>> - removing path with no index results >>> - pre-evaluating (())[1] >>> - binding static variable $res >>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>> - binding static variable $d >>> - adding text() step >>> - optimizing descendant-or-self step(s) >>> - removing path with no index results >>> - simplifying flwor expression >>> Result: () >>> Timing: >>> - Parsing: 0.46 ms >>> - Compiling: 0.42 ms >>> - Evaluating: 0.17 ms >>> - Printing: 0.1 ms >>> - Total Time: 1.15 ms >>> Query plan: >>> <sequence size="0"/> >>> >>> >>> >>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >>> http://www.w3.org/2001/XMLSchema-instance"> >>> <sitename>Wikipedia</sitename> >>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>> <generator>MediaWiki 1.17wmf1</generator> >>> <case>first-letter</case> >>> <namespaces> >>> <namespace key="-2" case="first-letter">Media</namespace> >>> <namespace key="-1" case="first-letter">Special</namespace> >>> <namespace key="0" case="first-letter"/> >>> <namespace key="1" case="first-letter">Talk</namespace> >>> <namespace key="2" case="first-letter">User</namespace> >>> <namespace key="3" case="first-letter">User talk</namespace> >>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>> <namespace key="6" case="first-letter">File</namespace> >>> <namespace key="7" case="first-letter">File talk</namespace> >>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>> <namespace key="10" case="first-letter">Template</namespace> >>> <namespace key="11" case="first-letter">Template talk</namespace> >>> <namespace key="12" case="first-letter">Help</namespace> >>> <namespace key="13" case="first-letter">Help talk</namespace> >>> <namespace key="14" case="first-letter">Category</namespace> >>> <namespace key="15" case="first-letter">Category talk</namespace> >>> <namespace key="100" case="first-letter">Portal</namespace> >>> <namespace key="101" case="first-letter">Portal talk</namespace> >>> <namespace key="108" case="first-letter">Book</namespace> >>> <namespace key="109" case="first-letter">Book talk</namespace> >>> </namespaces> >>> </siteinfo> >>> >>> On Mon, Apr 4, 2011 at 7:31 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >>> >>>> I imported wikipedia xml into basex and tried to search it. >>>> >>>> But searching it takes longer. >>>> >>>> I tried to search one element that is first child of whole document and >>>> it took 52 sec. >>>> I know the XML file is very big 31GB. How can I optimize the search? >>>> >>>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>>> >>>> let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo >>>> return $d >>>> >>>> Database info: >>>> >>>> > open enwiki-latest-pages-articles >>>> Database 'enwiki-latest-pages-articles' opened in 778.49 ms. >>>> > info database >>>> Database Properties >>>> Name: enwiki-latest-pages-articles >>>> Size: 23356 MB >>>> Nodes: 228090153 >>>> Height: 6 >>>> >>>> Database Creation >>>> Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml >>>> Time Stamp: 03.04.2011 12:29:15 >>>> Input Size: 30025 MB >>>> Encoding: UTF-8 >>>> Documents: 1 >>>> Whitespace Chopping: ON >>>> Entity Parsing: OFF >>>> >>>> Indexes >>>> Up-to-date: true >>>> Path Summary: ON >>>> Text Index: ON >>>> Attribute Index: ON >>>> Full-Text Index: OFF >>>> > >>>> >>>> >>>> Timing info: >>>> >>>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>>> Compiling: >>>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>>> - optimizing descendant-or-self step(s) >>>> - binding static variable $d >>>> - removing variable $d >>>> - simplifying flwor expression >>>> Result: element siteinfo { ... } >>>> Timing: >>>> - Parsing: 1.4 ms >>>> - Compiling: 52599.0 ms >>>> - Evaluating: 0.28 ms >>>> - Printing: 0.62 ms >>>> - Total Time: 52601.32 ms >>>> Query plan: >>>> <DBNode name="enwiki-latest-pages-articles" pre="5"/> >>>> >>>> >>>> >>>> Result of query: >>>> >>>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >>>> http://www.w3.org/2001/XMLSchema-instance"> >>>> <sitename>Wikipedia</sitename> >>>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>>> <generator>MediaWiki 1.17wmf1</generator> >>>> <case>first-letter</case> >>>> <namespaces> >>>> <namespace key="-2" case="first-letter">Media</namespace> >>>> <namespace key="-1" case="first-letter">Special</namespace> >>>> <namespace key="0" case="first-letter"/> >>>> <namespace key="1" case="first-letter">Talk</namespace> >>>> <namespace key="2" case="first-letter">User</namespace> >>>> <namespace key="3" case="first-letter">User talk</namespace> >>>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>>> <namespace key="6" case="first-letter">File</namespace> >>>> <namespace key="7" case="first-letter">File talk</namespace> >>>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>>> <namespace key="10" case="first-letter">Template</namespace> >>>> <namespace key="11" case="first-letter">Template talk</namespace> >>>> <namespace key="12" case="first-letter">Help</namespace> >>>> <namespace key="13" case="first-letter">Help talk</namespace> >>>> <namespace key="14" case="first-letter">Category</namespace> >>>> <namespace key="15" case="first-letter">Category talk</namespace> >>>> <namespace key="100" case="first-letter">Portal</namespace> >>>> <namespace key="101" case="first-letter">Portal talk</namespace> >>>> <namespace key="108" case="first-letter">Book</namespace> >>>> <namespace key="109" case="first-letter">Book talk</namespace> >>>> </namespaces> >>>> </siteinfo> >>>> >>>> >>>> >>>> Thanks >>>> >>>> Erol Akarsu >>>> >>>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>> >>> >>> >> >

2 3

Clustering of BaseX servers
by Erol Akarsu 29 Apr '11

29 Apr '11

Hi, Have we thought on clustering basex servers so we can partition xml documents? Here, I am only interested in a global partitioning: Let's say if we have xml document like this, I would like to partition RECORDS content so that each host will have equal number of RECORD elements. Then, we need to aggregate results of individual hosts. Can we implement this simple clustering framework with Basex? <RECORDS> <RECORD> ..... </RECORD> <RECORD> ..... </RECORD> </RECORDS> On Mon, Apr 11, 2011 at 12:35 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Ok, > > I was able to run full text search with another XML Database. > > I am primarily interested in how Basex will play with big XML file > Wikipedia. > > Actually, Database create of wikipedia is fine. But when I add full tet > search and indexes for it, it always throws out of memory exception error. > > I have changed -Xmx with 6GB that is still not enough to generate indexes > for Wikipedia. > > Can you help me on how to generate indexes with a machine that case 6GB > for Basex process? > > Thanks > > Erol Akarsu > > > > On Sun, Apr 10, 2011 at 4:07 AM, Andreas Weiler < > andreas.weiler(a)uni-konstanz.de> wrote: > >> Hi, >> >> the following query could work for you: >> >> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> for $i in doc("enwiki-latest-pages-articles")//w:sitename >> return $i[. contains text "Wikipedia"]/.. >> >> -- Andreas >> >> Am 09.04.2011 um 20:43 schrieb Erol Akarsu: >> >> Hi >> >> I am having difficulty in running full text operators. This script gives >> siteinfo below >> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> let $d := fn:doc ("enwiki-latest-pages-articles") >> return ($d//w:siteinfo)[1] >> >> But return $d//w:siteinfo[w:sitename contains text 'Wikipedia'] does NOT >> give same node >> Why "contains" ft operator behave incorrectly? I remember it was working >> fine. I just dropped and recreated database and turn all indexes. Can you >> help me? >> Query info is here: >> >> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >> Compiling: >> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >> - adding text() step >> - optimizing descendant-or-self step(s) >> - removing path with no index results >> - pre-evaluating (())[1] >> - binding static variable $res >> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >> - binding static variable $d >> - adding text() step >> - optimizing descendant-or-self step(s) >> - removing path with no index results >> - simplifying flwor expression >> Result: () >> Timing: >> - Parsing: 0.46 ms >> - Compiling: 0.42 ms >> - Evaluating: 0.17 ms >> - Printing: 0.1 ms >> - Total Time: 1.15 ms >> Query plan: >> <sequence size="0"/> >> >> >> >> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >> http://www.w3.org/2001/XMLSchema-instance"> >> <sitename>Wikipedia</sitename> >> <base>http://en.wikipedia.org/wiki/Main_Page</base> >> <generator>MediaWiki 1.17wmf1</generator> >> <case>first-letter</case> >> <namespaces> >> <namespace key="-2" case="first-letter">Media</namespace> >> <namespace key="-1" case="first-letter">Special</namespace> >> <namespace key="0" case="first-letter"/> >> <namespace key="1" case="first-letter">Talk</namespace> >> <namespace key="2" case="first-letter">User</namespace> >> <namespace key="3" case="first-letter">User talk</namespace> >> <namespace key="4" case="first-letter">Wikipedia</namespace> >> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >> <namespace key="6" case="first-letter">File</namespace> >> <namespace key="7" case="first-letter">File talk</namespace> >> <namespace key="8" case="first-letter">MediaWiki</namespace> >> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >> <namespace key="10" case="first-letter">Template</namespace> >> <namespace key="11" case="first-letter">Template talk</namespace> >> <namespace key="12" case="first-letter">Help</namespace> >> <namespace key="13" case="first-letter">Help talk</namespace> >> <namespace key="14" case="first-letter">Category</namespace> >> <namespace key="15" case="first-letter">Category talk</namespace> >> <namespace key="100" case="first-letter">Portal</namespace> >> <namespace key="101" case="first-letter">Portal talk</namespace> >> <namespace key="108" case="first-letter">Book</namespace> >> <namespace key="109" case="first-letter">Book talk</namespace> >> </namespaces> >> </siteinfo> >> >> On Mon, Apr 4, 2011 at 7:31 AM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >>> I imported wikipedia xml into basex and tried to search it. >>> >>> But searching it takes longer. >>> >>> I tried to search one element that is first child of whole document and >>> it took 52 sec. >>> I know the XML file is very big 31GB. How can I optimize the search? >>> >>> declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> >>> let $d := fn:doc ("enwiki-latest-pages-articles")//w:siteinfo >>> return $d >>> >>> Database info: >>> >>> > open enwiki-latest-pages-articles >>> Database 'enwiki-latest-pages-articles' opened in 778.49 ms. >>> > info database >>> Database Properties >>> Name: enwiki-latest-pages-articles >>> Size: 23356 MB >>> Nodes: 228090153 >>> Height: 6 >>> >>> Database Creation >>> Path: /mnt/hgfs/C/tmp/enwiki-latest-pages-articles.xml >>> Time Stamp: 03.04.2011 12:29:15 >>> Input Size: 30025 MB >>> Encoding: UTF-8 >>> Documents: 1 >>> Whitespace Chopping: ON >>> Entity Parsing: OFF >>> >>> Indexes >>> Up-to-date: true >>> Path Summary: ON >>> Text Index: ON >>> Attribute Index: ON >>> Full-Text Index: OFF >>> > >>> >>> >>> Timing info: >>> >>> Query: declare namespace w="http://www.mediawiki.org/xml/export-0.5/"; >>> Compiling: >>> - pre-evaluating fn:doc("enwiki-latest-pages-articles") >>> - optimizing descendant-or-self step(s) >>> - binding static variable $d >>> - removing variable $d >>> - simplifying flwor expression >>> Result: element siteinfo { ... } >>> Timing: >>> - Parsing: 1.4 ms >>> - Compiling: 52599.0 ms >>> - Evaluating: 0.28 ms >>> - Printing: 0.62 ms >>> - Total Time: 52601.32 ms >>> Query plan: >>> <DBNode name="enwiki-latest-pages-articles" pre="5"/> >>> >>> >>> >>> Result of query: >>> >>> <siteinfo xmlns="http://www.mediawiki.org/xml/export-0.5/" xmlns:xsi=" >>> http://www.w3.org/2001/XMLSchema-instance"> >>> <sitename>Wikipedia</sitename> >>> <base>http://en.wikipedia.org/wiki/Main_Page</base> >>> <generator>MediaWiki 1.17wmf1</generator> >>> <case>first-letter</case> >>> <namespaces> >>> <namespace key="-2" case="first-letter">Media</namespace> >>> <namespace key="-1" case="first-letter">Special</namespace> >>> <namespace key="0" case="first-letter"/> >>> <namespace key="1" case="first-letter">Talk</namespace> >>> <namespace key="2" case="first-letter">User</namespace> >>> <namespace key="3" case="first-letter">User talk</namespace> >>> <namespace key="4" case="first-letter">Wikipedia</namespace> >>> <namespace key="5" case="first-letter">Wikipedia talk</namespace> >>> <namespace key="6" case="first-letter">File</namespace> >>> <namespace key="7" case="first-letter">File talk</namespace> >>> <namespace key="8" case="first-letter">MediaWiki</namespace> >>> <namespace key="9" case="first-letter">MediaWiki talk</namespace> >>> <namespace key="10" case="first-letter">Template</namespace> >>> <namespace key="11" case="first-letter">Template talk</namespace> >>> <namespace key="12" case="first-letter">Help</namespace> >>> <namespace key="13" case="first-letter">Help talk</namespace> >>> <namespace key="14" case="first-letter">Category</namespace> >>> <namespace key="15" case="first-letter">Category talk</namespace> >>> <namespace key="100" case="first-letter">Portal</namespace> >>> <namespace key="101" case="first-letter">Portal talk</namespace> >>> <namespace key="108" case="first-letter">Book</namespace> >>> <namespace key="109" case="first-letter">Book talk</namespace> >>> </namespaces> >>> </siteinfo> >>> >>> >>> >>> Thanks >>> >>> Erol Akarsu >>> >>> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> >

1 0

Converting String to node inside XQuery
by Sony Vijay 26 Apr '11

26 Apr '11

Hi, I am wondering if there is a way to convert a String into a Node within XQuery. For example, consider the xquery let $node := copy $c := <entry> <title>entry title</title> <content>entry content</content> </entry> modify ( return replace value of node $entry/title with 'new entry title', return replace value of node $entry/content with 'new entry content' ) return $c return replace node doc('doc1')/entry with $c The above xquery throws the error: [XPTY0019] Context node required for entry; xs:string found. How do I fix this ? Thanks, Sony

3 8

Document questions
by Csaba Dery 26 Apr '11

26 Apr '11

Hi, Two questions about documents: 1. Is it possible to replace the whole content of a document stored in the database with newer content that's in raw XML format? Right now I'm deleting the document which is straightforward, and then adding it back again with the new content which is not really atomic. I have tried with XQUF but it won't accept raw XML. 2. Is it possible to retrieve the content of a document without using XQuery? I'm thinking of something similar to the Delete command where the path to the document is needed. Is there a command that by specifying the path to a document returns the XML content stored under that path? Thanks!

2 1

Re: [basex-talk] XQuery from console error
by Andreas Weiler 25 Apr '11

25 Apr '11

Right, this one works for me (Mac Terminal): java -cp BaseX.jmin -Padmin -c'xquery let $i := 10 return $i' -- Andreas > > Am 19.04.2011 um 21:24 schrieb Imsieke, Gerrit, le-tex: > >> Might have sth to do with shell interpolation? If you use single quotes around the -c option's argument, the shell won't try to expand $i to (presumably) the empty string. >> >> Jan's example might have worked because he used another type of shell. >> >> Gerrit >> >> On 2011-04-19 21:14, Andreas Weiler wrote: >>> Hi Hector, Hi Jan, >>> >>> i can reproduce the error with BaseX 6.6.1...strange. >>> >>> java -cp BaseX.jar org.basex.BaseXClient -Uadmin -Padmin -c"xquery let >>> $i := 10 return $i" >>> Error: Stopped at line 1, column 12: >>> Syntax: XQUERY [query] >>> Evaluate XQuery. >>> >>> We will have a look at it. >>> >>> -- Andreas >>> >>> Am 19.04.2011 um 20:27 schrieb Jan Vlčinský (CAD): >>> >>>> Hi Hector >>>> I run query like you, only using my existing database name and >>>> counting my elements, which exists there and I had no problem. I >>>> suspected that before : shall be a space, but this is not the case, it >>>> makes no difference in my test: >>>> >>>> D:\opt\BaseX>java -cp BaseX.jar org.basex.BaseXClient -Uadmin -Padmin >>>> -c"open ISO;xquery <results>{ let $total:=count(//LOCT) return >>>> <total>{$total}</total>}</results>" >>>> <results> >>>> <total>1487</total> >>>> </results> >>>> >>>> I use BaseX version 6.6.1 >>>> >>>> 1. What version of BaseX do you use? >>>> 2. Are you sure you run the same version for server and for the >>>> client? Once I had troubles mixing different versions. >>>> >>>> >>>> With best regards >>>> >>>> Jan >>>> 2011/4/19 Hector Diaz <hectordanieldg(a)gmail.com >>>> <mailto:hectordanieldg@gmail.com>> >>>> >>>> Hello, >>>> I am trying to run some Xqueries from command line but I am >>>> getting the following error: >>>> $ java -cp "C:\Program Files\BaseX\BaseX.jar" >>>> org.basex.BaseXClient -Uadmin -Pa >>>> dmin -c"open dbname;xquery <results>{ let >>>> $total:=count(//callRecords/*) return <t >>>> otal>{$total}</total>}</results>" >>>> Error: Stopped at line 1, column 30: >>>> [XPST0003] Expecting "}", found ":". >>>> If I run the query from the GUI it runs correctly, but here I am >>>> always getting this error. >>>> I tried running other dummy queries that work in the GUI but here >>>> I get an error like this: >>>> $ java -cp "C:\Program Files\BaseX\BaseX.jar" >>>> org.basex.BaseXClient -Uadmin -Pa >>>> dmin -c"open dbname;xquery let $total := count(//callRecords/*) >>>> return $total" >>>> Error: Stopped at line 1, column 23: >>>> Syntax: XQUERY [query] >>>> Evaluate XQuery. >>>> Any idea of how to solve this? >>>> Is it possible to use let in queries from command? >>>> Thanks in advance for your help. >>>> Hector >>>> >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> <mailto:BaseX-Talk@mailman.uni-konstanz.de> >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>> >>>> >>>> >>>> >>>> -- >>>> *Ing. Jan Vlčinský* >>>> CAD programy >>>> Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic >>>> tel: +420-597 602 024; mob: +420-608 979 040 >>>> skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com >>>> <mailto:jan.vlcinsky@gmail.com> >>>> http://cz.linkedin.com/in/vlcinsky >>>> >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> <mailto:BaseX-Talk@mailman.uni-konstanz.de> >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>> >>> >>> >>> _______________________________________________ >>> BaseX-Talk mailing list >>> BaseX-Talk(a)mailman.uni-konstanz.de >>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> -- >> Gerrit Imsieke >> Geschäftsführer / Managing Director >> le-tex publishing services GmbH >> Weissenfelser Str. 84, 04229 Leipzig, Germany >> Phone +49 341 355356 110, Fax +49 341 355356 510 >> gerrit.imsieke(a)le-tex.de, http://www.le-tex.de >> >> Registergericht / Commercial Register: Amtsgericht Leipzig >> Registernummer / Registration Number: HRB 24930 >> >> Geschäftsführer: Gerrit Imsieke, Svea Jelonek, >> Thomas Schmidt, Dr. Reinhard Vöckler >

2 1

Returning variable-length results
by Sony Vijay 22 Apr '11

22 Apr '11

Hi, Is there a way to return variable-length results using xquery ? Consider the following xml file (document name: doc1) <feed> <title>feed1</title> <entry> <id>1</id> <title>entry 1 title *match*</title> <content>entry 1 content *match* </content> </entry> <entry> <id>2</id> <title>entry 2 title *match*</title> <content>entry 2 content *match* </content> <author> <name>entry 2 author *match* </name> </author> </entry> </feed> Consider that there are multiple xml files in my database. I am trying to run an xquery which would perform a search across all the xml files in the database which contain entires with the matching key. Then for each matching document, return all the entry nodes with at least one match, followed by a list of nodes with the match. Say the match key word is: "match", the desired result is the following: - document name (doc1), id (1), *[**title (entry 1 title match), content (entry 1 content match)], *document name(doc1), id (2),* [title (entry 2 title match), content (entry 2 content match), author: name (entry 2 author match)]* Please note that the first entry(id=1) contains two matching nodes whereas the second entry(id=2) contains 3 matching nodes. Returning a variable length result as shown above would help me identify the next matching document name and entry id. Currently, I perform this action by splitting the task into 2 sub-tasks: - Return the document name and entry id with at least one match using one xquery - Return the list of matching child nodes for each of the above entries using a second xquery Is there a better way to do this? Thanks, Sony

3 3

Execute methods in ClientSession are marked protected...
by Meredith Gregory 21 Apr '11

21 Apr '11

Dear BaseXers, The execute methods in ClientSession are marked protected. So, the examples from the wiki page seem odd to me. What is the preferred approach? Should i implement my own version of ClientSession? Should i use something other than execute? Best wishes, --greg -- L.G. Meredith Managing Partner Biosimilarity LLC 7329 39th Ave SW Seattle, WA 98136 +1 206.650.3740 http://biosimilarity.blogspot.com

2 1