BaseX-Talk July 2011

basex-talk@mailman.uni-konstanz.de

29 participants
39 discussions

Embedding BaseX jax-rx inside a war
by Donovan, Aaron [USA] 22 Jul '11

22 Jul '11

First off, this is my first week with BaseX, and I'm extremely pleased with both performance and ease of use. Thank you. I really like the interface provided by jax-rx, but I want to deploy it inside of a war rather than start a separate server. While I considered starting the basex server in ServletContextListener, I noticed that LocalSession now supports all of the operations of ClientSession. I was hoping that you'd consider making the jax-rx's selection of LocalSession or ClientSession based upon a system property. The first patch above changes references to ClientSession and LocalQuery to Session and Query respectively in BXOutput and BXJaxRX. You should be able to apply it without any concerns. The second patch introduces a SessionFactory that is used by BXCode to create Sessions appropriately. It worked for me, but as I said this is my first week with the tool. There might be side effects that I didn't intend or a better place to introduce this functionality. Any time frame on releasing a 6.7.1 that includes your full LocalSession implementation? Thanks, Aaron

3 2

XQuery direkt auf XMLFile ?
by Burkert, Michael 22 Jul '11

22 Jul '11

Hallo ! Gibt es eine einfache Möglichkeit, das Ergebnis einer XQuery-Abfrage wiederum mit XQuery abzufragen ? Wenn ich es richtig verstehe, müsste dazu das Ergebnis (xml) zuvor in die Datenbank geschrieben werden. Derzeit schreibe ich das Ergebnis in ein XML-File und würde mir gerne dieses File direkt schnappen für weitere Abfragen. Sollte dies möglich sein, habt Ihr Codebeispiele auf Eurer Seite, bzw. wie sähe so etwas aus ? Mögliche Stichworte die dazu zu finden sind: XMLStreamWrapper, parse, XMLSerializer Mit freundlichem Gruß Michael

2 1

about basex server
by Lusha Wang 21 Jul '11

21 Jul '11

Hi Everyone If i have a dataset that is 1mb, what kind of computer is required to run the basex server? How about 1gb? I feel like the basex server cannot handle very frequent database query. Sincerely Serena

2 1

Re: [basex-talk] about performance
by Christian Grün 20 Jul '11

20 Jul '11

I got your example working after closing one element in your example document. Still I couldn't reproduce the problem you encountered. Note, however, that you are calling " $query->more() " twice without retrieving the first result. If your problem persists, please try to run your code with the stable version of BaseX (http://files.basex.org/releases/latest/), and give us some more hints. Christian ___________________________ On Wed, Jul 20, 2011 at 8:28 PM, Lusha Wang <lwang40(a)syr.edu> wrote: > <?xml version="1.0" encoding="UTF-8"?> > <root> > ... > From: Christian Grün [christian.gruen(a)gmail.com] > Sent: Wednesday, July 20, 2011 1:16 PM > To: Lusha Wang; BaseX > Subject: Re: [basex-talk] about performance > > Serena, > > this is better than nothing, but I still need more info (at least an > input document that allows me to run your query out of the box) to get > a clue what might go on. > > Christian > ___________________________ > > 2011/7/20 Lusha Wang <lwang40(a)syr.edu>: >> hI Christian >> I feel like this is not about my code. Because most of the time I can get results correctly. But I still pasted my code in the following: >> >> <html> >> <body> >> <?php >> >> include("BaseXClient.php"); >> $start=$_GET['start']; >> $end = $_GET['end']; >> //$type=$_GET['type']; >> >> >> if($start!=null && $end!=null) >> { >> echo "all entites that are within this time period:".$start."--".$end."<br>"; >> >> >> $cmd='for $Document in doc("newdf")//Document[xs:date(./Date/text()) <=xs:date("'.$end.'") and xs:date(./Date/text()) >=xs:date("'.$start.'")] return <Document>{ for $d in $Document/HasDomain/@domain/data() where $Document/HasDomain return <Domain>{attribute{"id"}{$d}, attribute{"data"}{doc("newdf")//Domain[@id/data()=$d]/Name/text()}}</Domain>, for $u in $Document/HasURL/@url/data() where $Document/HasURL return <URL>{attribute{"id"}{$u}, attribute{"data"}{doc("newdf")//URL[@id/data()=$u]/Name/text()} }</URL>, for $i in $Document/HasIP/@ip/data() where $Document/HasIP return <IP>{attribute{"id"}{$i}, attribute{"data"}{doc("newdf")//Ip[@id/data()=$i]/Name/text()}}</IP>, $Document/Time,$Document/Author,$Document/IsReply}</Document>'; >> } >> >> >> >> // commands to be performed >> >> $replace_string=array("<Document>"=>" ","</Document>"=>" ","<Domain"=>" ","/>"=>" ","<URL"=>" ","<IP"=>" ","<Author"=>" ","<Time>"=>" ","</Time>"=>" "); >> try { >> >> set_time_limit(0); >> ini_set('max_execution_time',1000); >> // create session >> $session = new Session("localhost", 1984, "admin", "admin"); >> if($cmd!=null) >> { >> >> $query = $session->query($cmd); >> print $query->init(); >> $count=0; >> if(!$query->more()) echo "no results"; >> while($query->more()) { >> $result=$query->next(); >> $result=strtr($result,$replace_string); >> echo $result."<br>"; >> >> } >> >> print $query->close(); >> } >> print $session->close(); >> } catch (Exception $e) { >> // print exception >> print $e->getMessage(); >> } >> ?> >> </body> >> </html> >> ________________________________________ >> From: Christian Grün [christian.gruen(a)gmail.com] >> Sent: Wednesday, July 20, 2011 12:59 PM >> To: Lusha Wang >> Cc: basex-talk(a)mailman.uni-konstanz.de >> Subject: Re: [basex-talk] about performance >> >> Serena, >> >> thanks for your e-mail, and.. Sorry, it's difficult to give you advice >> without any reproducible code [1]. Please take some time and send us a >> small code example that allows us to find out what's going wrong. >> >> Best, >> Christian >> >> [1] http://sscce.org/ >> ___________________________ >> >> On Wed, Jul 20, 2011 at 7:52 PM, Lusha Wang <lwang40(a)syr.edu> wrote: >>> Hello Everyone >>> When I tried the online basex demo, no mater how frequent I submit >>> the query, i can always get results. However, in my own machine, i started >>> the basex server, and then I use php script to query the server, sometimes, >>> no results are returned. Is there any way to solve this problem? Thanks a >>> lot. >>> >>> >>> Sincerely >>> Serena >

1 0

Re: [basex-talk] about performance
by Christian Grün 20 Jul '11

20 Jul '11

Serena, this is better than nothing, but I still need more info (at least an input document that allows me to run your query out of the box) to get a clue what might go on. Christian ___________________________ 2011/7/20 Lusha Wang <lwang40(a)syr.edu>: > hI Christian > I feel like this is not about my code. Because most of the time I can get results correctly. But I still pasted my code in the following： > > <html> > <body> > <?php > > include("BaseXClient.php"); > $start=$_GET['start']; > $end = $_GET['end']; > //$type=$_GET['type']; > > > if($start!=null && $end!=null) > { > echo "all entites that are within this time period:".$start."--".$end."<br>"; > > > $cmd='for $Document in doc("newdf")//Document[xs:date(./Date/text()) <=xs:date("'.$end.'") and xs:date(./Date/text()) >=xs:date("'.$start.'")] return <Document>{ for $d in $Document/HasDomain/@domain/data() where $Document/HasDomain return <Domain>{attribute{"id"}{$d}, attribute{"data"}{doc("newdf")//Domain[@id/data()=$d]/Name/text()}}</Domain>, for $u in $Document/HasURL/@url/data() where $Document/HasURL return <URL>{attribute{"id"}{$u}, attribute{"data"}{doc("newdf")//URL[@id/data()=$u]/Name/text()} }</URL>, for $i in $Document/HasIP/@ip/data() where $Document/HasIP return <IP>{attribute{"id"}{$i}, attribute{"data"}{doc("newdf")//Ip[@id/data()=$i]/Name/text()}}</IP>, $Document/Time,$Document/Author,$Document/IsReply}</Document>'; > } > > > > // commands to be performed > > $replace_string=array("<Document>"=>" ","</Document>"=>" ","<Domain"=>" ","/>"=>" ","<URL"=>" ","<IP"=>" ","<Author"=>" ","<Time>"=>" ","</Time>"=>" "); > try { > > set_time_limit(0); > ini_set('max_execution_time',1000); > // create session > $session = new Session("localhost", 1984, "admin", "admin"); > if($cmd!=null) > { > > $query = $session->query($cmd); > print $query->init(); > $count=0; > if(!$query->more()) echo "no results"; > while($query->more()) { > $result=$query->next(); > $result=strtr($result,$replace_string); > echo $result."<br>"; > > } > > print $query->close(); > } > print $session->close(); > } catch (Exception $e) { > // print exception > print $e->getMessage(); > } > ?> > </body> > </html> > ________________________________________ > From: Christian Grün [christian.gruen(a)gmail.com] > Sent: Wednesday, July 20, 2011 12:59 PM > To: Lusha Wang > Cc: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] about performance > > Serena, > > thanks for your e-mail, and.. Sorry, it's difficult to give you advice > without any reproducible code [1]. Please take some time and send us a > small code example that allows us to find out what's going wrong. > > Best, > Christian > > [1] http://sscce.org/ > ___________________________ > > On Wed, Jul 20, 2011 at 7:52 PM, Lusha Wang <lwang40(a)syr.edu> wrote: >> Hello Everyone >> When I tried the online basex demo, no mater how frequent I submit >> the query, i can always get results. However, in my own machine, i started >> the basex server, and then I use php script to query the server, sometimes, >> no results are returned. Is there any way to solve this problem? Thanks a >> lot. >> >> >> Sincerely >> Serena

1 0

about performance
by Lusha Wang 20 Jul '11

20 Jul '11

Hello Everyone When I tried the online basex demo, no mater how frequent I submit the query, i can always get results. However, in my own machine, i started the basex server, and then I use php script to query the server, sometimes, no results are returned. Is there any way to solve this problem? Thanks a lot. Sincerely Serena

2 1

a question about return values and data query
by Lusha Wang 20 Jul '11

20 Jul '11

Hi Everyone I have to questions: 1) Is it possible to return sth formatted string like this: return <Document>{$Document/HasDomain/@id /data()+"%%"+$Document/Time/text()}</Document> So far it shows errors.....I dont know if there are alternatives. 2) I have data like this <Documents> <Document id="doc1"> <Date>yyyy-mm-dd</Date> <HasIP ip="ip1"> <HasDomain domain="domain1"> <HasDomain domain="domain2"> </Document> <Document id="doc1"> <Date>yyyy-mm-dd</Date> <HasIP ip="ip2"> <HasDomain domain="domain1"> <HasDomain domain="domain3"> </Document> </Documents> <IPs> <IP id="ip1"> <data>111.111.111.111</data> </IP> <IP id="ip2"> <data>111.111.111.112</data> </IP> </IPs> <Domains> <Domain id="domain1"> <data>abc.com</data> </Domain> <Domain id="domain2"> <data>edf.com</data> </Domain> <Domain id="domain3"> <data>abc.com</data> </Domain> <Domains> I m trying to get all domains from documents that are within the following time period. for $Document in doc('test')//Document let $datestr := $Document/Date/text() let $date := xs:date($datestr) where $date<=xs:date("2010-05-02") and $date>xs:date("2010-05-01") and $Document/HasDomain return <Document>{$Document/HasDomain, $Document/Time/text()}</Document> However, only the domain ids are returned, I cant make the database return domain data rather than id. Can anyone offer me some suggestions? Thanks a lot. Sincerely Lusha

2 1

help! database query for specific time period
by Lusha Wang 18 Jul '11

18 Jul '11

Hi Guys Is it possible to query for specific time period of data? I really appreciate any help. <Documents> <Document id=" " time=" "> .............. </Document> <Document id=" " time=" "> .............. </Document> </Documents> Sincerely Serena

3 4

Re: [basex-talk] bulk-load
by Christian Grün 16 Jul '11

16 Jul '11

Dear Tomaso, dear Michael, today, I had a closer look into the BaseX routines that are responsible for adding new documents to the database, and I tweaked the update code of our document index to avoid linear costs for adding single documents. You are invited to check out the latest stable snapshot [1] and give us your valuable feedback. There are still some bottlenecks: - the default XML parser takes some time for initialization, which is particularly noticable for small documents. You'll get some performance boost by switching to the internal parser (Command: set intparse; see [2] for details). - as each BaseX database command is atomic, the data is flushed to disk after each update to avoid data loss. You may either specify a directory on disk to add multiple files at once, or choose to insert nodes instead of documents, which will give you better performance. Hope this helps, Christian [1] http://files.basex.org/releases/latest/basex-6.7.1-SNAPSHOT.jar [2] http://docs.basex.org/wiki/Parsers ___________________________ On Mon, Jul 4, 2011 at 8:22 PM, Christian Grün <christian.gruen(a)gmail.com> wrote: > Hi Tomaso, > >> From your answer I suppose there is something slower >> when Add() is called many times, and faster if we use CreateDb. >> Can you explain why the times increase? Is it because Add >> updates the index each time? > > Exactly; as the ADD operation is an atomic operation, there is > currently no way to define a batch operation (other than going more > low level, and looking at the Add command [1]). It might be that some > update operations could be delayed though; I've added this as an issue > (feel free to include more details) [2]. > > Christian > > [1] https://github.com/BaseXdb/basex/blob/master/src/main/java/org/basex/core/c… > [2] https://github.com/BaseXdb/basex/issues/137 >

1 0

Re: [basex-talk] how to specify xml-stylesheet when generating xml ?
by Eric 15 Jul '11

15 Jul '11

Leo Wörteler <lw(a)basex.org> wrote: >Dear Fabrice, > >Am 15.07.2011 11:18, schrieb Fabrice Etanchaud: >> I would like to add something like <?xml-stylesheet type="text/xsl" >> href="linktomystylesheet.xsl"?>between the xml declaration and the >> generated xml. >> I did not find any xml-stylesheet option for serialization. > >as BaseX doesn't have to understand what xml-stylesheet does, it treats >it like any other processing instruction [1]. To add one to your output >document, just insert it as the first node: > > > declare option output:omit-xml-declaration "no"; > > > > let $generated-xml := <foo><bar/></foo> > > return document { > > <?xml-stylesheet type="text/xsl" href="linktomystylesheet.xsl"?>, > > text { '
' }, > > $generated-xml > > } > >This produces: > > > <?xml version="1.0" encoding="UTF-8"?> > > <?xml-stylesheet type="text/xsl" href="linktomystylesheet.xsl"?> > > <foo> > > <bar/> > > </foo> > >Note that 
 is the entity for the ASCII newline character, I >inserted it only for readability. > >> BaseX is just wonderful. > >Thank you! > >Leo >__________ >[1] http://en.wikipedia.org/wiki/Processing_instruction >_______________________________________________ >BaseX-Talk mailing list >BaseX-Talk(a)mailman.uni-konstanz.de >https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk July 2011