- BaseX-Talk - mailman.uni-konstanz.de

streaming the output to another file in BaseX database
by Huy Vu 19 Dec '11

19 Dec '11

Hello, I am writing my code in Java and the result after querying xml files in my BaseX database is very large, about 500MB. Thus, I would like to stream the output to another xml file in the BaseX database. Could you tell me how to do this? Many thanks, Huy Vu -- Huy Vu Oxford University, United Kingdom http://www.cs.ox.ac.uk/people/huy.vu/

2 8

Using the BaseX REST interface from JavaScript
by Michael Piotrowski 19 Dec '11

19 Dec '11

Hi, I'm new at this, so please excuse if I missed something obvious... BaseX implements a REST interface via basexhttp and JavaScript frameworks like Ext JS allow you to use a REST interface for accessing data. So I thought it may be possible to create a Web interface to a corpus stored in BaseX that enables users to search the corpus and update the annotations *without* writing server-side code. The first obstacle I encountered is that under the same-orgin policy browsers consider localhost and localhost:8984 two separate domains and inhibit XmlHttpRequests calls, and basexhttp seems not to support cross-origin resource sharing (see <http://enable-cors.org/>). Using BaseX as a data store for an Ext JS component without having to write server-side code seems very attractive. However, I'm now wondering whether this approach makes sense at all. Has anybody tried to do something like this? Thanks in advance! Best regards -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

2 2

Approaches for XML merging and conflict resolution
by Eric Murphy 19 Dec '11

19 Dec '11

All, I am looking at using BaseX for a prototype that requires synchronization of XML data. In other words, XML documents may need to be merged and there might be conflicts. This seems like a complex issue and I wonder if anyone has conquered this before. The only thing that I can think of to do is to version nodes which may have conflicts. For example: <person> <name> <first version="2">Erik</first>  <last version="1">Murphy</last> </name> </person> If I do a merge and the <first> version is >= last known version (1) + 1 ( which is 2 or greater), then I would know there is a conflict. A possible solution is there could be a deferment of conflict resolution, and data could be inserted like this: <person> <name> <first version="3">Eric</first>  <first version="2">Erik</first> <last version="1">Murphy</last> </name> </person> The application would be responsible for resolving the conflict when the nodes are read at a later time. Like I said, this all seems very complicated, so maybe there is an elegant solution which I have not thought of. Thank you, Eric Murphy

1 0

BaseX Meetup, XML Prague
by Christian Grün 18 Dec '11

18 Dec '11

Dear all, we’re glad to announce the first BaseX Meetup aligned with the XML Prague Conference. The meetup will take place if we know that there will be enough participants on site, so.. you are invited to join in as soon as possible! http://lanyrd.com/2012/basexprague Note that your registration is non-binding, and free if you will participate at the main conference as well ...which is cheap, a really great opportunity which you shouldn't miss anyway! Find some more information on XML Prague on this page: http://www.xmlprague.cz Looking forward to meeting you live, Christian ___________________________ BaseX Team Christian Grün Uni KN, Box 188 D-78457 Konstanz http://www.basex.org

1 0

incremental update of index
by Fabrice Etanchaud 13 Dec '11

13 Dec '11

dear all at BaseX, concerning BaseX 7.1 beta, Are incremental index updated after db:add, db:replace and db:delete calls ? best regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

Whatever happened to DeepFS
by Andy Bunce 13 Dec '11

13 Dec '11

Hi, I was looking for this feature in version 7. https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/000994.ht… says it was temporarily removed from the GUI but create fs [name] [path] gives an error in 7.0.1. Is this feature gone for good now? /Andy

5 8

Re: [basex-talk] BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

On Mon, Dec 12, 2011 at 4:50 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: > Dear Christian, > Thank's for your quick reply. I try to give you an example as I don't > think my english is good enough to explain you otherwise: > For a xml like: > <AAA> > <BBB att1="bbb"> > <CCC att1="ccc"/> > <DDD att1="ddd"> > <EEE att1="eee"/> > </DDD> > </BBB> > </AAA> > If i search for "ddd" i need the result to be: > <AAA> > <BBB att1="bbb"> > <DDD att1="ddd"/> > </BBB> > </AAA> > > Maybe this result can be achieved using xquery, I'm not sure as I don't > know xquery well enough. I only tried using xpath, and with xquery I > only scratched the surface, and as it wasn't leading me in the right > direction and I was running out of time I had to use the solution that I've > send you. From what I could figure out in Serializer.java, it seems to me > that all the children of a result are serialized as well. I think it's > worth mentioning that I don't know the structure of the xml in which i'm > serching, and with XMLExtractSerializer I only use the xpath //*[@* > contains text '%s'] and it gives me the result I need. > If you think this can be achieved using XQuery please let me know and I'll > allocate more time to look into it. > Thank you for your time! > Best regards, > Tiberiu > > On Mon, Dec 12, 2011 at 4:22 PM, Christian Grün <christian.gruen(a)gmail.com > > wrote: > >> Dear Tiberiu Tofan, >> >> thanks for your code snippet, always welcome! Before including new >> code, I'd like to ensure that it will represent added value for other >> users as well, so.. may I ask what your XMLExtractSerializer class is >> supposed to do? Maybe it can also be realized via XQuery? >> >> Christian >> ___________________________ >> >> On Mon, Dec 12, 2011 at 3:15 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: >> > Hi, >> > I work on a project involving some large xml files that we need to >> search >> > for specific attribute values, and I tried a solution based on BaseX >> > database. After several hours of searching I found no way to serialize >> the >> > answer as I needed (the elements that had the searched attribute value >> and >> > all their parents). As I only had two days for a proof-of-concept I >> made my >> > own serializer and now the result is as I expect it to be. As I find >> these >> > feature to be useful I attached the source code and maybe you'll >> consider to >> > include such a feature in a future release. Unfortunately I had to hack >> > Serializer.java, as the node() method was final, and I suggest you at >> least >> > to make the Serializer more configurable (eg. a properties file for the >> > serialization options and the class to use and then >> > reflection, splitting the node() method into several override-able >> > sub-methods). >> > On the other hand, maybe there is a way to obtain the result I needed >> using >> > the existing features of basex, but as I told you I hadn't much time and >> > this seemed to me the quickest solution. >> > >> > Best Regards, >> > Tiberiu Tofan >> > >> > _______________________________________________ >> > BaseX-Talk mailing list >> > BaseX-Talk(a)mailman.uni-konstanz.de >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > >

2 1

BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

Hi, I work on a project involving some large xml files that we need to search for specific attribute values, and I tried a solution based on BaseX database. After several hours of searching I found no way to serialize the answer as I needed (the elements that had the searched attribute value and all their parents). As I only had two days for a proof-of-concept I made my own serializer and now the result is as I expect it to be. As I find these feature to be useful I attached the source code and maybe you'll consider to include such a feature in a future release. Unfortunately I had to hack Serializer.java, as the node() method was final, and I suggest you at least to make the Serializer more configurable (eg. a properties file for the serialization options and the class to use and then reflection, splitting the node() method into several override-able sub-methods). On the other hand, maybe there is a way to obtain the result I needed using the existing features of basex, but as I told you I hadn't much time and this seemed to me the quickest solution. Best Regards, Tiberiu Tofan

2 1

basexhttp server serving html document?
by Erol Akarsu 11 Dec '11

11 Dec '11

Christian, I would like to know the scalability and performance of basex if we used it as Web server serving HTML documents for web clients. Think about we would be using basexhttp server. Have we done any load testing for multiple concurrent users on basexhttp server? Do we have any performance metrics available to share with me? Best Regards Erol Akarsu On Sat, Dec 10, 2011 at 6:16 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Christian, > > Nothing wrong on Basex side. > > It was my error no handling one type of input in html page. > > Basex works perfectly, > > It was first time to use Basex as web scrapping tool. It did indeed very > nicely and perfectly. > > Great job of Basex team > > Erol Akarsu > > > On Fri, Dec 9, 2011 at 4:55 PM, Christian Grün <christian.gruen(a)gmail.com>wrote: > >> ..wow, I've never managed to do segmentation faults with Java ;) Seems >> to be an error in your JVM, which will have to be reported to Oracle. >> >> How long did you run your script? Did you manage to find the script >> with the unparsed "µ" ? >> >> Christian >> ___________________________ >> >> On Fri, Dec 9, 2011 at 10:37 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> > Christian, >> > >> > Attached xquery file run gives segmentation fault. You can run it and >> see >> > it: >> > >> > eakarsu@ubuntu:~/Neweggdata/scripts$ xquery1 xq5 >> > /home/eakarsu/basex/bin/xquery1: line 20: 808 Segmentation fault >> java >> > -cp "$CP" $VM org.basex.BaseX "$@" >> > >> > Erol Akarsu >> > >> > >> > On Fri, Dec 9, 2011 at 10:55 AM, Christian Grün < >> christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> It's probably an encoding issue. Could you provide us with the >> >> relevant $url or original file? >> >> ___________________________ >> >> >> >> On Fri, Dec 9, 2011 at 4:24 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >> > Christian, >> >> > >> >> > It won't work with latest version of Basex also. >> >> > >> >> > Erol Akarsu >> >> > >> >> > >> >> > On Fri, Dec 9, 2011 at 9:52 AM, Christian Grün >> >> > <christian.gruen(a)gmail.com> >> >> > wrote: >> >> >> >> >> >> Thanks Erol, >> >> >> >> >> >> have you tried the latest version >> >> >> (http://files.basex.org/releases/latest/)? >> >> >> >> >> >> Best, >> >> >> Christian >> >> >> ___________________________ >> >> >> >> >> >> On Fri, Dec 9, 2011 at 3:49 PM, Erol Akarsu <eakarsu(a)gmail.com> >> wrote: >> >> >> > >> >> >> > When I was fetching and parsing some html documents with >> >> >> > >> >> >> > let $doc := http:send-request(<http:request method='get' >> >> >> > href='{$url}'/>) >> >> >> > >> >> >> > I am getting an error: >> >> >> > >> >> >> > [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): >> >> >> > Invalid >> >> >> > character found: 'µ'. >> >> >> > >> >> >> > It seems base is not able to handle special chracter 'µ'. >> >> >> > >> >> >> > >> >> >> > Erol Akarsu >> >> >> > >> >> >> > _______________________________________________ >> >> >> > BaseX-Talk mailing list >> >> >> > BaseX-Talk(a)mailman.uni-konstanz.de >> >> >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> > >> >> > >> >> > >> > >> > >> > >

2 1

Portuguese stemmer
by Michael Piotrowski 11 Dec '11

11 Dec '11

Hi, When trying to use the Portuguese stemmer (from the GUI), I get the following error: --8<---------------cut here---------------start------------->8--- Version: BaseX 7.0.2 Java: Apple Inc., 1.6.0_29 OS: Mac OS X, x86_64 Stack Trace: java.lang.NullPointerException org.basex.util.Token.token(Token.java:154) org.basex.util.ft.LuceneStemmer.stem(LuceneStemmer.java:133) org.basex.util.ft.Stemmer.nextToken(Stemmer.java:96) org.basex.util.ft.FTLexer.nextToken(FTLexer.java:119) org.basex.index.ft.FTBuilder.index(FTBuilder.java:122) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:48) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:1) org.basex.core.cmd.ACreate.index(ACreate.java:154) org.basex.core.cmd.ACreate.index(ACreate.java:131) org.basex.core.cmd.CreateIndex.run(CreateIndex.java:63) org.basex.core.Command.run(Command.java:328) org.basex.core.Command.run(Command.java:116) org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:135) --8<---------------cut here---------------end--------------->8--- I had a look in lucene-stemmers-3.4.0.jar; could the problem be that the Portuguese stemmer is actually a Snowball, not a Lucene stemmer? Thanks and best regards -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

3 8