December 2011 - BaseX-Talk - mailman.uni-konstanz.de

incremental update of index
by Fabrice Etanchaud 13 Dec '11

13 Dec '11

dear all at BaseX, concerning BaseX 7.1 beta, Are incremental index updated after db:add, db:replace and db:delete calls ? best regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

Whatever happened to DeepFS
by Andy Bunce 13 Dec '11

13 Dec '11

Hi, I was looking for this feature in version 7. https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/000994.ht… says it was temporarily removed from the GUI but create fs [name] [path] gives an error in 7.0.1. Is this feature gone for good now? /Andy

5 8

Re: [basex-talk] BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

On Mon, Dec 12, 2011 at 4:50 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: > Dear Christian, > Thank's for your quick reply. I try to give you an example as I don't > think my english is good enough to explain you otherwise: > For a xml like: > <AAA> > <BBB att1="bbb"> > <CCC att1="ccc"/> > <DDD att1="ddd"> > <EEE att1="eee"/> > </DDD> > </BBB> > </AAA> > If i search for "ddd" i need the result to be: > <AAA> > <BBB att1="bbb"> > <DDD att1="ddd"/> > </BBB> > </AAA> > > Maybe this result can be achieved using xquery, I'm not sure as I don't > know xquery well enough. I only tried using xpath, and with xquery I > only scratched the surface, and as it wasn't leading me in the right > direction and I was running out of time I had to use the solution that I've > send you. From what I could figure out in Serializer.java, it seems to me > that all the children of a result are serialized as well. I think it's > worth mentioning that I don't know the structure of the xml in which i'm > serching, and with XMLExtractSerializer I only use the xpath //*[@* > contains text '%s'] and it gives me the result I need. > If you think this can be achieved using XQuery please let me know and I'll > allocate more time to look into it. > Thank you for your time! > Best regards, > Tiberiu > > On Mon, Dec 12, 2011 at 4:22 PM, Christian Grün <christian.gruen(a)gmail.com > > wrote: > >> Dear Tiberiu Tofan, >> >> thanks for your code snippet, always welcome! Before including new >> code, I'd like to ensure that it will represent added value for other >> users as well, so.. may I ask what your XMLExtractSerializer class is >> supposed to do? Maybe it can also be realized via XQuery? >> >> Christian >> ___________________________ >> >> On Mon, Dec 12, 2011 at 3:15 PM, Tiberiu Tofan <tibtof(a)gmail.com> wrote: >> > Hi, >> > I work on a project involving some large xml files that we need to >> search >> > for specific attribute values, and I tried a solution based on BaseX >> > database. After several hours of searching I found no way to serialize >> the >> > answer as I needed (the elements that had the searched attribute value >> and >> > all their parents). As I only had two days for a proof-of-concept I >> made my >> > own serializer and now the result is as I expect it to be. As I find >> these >> > feature to be useful I attached the source code and maybe you'll >> consider to >> > include such a feature in a future release. Unfortunately I had to hack >> > Serializer.java, as the node() method was final, and I suggest you at >> least >> > to make the Serializer more configurable (eg. a properties file for the >> > serialization options and the class to use and then >> > reflection, splitting the node() method into several override-able >> > sub-methods). >> > On the other hand, maybe there is a way to obtain the result I needed >> using >> > the existing features of basex, but as I told you I hadn't much time and >> > this seemed to me the quickest solution. >> > >> > Best Regards, >> > Tiberiu Tofan >> > >> > _______________________________________________ >> > BaseX-Talk mailing list >> > BaseX-Talk(a)mailman.uni-konstanz.de >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > >

2 1

BaseX Serializer
by Tiberiu Tofan 12 Dec '11

12 Dec '11

Hi, I work on a project involving some large xml files that we need to search for specific attribute values, and I tried a solution based on BaseX database. After several hours of searching I found no way to serialize the answer as I needed (the elements that had the searched attribute value and all their parents). As I only had two days for a proof-of-concept I made my own serializer and now the result is as I expect it to be. As I find these feature to be useful I attached the source code and maybe you'll consider to include such a feature in a future release. Unfortunately I had to hack Serializer.java, as the node() method was final, and I suggest you at least to make the Serializer more configurable (eg. a properties file for the serialization options and the class to use and then reflection, splitting the node() method into several override-able sub-methods). On the other hand, maybe there is a way to obtain the result I needed using the existing features of basex, but as I told you I hadn't much time and this seemed to me the quickest solution. Best Regards, Tiberiu Tofan

2 1

basexhttp server serving html document?
by Erol Akarsu 11 Dec '11

11 Dec '11

Christian, I would like to know the scalability and performance of basex if we used it as Web server serving HTML documents for web clients. Think about we would be using basexhttp server. Have we done any load testing for multiple concurrent users on basexhttp server? Do we have any performance metrics available to share with me? Best Regards Erol Akarsu On Sat, Dec 10, 2011 at 6:16 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: > Christian, > > Nothing wrong on Basex side. > > It was my error no handling one type of input in html page. > > Basex works perfectly, > > It was first time to use Basex as web scrapping tool. It did indeed very > nicely and perfectly. > > Great job of Basex team > > Erol Akarsu > > > On Fri, Dec 9, 2011 at 4:55 PM, Christian Grün <christian.gruen(a)gmail.com>wrote: > >> ..wow, I've never managed to do segmentation faults with Java ;) Seems >> to be an error in your JVM, which will have to be reported to Oracle. >> >> How long did you run your script? Did you manage to find the script >> with the unparsed "µ" ? >> >> Christian >> ___________________________ >> >> On Fri, Dec 9, 2011 at 10:37 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> > Christian, >> > >> > Attached xquery file run gives segmentation fault. You can run it and >> see >> > it: >> > >> > eakarsu@ubuntu:~/Neweggdata/scripts$ xquery1 xq5 >> > /home/eakarsu/basex/bin/xquery1: line 20: 808 Segmentation fault >> java >> > -cp "$CP" $VM org.basex.BaseX "$@" >> > >> > Erol Akarsu >> > >> > >> > On Fri, Dec 9, 2011 at 10:55 AM, Christian Grün < >> christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> It's probably an encoding issue. Could you provide us with the >> >> relevant $url or original file? >> >> ___________________________ >> >> >> >> On Fri, Dec 9, 2011 at 4:24 PM, Erol Akarsu <eakarsu(a)gmail.com> wrote: >> >> > Christian, >> >> > >> >> > It won't work with latest version of Basex also. >> >> > >> >> > Erol Akarsu >> >> > >> >> > >> >> > On Fri, Dec 9, 2011 at 9:52 AM, Christian Grün >> >> > <christian.gruen(a)gmail.com> >> >> > wrote: >> >> >> >> >> >> Thanks Erol, >> >> >> >> >> >> have you tried the latest version >> >> >> (http://files.basex.org/releases/latest/)? >> >> >> >> >> >> Best, >> >> >> Christian >> >> >> ___________________________ >> >> >> >> >> >> On Fri, Dec 9, 2011 at 3:49 PM, Erol Akarsu <eakarsu(a)gmail.com> >> wrote: >> >> >> > >> >> >> > When I was fetching and parsing some html documents with >> >> >> > >> >> >> > let $doc := http:send-request(<http:request method='get' >> >> >> > href='{$url}'/>) >> >> >> > >> >> >> > I am getting an error: >> >> >> > >> >> >> > [FOHC0001] An HTTP error occurred: "1323441640568.xml" (Line 475): >> >> >> > Invalid >> >> >> > character found: 'µ'. >> >> >> > >> >> >> > It seems base is not able to handle special chracter 'µ'. >> >> >> > >> >> >> > >> >> >> > Erol Akarsu >> >> >> > >> >> >> > _______________________________________________ >> >> >> > BaseX-Talk mailing list >> >> >> > BaseX-Talk(a)mailman.uni-konstanz.de >> >> >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> > >> >> > >> >> > >> > >> > >> > >

2 1

Portuguese stemmer
by Michael Piotrowski 11 Dec '11

11 Dec '11

Hi, When trying to use the Portuguese stemmer (from the GUI), I get the following error: --8<---------------cut here---------------start------------->8--- Version: BaseX 7.0.2 Java: Apple Inc., 1.6.0_29 OS: Mac OS X, x86_64 Stack Trace: java.lang.NullPointerException org.basex.util.Token.token(Token.java:154) org.basex.util.ft.LuceneStemmer.stem(LuceneStemmer.java:133) org.basex.util.ft.Stemmer.nextToken(Stemmer.java:96) org.basex.util.ft.FTLexer.nextToken(FTLexer.java:119) org.basex.index.ft.FTBuilder.index(FTBuilder.java:122) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:48) org.basex.index.ft.FTTrieBuilder.build(FTTrieBuilder.java:1) org.basex.core.cmd.ACreate.index(ACreate.java:154) org.basex.core.cmd.ACreate.index(ACreate.java:131) org.basex.core.cmd.CreateIndex.run(CreateIndex.java:63) org.basex.core.Command.run(Command.java:328) org.basex.core.Command.run(Command.java:116) org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:135) --8<---------------cut here---------------end--------------->8--- I had a look in lucene-stemmers-3.4.0.jar; could the problem be that the Portuguese stemmer is actually a Snowball, not a Lucene stemmer? Thanks and best regards -- Dr.-Ing. Michael Piotrowski, M.A. <mxp(a)cl.uzh.ch> Institute of Computational Linguistics, University of Zurich Phone +41 44 63-54313 | OpenPGP public key ID 0x1614A044 * OUT NOW: Systems and Frameworks for Computational Morphology * <http://www.springeronline.com/978-3-642-23137-7>

3 8

basex 7.0.2: no context item for root error
by Andy Bunce 11 Dec '11

11 Dec '11

Hi with the factbook.xml database open in the 7.0.2 gui declare function local:linkto($id as xs:string){ let $d:=//city let $a:=$d[@id=$id] return $a }; local:linkto("f0_1461") Gives the "no context item for root" error on the //city line, but declare function local:linkto($id as xs:string){ let $a:=//city[@id=$id] return $a }; local:linkto("f0_1461") Works fine. Should it give the same error? If it should, and I try to pass the nodes into the function then the relative performance is not good at all. declare function local:linkto2($id as xs:string,$nodes as node()*){ let $c:=$nodes[@id=$id] let $n:=name($c[1]) return <a href="/fb/{$n}/{$id}"> {$c/name/string()} </a> }; let $caps:=//country/@capital/string() for $id in $caps return local:linkto2($id,//city) /Andy

2 3

Old factbook/Mo version
by Andy Bunce 11 Dec '11

11 Dec '11

Hi, The version of factbook.xml http://files.basex.org/xml/factbook.xml is not the latest. It suffers from repeated ids. The happens for cities in more than one province. http://www.dbis.informatik.uni-goettingen.de/Mondial/ has a more up to date version with a slightly different schema without this problem. (As used by existDb :-) /Andy

2 1

reporting a BUG in the IOFile class
by VORS, Guilhem (CIMPA SAS) 10 Dec '11

10 Dec '11

To all the baseX team, First of all I would like to thank you for the great tool you made. We use it almost every day in our team. One member had actually developed a pluggin for xml validation some years ago. To the bug trackers, I would like to report a strange behaviour regarding the IOFile class, using baseX702 jar file, eclipse indigo, along with JDK 1.7.0_01 When trying to execute the CreateDB command to build a local baseX database from a distant file (say fileInputPath = "//filer/distant/file.xml"), when you proceed with the static method by doing: BufferedInputStream bis = new BufferedInputStream(new FileInputStream( fileInputPath)); SAXSource saxSource = new SAXSource(new InputSource(bis)); SAXWrapper saxWrapper = new SAXWrapper(saxSource, context.prop); CreateDB.create(dbName, saxWrapper, context); Everything works fine. BUT, when you try to do the same using the non static method, by doing (which I need because I have to report the progress of the create command in a JProgressBar): create = new CreateDB(dbName, fileInputPath); create.execute(context); You get the following exception: org.basex.core.BaseXException: "filer/distant/file.xml ": (here the path where the command is run)/filer/distant/file.xml (unknown path or something like that (in French it's :"le chemin d'accès spécifié est introuvable")). After some bug tracking, it appears that in the function create, in static class PathList, inside the IOFile class, there is a mistreatment of the path, here is the function: static class PathList extends StringList { /** * Creates a path. * @param path input path * @return path */ String create(final String path) { final TokenBuilder tb = new TokenBuilder(); final int l = path.length(); for(int i = 0; i < l; ++i) { final char ch = path.charAt(i); if(ch == '\\' || ch == '/') add(tb); else tb.add(ch); } add(tb); for(int s = 0; s < size; ++s) { // if(s == 0 && (path.startsWith("\\\\") || path.startsWith("//"))) tb.add("//"); // this is my current "hack" to resolve the problem) if(s != 0 || path.startsWith("/")) tb.add('/'); tb.add(list[s]); } return tb.toString(); } If I don't uncomment my line, I get the error described above, because the TokenBuilder remove the first two '/' from the path it builds. What I have done to solve the problem, is to make a local copy of IOFile + CreateDB, and I have added the line commented, to add the leading '//' in front of remote file access. This workaround works well for my project, but it is not convenient for me, as I would like to get the new versions of baseX. Could you please find a way to resolve this problem, I don't know if it is intentional, or even if I'm using it the right way. Again thank you for your professional quality software. I'm waiting forward to have news from you. Guilhem VORS iSLM Business Solution Integration AIRBUS CIMPA SAS Phone : +33 (0) 5 61 53 50 28 Fax : +33 (0) 5 67 19 95 52 E-mail : guilhem.vors(a)airbus.com The information in this e-mail is confidential. The contents may not be disclosed or used by anyone other than the addressee. Access to this e-mail by anyone else is unauthorised. If you are not the intended recipient, please notify Airbus immediately and delete this e-mail. Airbus cannot accept any responsibility for the accuracy or completeness of this e-mail as it has been sent over public networks. If you have any concerns over the content of this message or its Accuracy or Integrity, please contact Airbus immediately. All outgoing e-mails from Airbus are checked using regularly updated virus scanning software but you should take whatever measures you deem to be appropriate to ensure that this message and any attachments are virus free.

2 1

can't call the outer most return value by name
by jidanni＠jidanni.org 09 Dec '11

09 Dec '11

Odd, one can see <R> but not access by it. Run this: declare function local:K($x){ switch ($x) case 2 return <R><name>N</name><o><name>Y</name></o></R> default return() }; " A",local:K(2)//*:R, " B",local:K(2)/o/name, (: shows we are already at the root :) " C",local:K(2)/., (: reveals R is really in there, but can't be called by name :) " D",local:K(2)/./R What's the deal?

2 1