January 2011 - BaseX-Talk - mailman.uni-konstanz.de

Unique node identifier?
by NewIntellectual 25 Jan '11

25 Jan '11

Is there a function to retrieve a persistent unique node identifier from any given retrieved node? I thought it would be db:node-id($node) but that is returning '0'.

2 3

Re: [basex-talk] Strange query plan difference
by Christian Grün 25 Jan '11

25 Jan '11

Hi Philip (cc:mailing list), does the index still work if you reopen the GUI and run your query? Next, which full-text options have you set? Christian ___________________________ On Tue, Jan 25, 2011 at 10:15 AM, Philip Oliver <phil3(a)olivercomputing.com> wrote: > Christian - I've gotten around to trying BaseX 6.5.1 (generated from SVN) with some code changes, and I'm trying to figure out some strange behavior: a query executed in the GUI is using an index, whereas the same query executed in my program via client/server execution, does not (so is very slow.) > > (One thing I've noticed is that the fulltext indices are not used if the "English" language option is chosen. I figure this is the same principle as the indices not being used if the "contains text" query options don't match the database fulltext index properties - but I don't know what fulltext options to use in the query, then. I don't know if this is related to the problem I'm seeing.) > > ---------------------------------------- > This is the query: > > let $paras:=db:open('CIVWAR')//node()[text() contains text "ohio"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > > ---------------------------------------- > This is the result of session.info() with "set queryinfo on", after the query is executed in my program: > > Query: let $paras:=db:open('CIVWAR')//node()[text() contains text "zanesville"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > > Compiling: > - pre-evaluating open("CIVWAR") > - optimizing descendant-or-self step(s) > - binding static variable $paras > - merging axis paths > - binding static variable $books > - rewriting where clause to predicate(s) > - rewriting exists(@*:id) > - removing variable $paras > - removing variable $books > - simplifying flwor expression > > Result: for $book in (document-node { "DYERS_P1.xml" }, ...)/descendant::node()[text() contains text "zanesville"]/ancestor::*:book[@*:id] order by number($book/@id) return element { "book" } { attribute { "id" } { $book/@id }, attribute { "series" } { $book/@series }, attribute { "title" } { $book/title } } > > Parsing: 1.83 ms > Compiling: 8.73 ms > Evaluating: 36902.45 ms > Printing: 0.71 ms > Total Time: 36913.74 ms > Results: 15 Items > Updated: 0 Items > Printed: 964 Bytes > Memory: 11970 KB > > Query executed in 36914.08 ms. > > > ---------------------------------------- > And this is the query info from the GUI: > > Query: let $paras:=db:open('CIVWAR')//node()[text() contains text "ohio"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > Compiling: > - pre-evaluating open("CIVWAR") > - optimizing descendant-or-self step(s) > - applying full-text index > - binding static variable $paras > - merging axis paths > - binding static variable $books > - rewriting where clause to predicate(s) > - rewriting exists(@id) > - removing variable $paras > - removing variable $books > - simplifying flwor expression > Result: for $book in FTIndexAccess("CIVWAR", "ohio")/..[ancestor::document-node()]/ancestor::book[@id] order by number($book/@id) return element { "book" } { attribute { "id" } { $book/@id }, attribute { "series" } { $book/@series }, attribute { "title" } { $book/title } } > Query plan: > <GFLWOR> > <For var="$book"> > <AxisPath> > <FTIndexAccess data="CIVWAR"> > <FTWords>ohio</FTWords> > </FTIndexAccess> > <IterStep axis="parent" test="node()"> > <AxisPath> > <IterStep axis="ancestor" test="document-node()"/> > </AxisPath> > </IterStep> > <IterStep axis="ancestor" test="book"> > <AxisPath> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </IterStep> > </AxisPath> > </For> > <Order> > <OrderByExpr dir="ascending" empty="least"> > <FNAcc name="number(item?)"> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </FNAcc> > </OrderByExpr> > </Order> > <Return> > <CElem> > <Item value="book" type="xs:QName"/> > <CAttr> > <Item value="id" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </CAttr> > <CAttr> > <Item value="series" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="series"/> > </AxisPath> > </CAttr> > <CAttr> > <Item value="title" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="child" test="title"/> > </AxisPath> > </CAttr> > </CElem> > </Return> > </GFLWOR> > Timing: > - Parsing: 0.99 ms > - Compiling: 0.59 ms > - Evaluating: 864.56 ms > - Printing: 1.09 ms > - Total Time: 867.25 ms > >

2 1

Software Submitted - BaseX 6.5
by SoftList 25 Jan '11

25 Jan '11

Dear BaseX, Thank you for your submission - "BaseX 6.5" to SoftList. Please allow a few days until we review and place it on our site. Sincerely, SoftList.Net http://www.softlist.net � 2000-2008, SoftList.Net

1 0

6.5 - org.basex.server : basex never returns
by Fabrice Etanchaud 25 Jan '11

25 Jan '11

Dear all, I get a very strange behaviour in client/server mode with the java binding (ckecked out from the repository). I wrote a little piece of code that never returns from the last command 'DROP DATABASE xxx' It ends up normally if you comment the query or if you change it to an iterative query. Please find the code below : Best regards import org.basex.server.*; import java.io.*; public class Test { public static final void main(String[] args) { try { ClientSession session = new ClientSession("localhost", 1984, "admin", "admin"); session.create("mydb", new ByteArrayInputStream("<Root1/>".getBytes("UTF-8"))); session.execute("OPEN mydb"); session.add("mydoc.xml", "/mypath", new ByteArrayInputStream("<Root2/>".getBytes("UTF-8"))); session.execute("DELETE /mypath/mydoc.xml"); String req = "for $i in collection() return base-uri($i)"; Query q = session.query(req); System.out.println(q.execute()); System.out.println(q.info()); q.close(); session.execute("CLOSE"); session.close(); session = new ClientSession("localhost", 1984, "admin", "admin"); session.execute("DROP DATABASE mydb"); session.close(); } catch (Exception e) { e.printStackTrace(); } } } Fabrice Etanchaud Senior Software Engineer CT Corsearch / Edital, a Wolters Kluwer business Berkenlaan 1 1831 Diegem Belgium <skype:fabrice.etanchaud?call> skype:fabrice.etanchaud Get Skype <http://www.skype.com/go/download> and call me for free. fetanchaud(a)edital.com <mailto:fetanchaud@edital.com> <http://www.edital.com/> www.edital.com (website) <http://www.ctcorsearch.com/> www.ctcorsearch.com (website) Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

3 3

fulltext score value
by KUSTER, Juan Pablo 24 Jan '11

24 Jan '11

Hello community, I have a question about score results. I create a DB with one XML document using TF/IDF text node strategy and when make query on it always obtain the same score for all results equal one. the query is: declare option output:omit-xml-declaration "no"; declare variable $w1 as xs:string external := 'roma'; declare variable $w2 as xs:string external := ''; <results> { for $hit score $score in /kdo/idf/idf/idf/idf/idf[text() contains text {$w1} all words using wildcards ] let $cap := $hit/idf[@ctx="20.1"]/text() let $continente := $hit/ancestor-or-self::idf[@ctx="20.9"]/text() order by $score descending return <result score="{$score}"> <continente>{$continente}</continente> <paese>{$hit/../../../text()}</paese> <regione>{$hit/../../text()}</regione> <provincia>{$hit/../text()}</provincia> <cap>{$cap}</cap> <nome>{$hit/text()}</nome> </result> } </results> executed through RESTFULL with the URL http://localhost:8984/basex/jax-rx/comuni?wrap=no&run=fulltext_wildcard… and follow the query results: <?xml version="1.0" encoding="UTF-8"?><results count="6"> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>FROSINONE</provincia> <cap>03020</cap> <nome>GIULIANO DI ROMA</nome> </result> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>VITERBO</provincia> <cap>01034</cap> <nome>FABRICA DI ROMA</nome> </result> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>ROMA</provincia> <cap>00063</cap> <nome>CAMPAGNANO DI ROMA</nome> </result> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>ROMA</provincia> <cap>00020</cap> <nome>CERVARA DI ROMA</nome> </result> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>ROMA</provincia> <cap>00045</cap> <nome>GENZANO DI ROMA</nome> </result> <result score="1"> <continente>EUROPA</continente> <paese>ITALIA</paese> <regione>LAZIO</regione> <provincia>ROMA</provincia> <cap>001xx</cap> <nome>ROMA</nome> </result> </results>for each result node you can see the score node with the same value for deferents <nome> nodes strings.Sorry for my English, and thanks for any comment.

2 1

Re: [basex-talk] external variables
by Christian Grün 24 Jan '11

24 Jan '11

> Yesterday you sketched that multiple -b options > may be given if multiple params need to be passed. > Does your implementation > behave like that (multiple -b), or if just a single -b is permitted, how do > I separate multiple param/value pairs? Exactly; more than one -b parameter can be specified. As an alternative, several bindings can also be split by commas: basex -b a=1,b=1 query.xq > On 24.01.2011 13:57, Christian Grün wrote: >> >> Gerrit, >> >> I've now added a -b flag to the command-line options of BaseX Client >> and Standalone. This way, external variables can be bound to queries, >> which are either referenced as file, or specified via the -c or -q >> flags. Two examples: >> >> basex -b a=1 query.xq >> basexclient -b a=1 -q "declare variable $a external; $a" >> >> By defauls, the passed on values will be treated as strings. If the >> query specifies a data type, the passed on value will be cast to that >> type. Note that the value to be bound may not contain equality signs, >> commas, semi-colons or (depending on the OS) other characters that may >> be interpreted the wrong way. In other words, the integrated solution >> doesn't support all values that could be bound to variables. Similar >> restrictions apply to the GET method of JAX-RX, though. >> >> Christian >> >> >> On Sun, Jan 23, 2011 at 7:22 PM, Christian Grün >> <christian.gruen(a)gmail.com> wrote: >>> >>> Dear Gerrit, >>> >>> currently, external variables are supported by our various language >>> bindings (listed at http://docs.basex.org/wiki/Languages) and JAX-RX, >>> but not on the command line. Your feature request looks quite >>> reasonable, though, so I'll probably add a -b option, similar to the >>> option -s for defining serialization parameters. A command line call >>> will look sth. like that: >>> >>> basex -bvar1=hello -bvar2=world query.xq >>> >>> Hope this helps, >>> Christian >>> >>> >>> On Sun, Jan 23, 2011 at 5:36 PM, Imsieke, Gerrit, le-tex >>> <gerrit.imsieke(a)le-tex.de> wrote: >>>> >>>> I'm trying to pass a parameter to an xquery file whose first line reads: >>>> define variable $db as xs:string external >>>> >>>> How may I invoke the BaseX client so that the param will be passed to >>>> the >>>> query? >>>> >>>> Just saw in the 6.5 change log "[ADD] JAX-RX: bind external variables to >>>> query and run parameter". Does that mean that passing param is currently >>>> only available in the JAX-RX interface? >>>> >>>> Maybe you can parse the command line client invocation such that >>>> everything >>>> after the options and after a xquery file name is considered as >>>> param=value >>>> pairs? >>>> >>>> -Gerrit >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>> >>> > > -- > Gerrit Imsieke > Geschäftsführer / Managing Director > le-tex publishing services GmbH > Weissenfelser Str. 84, 04229 Leipzig, Germany > Phone +49 341 355356 110, Fax +49 341 355356 510 > gerrit.imsieke(a)le-tex.de, http://www.le-tex.de > > Registergericht / Commercial Register: Amtsgericht Leipzig > Registernummer / Registration Number: HRB 24930 > > Geschäftsführer: Gerrit Imsieke, Svea Jelonek, > Thomas Schmidt, Dr. Reinhard Vöckler >

1 0

external variables
by Imsieke, Gerrit, le-tex 24 Jan '11

24 Jan '11

I'm trying to pass a parameter to an xquery file whose first line reads: define variable $db as xs:string external How may I invoke the BaseX client so that the param will be passed to the query? Just saw in the 6.5 change log "[ADD] JAX-RX: bind external variables to query and run parameter". Does that mean that passing param is currently only available in the JAX-RX interface? Maybe you can parse the command line client invocation such that everything after the options and after a xquery file name is considered as param=value pairs? -Gerrit

2 2

Resolver/catalog: can't make it work
by Imsieke, Gerrit, le-tex 24 Jan '11

24 Jan '11

Dear Team (especially Michael), I'm trying to use an XML catalog during import (for the first time admittedly), but the catalog is obviously not being used. I tried to specify a full path in the GUI: c:/cygwin/home/gerrit/Apotheker/BaseX/catalog/catalog-win.xml I also tried to specify SET CATFILE on the command line, when the server was running and the GUI was off: basexclient -Uadmin -Padmin -c "SET CATFILE catalog/catalog-win.xml; set createfilter *.html; create database amt2; open amt2; add Apotheker/AMT" Took ages (never finished), which made me think that the resolver wasn't used. Switched off network connection. Received: Error: www.w3.org Since I was trying to import XHTML files, this is an indication that the catalog hasn't been used. Changed the CATFILE path to Apotheker/BaseX/catalog/catalog-win.xml (because the documents to be imported were apparently considered relative to my home dir or the current dir), to no avail. Also c:/cygwin/home/gerrit/Apotheker/BaseX/catalog/catalog-win.xml didn't work. Here's the server output: $ basexserver -di BaseX 6.5 [Server] Try "help" to get more information. > Creating Database... 62.02 ms (501 KB) Indexing Text... . 63.36 ms (588 KB) Indexing Attributes... . 66.02 ms (621 KB) Creating Database... java.io.IOException: www.w3.org java.net.PlainSocketImpl.connect(Unknown Source) ... Created a CatalogManager.properties in the CLASSPATH before starting the server. But it kept trying to connect to www.w3.org. Current catalog file looks like that: <?xml version="1.0"?> <catalog prefer="system" xmlns="urn:oasis:names:tc:entity:xmlns:xml:catalog"> <rewriteSystem systemIdStartString="http://www.w3.org/TR/xhtml1/DTD/" rewritePrefix="file:///c:/cygwin/home/gerrit/Apotheker/schema/xhtml1/" /> </catalog> First HTML file that it is trying to import begins with: <?xml version="1.0" encoding="UTF-8"?> <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> <html xmlns="http://www.w3.org/1999/xhtml"> <head> <meta http-equiv="content-type" content="text/html;charset=utf-8"/> There is a file xhtml1-strict.dtd in the local directory. Altering the catalog file so that it's not well-formed any more doesn't seem to impress the parser. So I think it is not being read, but without a warning. What did I do wrong? If we manage to solve this, you may want to insert an XML Catalog Howto into the documentation wiki. Gerrit -- Gerrit Imsieke Geschäftsführer / Managing Director le-tex publishing services GmbH Weissenfelser Str. 84, 04229 Leipzig, Germany Phone +49 341 355356 110, Fax +49 341 355356 510 gerrit.imsieke(a)le-tex.de, http://www.le-tex.de Registergericht / Commercial Register: Amtsgericht Leipzig Registernummer / Registration Number: HRB 24930 Geschäftsführer: Gerrit Imsieke, Svea Jelonek, Thomas Schmidt, Dr. Reinhard Vöckler

2 3

Invalid arguments...
by Mark Boon 23 Jan '11

23 Jan '11

Just now I spent considerable time figuring out why I get a message like this: [FORG0006] Invalid arguments for com.avatar_reality.ai.OntologyManager.save(...) method. In case you're wondering, it doesn't have anything to do with invalid arguments. It prints this whenever anything is wrong. Anything. It could be the wrong arguments. Or the wrong method name. Or the wrong class-name. Or even better, nothing like that at all, just any uncaught exception thrown by the method (or the class-loader) will cause it to print this error. May kindly I suggest embedding the original cause in the error message? That would save a ton of time figuring out what exactly is the matter. Mark

3 3

BaseX 6.5
by Raymond Meester 21 Jan '11

21 Jan '11

I like 6.5 with the new tree visualization and commercial support. It's stabile and fast. Here is some feedback/feature requests for future development of BaseX: 1) Double click on the blue bar to get a full view (All other views are send to the background. When double clicking the other views appear again) 2) Put a close button on the blue bar 3) Folder view; add entry in the right-click menu to collapse in or out all nodes 4) Add support for intelligent xpath autocompletion in the search bar 5) Possibility in the right click menu to duplicate a node 6) Possibility to place a node in comment /uncomment 7) In text mode highlight a node when the cursor is standing on an opening or ending tag, so that the corresponding pair will be remark 8) Make "Enter" equal to double clicking when navigation in a xml 9) Option to show line numbers in text mode 10) Launch a xml in a browser, xml editor or IDE from the menu In the long run it would be nice to add 1) A XML Grid View (like xmlSpy or Stylus Studio) 2) XSD support for validating and generating schemas 3) XSLT support for transforming a xml db into another xml db and alternative query posibillities 4) Visualizing differences between two databases 5) Export xml to text, csv, xls, json etc 6) XQuery Documentation Generator (XQDoc Support) 7) Use colors to show structure of an xml in the visualization views (this option can be turned on and off) 8) Support for forms (Create forms as a front end for basex and distribute this together with the xml db as a jar file) 9) XML editing mode and read only mode (xacml) 10) Focus on support for adding thousands of xml files into one db Thanks, I will look forward to future releases Ray

3 2