March 2012 - BaseX-Talk - mailman.uni-konstanz.de

REPOPATH prefixed twice on current snapshots?
by Charles Duffy 17 Mar '12

17 Mar '12

In my .basex file: REPOPATH = /home/cduffy/local/opt/basex-data/repo ...and running repo:list() shows my local package, with namespace http://dyfis.net/ as installed, but trying to use anything from it leads to an error similar to the following: releng.db.basex.rest.RemoteException: [XQST0059] Could not retrieve module '/home/cduffy/local/opt/basex-data/home/cduffy/local/opt/basex-data/repo/http-dyfis.net-0.1.140101/dyfis/reporting.xq'. This is happening with a local build of 230e16551cf397def9e6c59044ff605e48908e1c (current master on github).

2 8

after upgrading one big disaster
by jidanni＠jidanni.org 17 Mar '12

17 Mar '12

All I know back in December the Makefile and programs in http://radioscanningtw.jidanni.org/images/radioscanningtw/maps/ worked fine. Now with BaseX 7.1.1 it is one big disaster and will take days to rewrite.

3 6

Any way to persist OutputStream in DiskData?
by Dave Glick 16 Mar '12

16 Mar '12

Hi, I've been doing some profiling recently and noticed one area in particular that appears to be using a lot of cycles. In calls to DiskData.write() the final DataOutput.close() call results in 20% - 40% of overall execution time in a variety of cases. The following screen capture shows the aggregated call stack (though it might look a little funny since this is the cross-compiled version used for Nxdb). Admittedly, this is probably an issue that just impacts me. Based on the trace, I suspect the issue is related to the releasing of handles rather than the actual disk writes (though I could be wrong - I'm not entirely sure what the cross-compiler does behind the scenes to support Java file descriptors). In any case, my question boils down to wondering if there is a way to force the DiskData class to use a persistent DataOutput instance instead of creating and closing a new one for every write? Instead, could a DataOutput be kept open until the database is "unpinned" and simply flushed on each write? Would this cause any problems with the current GUI, server, etc. uses? Thanks, Dave

3 4

fulltext index: case sensitive vs. case insensitive
by Cerstin Mahlow 16 Mar '12

16 Mar '12

Hi, If I create the fulltext index with "stemming" switched on and "case sensitive" switched off, there is no way to enable case sensitive search, is this correct? So if users would like to search case sensitive as well as case insensitive, I would have to create two indices? Which would mean creating actually four indices to allow for fuzzy search or exact matches as well: w/ stemming and w/ case sensitive w/ stemming and w/o case sensitive w/o stemming and w/ case sensitive w/o stemming and w/o case sensitve. That's quite a lot of data! Would it be possible to handle case sensitivity rather as an option for the query than as an option for the index, like described here: <http://www.xmlmind.com/tutorials/XQueryFullText/index.html#d0e333> Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Deutsches Seminar Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net ---------------------------------------------------------------- This message was sent using IMP, the Internet Messaging Program.

2 1

Delete attributes
by William P. Heise 16 Mar '12

16 Mar '12

How do I delete attributes? (and just the attribute, not the node) Motivation: I have a db where 20% of the attributes is the same, 'title', which is never used. Deleting it could decrease the size of the db. /William ________________________________ Please consider the environment before printing. </pre> <div style="FONT-FAMILY: arial;color:#525759;font-size:9pt; margin-top:15px">This e-mail and any attachments are intended only for the named recipient(s) and may contain information that is legally privileged, confidential, or exempt from disclosure under applicable law. This message may be logged for archival purposes, may be reviewed by parties at Deltek other than those named in the message header, and may not necessarily constitute an official representation of Deltek. If you have received this message in error, or are not the named recipient(s), you may not retain copy or use this e-mail or any attachment for any purpose or disclose all or any part of the contents to any other person. Any such dissemination, distribution or copying of this e-mail or its attachments is strictly prohibited. Please immediately notify the sender and permanently delete this e-mail and any attachment from your computer.</div>

2 2

REPLACE fails when root has attributes
by Charles Duffy 16 Mar '12

16 Mar '12

> REPLACE inventory <root foo="bar">test</root> Stopped at line 1, column 24: Syntax: REPLACE [path] [input] Replace documents in database. Replaces documents in the current database.

1 1

ADD:REPLACE :: STORE:?
by Charles Duffy 15 Mar '12

15 Mar '12

Restated: "ADD is to REPLACE as STORE is to... what?" REPLACE, like ADD, expects the content given to be parsed rather than raw. ADDing the same content twice can result in two documents with the same name in the database; I'm presuming that duplicate STORE commands have similar peril attached. What is the appropriate mechanism to use when replacing one version of raw content with another?

2 1

nesting queries
by Cerstin Mahlow 15 Mar '12

15 Mar '12

Hi, I would like to have a nested xquery, but I am not sure if this is possible at all: When a user searches the corpus, he can save the hits he likes most. The result for the query is a form with checkboxes. The node IDs together with the query and a time stamp are saved in a second collection. This collections looks like this: <collection> <entry time="2012-03-04T17:24:53"> <node>1434455</node> <query>[text() contains text ('Daumen' ftand 'Auge' ftand 'halten') using stemming using language "de" distance at most 10 words ordered]</query> <person>xyz</person> <phraseme>Ad0024</phraseme> <selected>yes</selected> </entry> <entry time="2012-03-04T17:24:53"> <node>1475764</node> <query>[text() contains text ('Daumen' ftand 'Auge' ftand 'halten') using stemming using language "de" distance at most 10 words ordered]</query> <person>abc</person> <phraseme>Ad0024</phraseme> <selected>no</selected> </entry> </collection> When the user searches again with a different query, he will see the results as for the first search and is able to save only those that are not in the hit-collection. This is controlled by this part in the "return" part of the xquery in my perl client: { if (not (db:open("collect")//node[text() = \$node and ../phraseme[text() = "$phraseme"] and ../selected[text() = "yes"]])) then <input type="checkbox" name="NODE" value="{\node}"/> else "X" } Already saved hits get an "X" and new hits get the checkbox. For documentation, I would like to collect all queries a node could be found with. Thus, instead of printing "X", I would like to add an additional query-element to the entry-element, i.e., something like insert node <query>$query</query> after /collection/entry/node[text() = "\$node" and ../phraseme[text() = "$phraseme" and ../selected[text() = "yes"]]] to get: <collection> <entry time="2012-03-04T17:24:53"> <node>1434455</node> <query>[text() contains text ('Daumen' ftand 'Auge' ftand 'halten') using stemming using language "de" distance at most 10 words ordered]</query> <query>[text() contains text ('Daumen' ftand 'Auge') using stemming using language "de" distance at most 10 words ordered]</query> <query>[text() contains text ('Daumen' ftand 'Auge') distance at most 10 words ordered]</query> <person>xyz</person> <phraseme>Ad0024</phraseme> <selected>yes</selected> </entry> <entry time="2012-03-04T17:24:53"> <node>1475764</node> <query>[text() contains text ('Daumen' ftand 'Auge' ftand 'halten') using stemming using language "de" distance at most 10 words ordered]</query> <person>abc</person> <phraseme>Ad0024</phraseme> <selected>no</selected> </entry> </collection> However, I am not sure if it is possible at all to mix displaying (in the "then" part) and updating (in the "else" part) -- although I would like to update a different collection than I am searching. If it is possible, I guess I have to include the name of the collection for insertion by using db:open? Is it necessary to specify the exact place for insertion (as in my example) as this should be already determined by the condition? Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Deutsches Seminar Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net

2 2

Position information on errors for queries submitted via REST
by Charles Duffy 14 Mar '12

14 Mar '12

Howdy -- The GUI's feedback on errors, including line number and position, is an extremely useful feature. Is this information also available via the REST interface? If so, how is it enabled? Thanks!

2 5

BaseX: New XQuery 3.0 Features
by Christian Grün 14 Mar '12

14 Mar '12

Dear all, we have now added documentation to function items [1] and higher order functions [2] in our Wiki. These features are being introduced with XQuery 3.0, and they provide much more powerful ways to write real functional code with XQuery. We dare say that BaseX currently offers the most complete and up-to-date support for these new features! Thanks to our team member Leo, we will soon be able to offer the last pending 3.0 features, such as general flwor expressions, which allow an arbitrary order of FLWOR clauses (fot, let, order, group by, count, etc.) [3] By the way: BaseX 7.2 will be released in about 10 days. Stay tuned.. Christian [1] http://docs.basex.org/wiki/XQuery_3.0#Function_Items [2] http://docs.basex.org/wiki/Higher-Order_Functions [3] http://www.w3.org/TR/xquery-30/ ___________________________ BaseX Team Christian Grün Uni KN, Box 188 D-78457 Konstanz http://www.basex.org

3 5