May 2015 - BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] "Input is too large for a single database" error
by Christian Grün 23 May '15

23 May '15

Hi Huib, > However, using 8.2 I managed to load the entire Dutch legislation documents > into 5 separate databases. Yay! Good to hear! > Anyway, and I must confess I am a bit lazy here, how do I run a query over > multiple databases/collections in BaseX? Of course I would like to run the > same dumb count query in BaseX too, over these 5 databases containing all my > data, see if it works... This could be a solution: count( for $name in ('laws1', 'laws2') return db:open($name)//law ) This could be another: count( for $i in 1 to 5 let $name := 'laws' || $i return db:open($name)//law ) This is a third (it may be the fastest one, because the dynamic binding of database names in the first 2 queries prevents some optimizations to be triggered): sum( for $i in 1 to 5 let $query := 'count(db:open("db' || $i || '")//law)' return xquery:eval($query) ) Hope this helps, Christian

1 0

Position of matched tokens in a full-text query
by Javier Couto 22 May '15

22 May '15

Hi, Sorry if this is too basic, but I’m trying to get the positions of the matched tokens in a full-text query, and I can’t find the way to do it. I imagine something like: for $sentence in //sentence where $sentence[text() contains text { ‘DNA', ‘oxidation' }] return <positions>ft:SOME-FUNCTION-FOR-TOKENS-POSITIONS($sentence[text() contains text { ‘DNA', ‘oxidation' }])</positions> Is this possible? Thank you in advance, Javier

3 10

[DELIVER]Request for Training
by Adam Law 22 May '15

22 May '15

I was wondering whether there might be someone on the list who would be willing to teach me about BaseX. I will pay per hour. I have some xquery code (from existdb) that I scrapped together and would like to improve and set up a similar app in BaseX. I have other applications that I would like to have coded. If you are interested, please let me know your hourly rate. I am a sole trader and would find some training invaluable. I have limited xquery and xslt experience. Kind regards Adam

1 0

Installing an older version of BaseX on a Mac laptop
by Schwartz, Christine 22 May '15

22 May '15

Hi, I'm new to BaseX and currently preparing a training session teaching XQuery and using BaseX as the programming environment. I'm setting up step-by-step instructions for the attendees and have run into trouble with the Mac installation using Homebrew and BaseX. The Homebrew formula that was available yesterday appears to be gone. Please advise as to how to simply install BaseX on a Mac, as the session is for non-programmers and I want to keep the instructions simple. Thanks, Chris Christine Schwartz Metadata Librarian and XML Database Administrator Princeton Theological Seminary Library

4 3

db:replace and error bxerr:BXDB0007 (opened by another process)
by James Ball 21 May '15

21 May '15

Hello, I’m currently writing a small RESTXQ application that receives POSTed XML and then stores it into the database. It works well but I want to make it more robust so I’m adding more error handling code. One scenario I want to cover is where the database to be written to exists but is open in another process for some reason. In my function I do something like this: try { db:replace(“DATABASE_NAME”,”PATH/TO/FILE”,<Element/>) } catch * { db:output(<insert code here>) } I expect that this code should complete without error - knowing of course that the database won’t be updated. Instead I always get a bxerr:BXDB0007 error thrown and I can’t find any way to catch it. (It’s also not listed as a possible error in the documentation, although is against db:create) Is this something subtle to do with the pending updates list? I’m sure I’m missing something obvious but I can’t see it. Thank you for any help and direction, James

2 4

BaseX 8.2: The Summer Edition
by Christian Grün 21 May '15

21 May '15

Dear all, We invite you to check out Version 8.2, the Summer Edition, of BaseX, our XML database system and XQuery 3.1 processor! You can expect the following features: XQUERY - much faster sequence modification via finger trees - improved compliance with XQuery 3.1 DBA - open, save and delete queries - better Tomcat support STORAGE - updatable index structures: reduced disk space consumption XQUERY FUNCTIONS - Standard Module: fn:json-to-xml, fn:xml-to-json - Web Module: web:encode-url, web:decode-url - File Module: file:is-absolute, file:resolve-path - Admin Module: admin:delete-logs - Database Module: db:output-cache BUG FIXES - locking, full-text requests, stemming REMOVED FEATURES - event handling (will be replaced by database triggers) The latest version is available at http://basex.org. As usual, various minor bugs and inconsistencies have been fixed in the latest version; check out our documentation (http://docs.basex.org) and the GitHub commits (https://github.com/BaseXdb/basex) for more details! We are looking forward to your feedback, Your BaseX Team

1 0

rest vs. restxq - strange difference
by Lars Johnsen 20 May '15

20 May '15

I am running a web script in two identical versions (identical as in "cut and paste"), one via RESTXQ and one vi REST. The response is different, and I wondered what may be the trouble. For example the output (the URLs only works locally) for http://ljohnsen:8984/hyphens/mellom is the same as http://ljohnsen:8984/rest?run=hyphen-show.xq&word=mellom which is a set of hyphenation data: mellom mel - lom 17005 Mel - lom 144 mel - lom. 50 but if "mellom" is exchanged with "nasjonalbiblioteket" only the REST version shows any result, which then is the same as I get experimenting in the GUI. The actual script is added below, and which runs in both versions (identical apart form the rest and restxq interfaces), it uses full text search, but results differ when run under the REST-regime. All the best Lars G Johnsen National Library of Norway module namespace page = 'http://basex.org/modules/web-page'; declare %rest:path("/hyphens/{$word}") %output:method("html") function page:show-hyphens($word) { let $db := db:open('hyphen-data') let $hyphens := for $hyp in $db/hyphens/hyphens[full contains text {$word}] group by $first := $hyp/first, $second := $hyp/second let $count := count($hyp) order by xs:int($count) descending return element p { attribute freq {$count}, $first, " - ", $second, $count } let $total := sum($hyphens//@freq) let $div := element div { element p {$word}, for $hyp in $hyphens return element div { attribute class {"hyph"}, attribute style {"font-size:", 1 +round(xs:int($hyp//@freq/data()) div $total,1) || "em"}, $hyp } } return <html encoding="UTF-8"> <head> <meta http-equiv="Content-Type" content="text/html" charset="UTF-8" /> <title>Orddelinger</title> </head> <body>{$div} </body> </html> };

2 12

Create DB from large XML extraction without root element?
by Hondros, Constantine (ELS-AMS) 19 May '15

19 May '15

Hello all, I have a huge extraction of XML documents in a single file, without a root element, something along these lines: <a> <b/> </a> <a> <b/> </a> ... Other than by editing it to add a root element, is there a clever way of creating a Basex DB from this? Thanks for any pointers, C. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

3 4

Server protocol bug?
by alxarch 18 May '15

18 May '15

Hi, While testing for basex-stream i encountered a weird behavior in the OPTIONS query command. After creating the query ```xquery declare option output:method "json"; declare option output:json "lax"; <json type="object"/> ``` the response of OPTIONS was: `json=lax=true,method=json` Which seems wrong. I event tried setting cdata-section-elements to "pre, code" and the response had a double comma ("cdata-section-elements=pre,,code,method=xml") Is this a bug or is there some deterministic method of parsing the response? Thanks, Alex

2 2

DB size sanity check
by Hondros, Constantine (ELS-AMS) 18 May '15

18 May '15

Hi all, Database created from 17692 MB: resulting DB size 30450 MB. CHOP is set to false, but for good reasons. TEXTINDEX and ATTRINDEX are true, but FTINDEX false. Can I just sanity check this size of DB? It surprises me a little. (Basex 8.0.2 by the way). Thanks in advance, Constantine ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1