- BaseX-Talk - mailman.uni-konstanz.de

Export gzipped XML files
by Mike Cobo 08 Oct '13

08 Oct '13

Hi, I created a database from gzipped XML files, then deleted some elements (using "delete node"). Now I want to export the files again as gzipped XML files. But when I use the "Database > Export..." function of the BaseX GUI the files are exported unzipped. Question: is it possible to export the files as gzipped XML files? Thx - Mike

2 1

Fwd: [homebrew] basex 7.7.2 (#23100)
by Jens Erat 07 Oct '13

07 Oct '13

I just bumped BaseX on Homebrew to 7.7.2, patch already got merged. Whoever's using Homebrew is just a brew update; brew upgrade basex away from the newest release. Regards, Jens -- Jens Erat [phone]: tel:+49-151-56961126 [mail]: mailto:email@jenserat.de [jabber]: xmpp:jabber@jenserat.de [web]: http://www.jenserat.de PGP: 350E D9B6 9ADC 2DED F5F2 8549 CBC2 613C D745 722B Anfang der weitergeleiteten Nachricht: > Von: Mike McQuaid <notifications(a)github.com> > Betreff: Aw: [homebrew] basex 7.7.2 (#23100) > Datum: 7. Oktober 2013 16:53:44 MESZ > An: mxcl/homebrew <homebrew(a)noreply.github.com> > Kopie: JensErat <email(a)jenserat.de> > Antwort an: mxcl/homebrew <reply+i-68992688-ffa65db8839fe5d83e9eccef8d1c043a081d3fe5-628441(a)reply.github.com> > > Closed #23100 via f7ace42. > > — > Reply to this email directly or view it on GitHub. >

1 0

xquery replace node adds spaces to inline content
by France Baril 07 Oct '13

07 Oct '13

Hi, I'm getting extra spaces after a node replace. Code: *let **$original* := <div><p>I love flowers (<specify/>).</p> <p>I love flowers: <specify/>.</p></div> *let* *$specify* := <b><i>red, yellow and white ones</i></b> *let* *$new* := *copy* *$copy* := *$original* *modify*(*for **$prompt* *in **$copy*//*specify* *return **replace* *node* *$prompt* *with* * $specify*) *return **$copy* I would expect $new to give: I love flowers (*red, yellow and white ones*). I love flowers: *red, yellow and white ones*. But I get extra spaces inside the parenthesis of the first sentence and before the period of the second sentence: I love flowers (* red, yellow and white ones** *). I love flowers: *red, yellow and white ones** *. You can try my .xqm on BaseX 7.7 1. Create a DB 'test' with chop white spaces to 'no'. 2. Run access http://*localhost:8984*/test-extra-spaces/test-1 from your browser. 3. Look at the .xml in the test DB. It has extra carriage return. It looks like the query assumed that <i> was a block and it felt compelled to add a carriage return and indent. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 6

BaseX 7.7.2
by Christian Grün 07 Oct '13

07 Oct '13

Dear all, a new minor BaseX release is available; it provides the following new features and fixes: XQUERY • a CSV Module and serialization was added • the JSON serializer was updated (more to follow!) • some update checks in the modify clause were fixed • parsing of new map syntax was fixed (ignoring spaces) • tail call handling in built-in higher order functions was fixed API • a Russian translation was added (thanks to Oleksandr Shpak, Max Shamaev) • command-line arguments starting with '<' are interpreted as XQuery INDEXING • a bug was fixed in the updatable index structure (updindex=true) We are looking forward to your feedback, Christian, BaseX Team 2013

1 0

db:list($db) returns raw files, but not db:list($db, $path)
by France Baril 01 Oct '13

01 Oct '13

I'm currently on 7.7. The second function returns files from folders and subfolders at $path, but omits the folders that contain only raw files. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

BaseX http running single threaded?
by Joe Templeman 30 Sep '13

30 Sep '13

Hi all, I'm having trouble with the running a restxq API, set up as either a stand alone app (using basexhttp) or running the servlet in jetty. When I make a request, the server will lazily load in the requested content using a small java library that I've built which can take quite a while, and unfortunately it completely blocks waiting for this request to complete. This means that if I make a request for content which is already loaded, which should return in a couple of milliseconds, it instead waits for the downloading of the first request to complete before returning. I'm sure it's something simple that I'm missing in the config somewhere, but I have the threadpool parameters set up in my jetty.xml config file but it doesn't seem to make any difference. Is this expected behavior? I can't imagine any HTTP server would ever be designed to be single threaded... Any help is welcome, I've been trying to figure this out for days now. Thanks, Joe

3 5

Keep index in main memory-performance
by Aravanis, G. 30 Sep '13

30 Sep '13

Hi community, I have created a DB of around 7 GB documents in BaseX (100 first records of Medline) with full text index option enabled (index size 1 GB). I test it locally on my laptop. The problem is that I observe great variations in the free text query times from 8s up to couple of minutes. Main memory is underused (allocated 2 GB) and the processor has quite low utilization. I observe high usage of the hard disk. I have read that the whole db could be loaded in the main memory, but this is not an option for an 100 GB db collection that I would like to have. My question is if there is a possibility to load only the index in the main memory in order to accelerate the process of searching. Any other performance tips are very welcome. Thank you, George Aravanis

2 4

Re: [basex-talk] Set Operator Examples
by Arto Viitanen 26 Sep '13

26 Sep '13

Question was about set operations in BaseX. I had to calculate set difference on a sequence of values. XQuery has operator except, but it works only on nodes. I guess normal code for this is using distinct-values: declare function local:difference-pred($a, $b) { distinct-values($a[not(.=$b)]) }; I used it on big (thousands of values) sets, and it was slow. Then I tried on maps using BaseX map-module : declare function local:difference-map($a, $b) { let $m1 := map:new(for $i in $a return map:entry($i, true())) let $m2 := map:new(for $i in $b return map:entry($i, false())) let $m3 := map:new(($m1, $m2)) return for $i in map:keys($m3) return if ($m3($i)) then $i else () }; Then we found another solution, with only one map: declare function local:difference-map-2($a, $b) { let $m2 := map:new(for $i in $b return map:entry($i, true())) return for $i in $a return if($m2($i)) then () else $i }; When trying them at same sequences: let $a :=for $i in (1 to 100000) return if (random:double() < 0.01) then () else string($i) let $b := for $i in $a return if (random:double() < 0.45) then () else $i return (count($a), count($b), count(prof:time( local:difference-pred($a, $b), true(), 'pred ')), count(prof:time( local:difference-map($a, $b), true(), 'map ')), count(prof:time( local:difference-map($a, $b), true(), 'map2 '))) This gives times (on BaseX 7.6 running on OpenSUSE on VMWare virtual machine on a PC). pred: 80468.68ms map: 261.23 ms map2: 253.77 ms That is: map2 is 317 times faster than distinct-values version. I did not measure memory usage. Also on different size sequences, each one of the functions can be fastest! -- Arto Viitanen Finland

4 7

Issue with linebreak using REST since 7.7.1
by Yoann Maingon 25 Sep '13

25 Sep '13

Hi, I've got a simple node move PHP script (sorry for my terrible code, I'm an electronician!) 1. // get the node 2. $xquery = "XQUERY //noteitem[@id='$movedID']"; 3. $saveNode = $session->execute($xquery); 4. 5. // delete the node 6. $xquery = "XQUERY delete node //noteitem[@id='$movedID']"; 7. $content = $session->execute($xquery); 8. // insert the node 9. if ($nextID == 'last') { 10. $xquery = "XQUERY insert node ($saveNode) as last into //meeting[@id='$meetingID']/items " ; 11. $content = $session->execute($xquery); 12. } else { 13. echo $saveNode; 14. $xquery = "XQUERY insert node ($saveNode) before //meeting[@id='$meetingID']/items/noteitem[@id='$nextID'] " ; 15. $content = $session->execute($xquery); 16. } 17. $contentFull = "<MN>$content</MN>"; 18. echo $contentFull; If I look into the content that is saved, deleted and inserted I have the following: <noteitem status="new" commentsCounter="0" created_on="Tue, 24 Sep 13 12:09:29 +0000" modified_on="Tue, 24 Sep 13 12:09:29 +0000" id="MnNo524180f9587c1" genid="MnNo524180f9587c1" owner="1" type="question"> <notecontent>...</notecontent> </noteitem> It worked fine until the latest update. Where apparently the query breaks with the line break. It creates an error saying that the closing </noteitem> tag is missing. Just got back to 7.6 and it works well. any idea? Yoann Maingon CEO - mydatalinx +33664324966

2 1

feature request -- GUI database creation overall progress
by Graydon Saunders 25 Sep '13

25 Sep '13

Hi! Right now, creating a database in the GUI gives a per-file progress, which is accurate but not informative. Any chance of getting, in addition to the per-file progress, the overall progress of creating the database? Thanks! Graydon

2 1