October 2013 - BaseX-Talk - mailman.uni-konstanz.de

JSON or JSONML output formatting
by Zachary Pride 16 Jul '14

16 Jul '14

Hello, I've been playing with BaseX lately and all-in-all am very impressed. Something I'm wrestling with however is the JSON output options. I've got various web applications that would really be simplified by receiving JSON straight away for the obvious scripting benefits. The JSON method has been giving me a lot of grief, stipulating rules I'm not sure how to follow. right now I have an element that "is typed as string and cannot be nested." I've been able to get JSONML to output but the JSON is this morass of nested Arrays... Attributes seem to get transformed into Objects but elements/tags and their values are pushed into Arrays for some rationale - which I suppose is on purpose. My question is how can I get Objects for simple key:value properties from <tag>value</tag> 's. Are there options I'm not utilizing? Would it be feasible to transform the XML output to some middle form first - setting it up to become Objects, before serializing it to JSON? Thanks! Zach Pride Associate Software Engineer Ultra Electronics, ProLogic 1000 Green River Drive, Ste. 201 Fairmont, WV 26554 zachary.pride(a)ultra-prologic.com Tel: +1 304 333 2680 ext.308 www.ultra-prologic.com This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. Please consider the environment before printing this email.

4 4

Dynamic Module Loading
by Jean-philippe Magué 19 May '14

19 May '14

Hello, Exist-db has an util:import-module<http://exist-db.org/exist/apps/fundocs/view.html?uri=http://exist-db.org/xq…>function that allows to dynamically import an XQuery module at run time. I haven't found anything equivalent in BaseX. Is that right ? I have also tried to see how to implement such a function directly in Java, but as far as I understand the module parsing process, functions prefix are checked at compile time. That would compromise any attempt to write such a function. Am I right ? Best, Jean-Philippe -- Jean-Philippe Magué Maître de Conférences en Humanités Numériques Responsable de l'Atelier des Humanités Numériques : ahn.ens-lyon.fr Ecole Normale Supérieure de Lyon +33 (0)4 26 23 38 08 -- "Using computers will therefore lead us to a more profound and systematic knowledge of human expression; in principle, it can help us to be more humanistic than before." Busa, 1980.

6 16

strange behaviour of the BaseXgui-editor
by Rob Stapper 14 Dec '13

14 Dec '13

Hi, I encountered a few (3) problems with the BasexGui-editor. I use the 7.8 beta release but the issue's also occur in previous versions. Problem 1: this is a minor problem but maybe related to problem 2 which is ( for me) a major problem: If I open two ( small) packages of which one has no errors and one has errors then the errorstatus-message at the bottom of the editor doesn't synchronize correctly when switching files. If I switch from the incorrect packagefile to the correct packagefile the errormessage doesn't refresh to 'ok' until I edit this file. Even after closing an activated incorrect packagefile the errormessage stays active. Clicking on the message even reopens the incorrect packagefile. Switching the focus from the correct packagefile to the incorrect packagefile however, doesn't show this behavior. In that case the errorstatus-message changes to the appropriate errormessage of the incorrect file. Problem 2: which is a major problem when working with big files ( 80 kB) I found that when editing a large(r) packagefile the Basexgui-editor doesn't recognize errors that occur after a certain point in the file. If errors occur after this point the errorstatus-message shows 'ok' but I know that the file contains errors and if I try to install the file as a package I get an window with the message below. If the error occurs before that certain point then I get an correct errormessage. However if I delete the code which contains the error the error-message remains. Clicking on the message brings the cursor to the point where the deleted code with the error used to be, even after saving and closing the file. Errormessage ============================================================================ ============================================== Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 beta Java: Oracle Corporation, 1.7.0_45 OS: Windows Vista, x86 Stack Trace: java.lang.NullPointerException at org.basex.query.func.StaticFuncs.check(StaticFuncs.java:121) at org.basex.query.QueryParser.finish(QueryParser.java:312) at org.basex.query.QueryParser.parseLibrary(QueryParser.java:253) at org.basex.query.QueryContext.parseLibrary(QueryContext.java:197) at org.basex.query.util.pkg.RepoManager.installXQ(RepoManager.java:230) at org.basex.query.util.pkg.RepoManager.install(RepoManager.java:70) at org.basex.core.cmd.RepoInstall.run(RepoInstall.java:37) at org.basex.core.Command.run(Command.java:344) at org.basex.core.Command.exec(Command.java:320) at org.basex.core.Command.execute(Command.java:77) at org.basex.core.Command.execute(Command.java:89) at org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:178) ============================================================================ ============================================== Being a responsible Basex-user I does what it says and give you some feedback J Problem 3: This is an old issue that I addressed e few months ago but which you could not reproduce. I found a new clue which might help you solving this issue. The issue was when working in fullscreen mode (F11) in the BasexGUI and then saving a file with 'save as .' The save-messagebox gets the focus but disappears behind fullscreen basexgui-window. This has something to do with using a dual monitorsystem. On a single monitor system it works ok: The save-box is placed on top of the fullscreen Basexgui-window and gets the focus. On a dualmonitorsystem the save-box is placed behind the fullscreen Basexgui-window and gets the focus. I hope this insight helps you tackle this minor issue. Well, that's all folk. I hope you can solve the editor-problem soon because I have a really hard time debugging my (large(r)) programs. Regards, Rob Stapper

2 4

Feature request: output params for db:replace
by France Baril 09 Nov '13

09 Nov '13

Hi, I have a feature request. I have a nice file with just the correct indent, that I was able to create by adding the xml:space="preserve" attribute to the root before making my inserts. [From previous thread] Ex. <block xml:space="preserve"> <block>This is a test sentence.</block> </block> Note: I can't use the output indent = no declaration at the top of my query because I'm in a library module, and I need this function to stay there for sharing. Now, I can't save the content like this (with @xml:space). My DTD doesn't allow for xml:space="preserve", and I don't want it to. Authors can't get the correct indent (based on our DTD) in the editor as long as the xml:space="preserve" remains. If I apply: *let* *$clean-file* := *copy* *$copy* := *$new* *modify* (*delete* *node* *$copy*/*/* @xml:space*) *return **$copy* file:write('file.xml', $clean-file, $param), where param contains indent="no". It saves correctly, indicating that removing the @xml:space did not cause a the insertion of an indent space between and . However, the db:replace('db', 'path', $clean-file) function forces an indent on the content between the and the . Since this is a BaseX function, and not an XQuery fonction, I'm hoping we could get db:replace('db', 'path', $clean-file, $param), where param can include output params such as indent=no. Thank you! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 2

BaseX
by Stefan Sechelmann 06 Nov '13

06 Nov '13

Hallo, ich bin dabei BaseX für unser aktuelles Projekt zu evaluieren. Bis jetzt sieht alles danach aus als ob BaseX genau das ist wonach wir gesucht haben. Hier meine Fragen dazu: - Der Datenbankserver speichert seine XML-Daten optimiert in .basex Files. Gibt es die Möglichkeit den Server auch XML Files schreiben zu lassen (So wie er das mit raw Files tut), so dass ich alles auch ohne BaseX ansehen kann? Gibt es vielleicht einen automatischen Export? - Der Webdav-Support kommt mir unstabil vor. Wenn ich XML-Dateien kopiere sind diese danach teilweise leer oder werden vom Server als RAW erkannt. Ich benutze einen Mac und den Finder als Client. Sind das eventuell bekannte Probleme oder muss ich bei mir suchen? Vielen Dank Stefan Sechelmann -- Stefan Sechelmann DFG-Forschungszentrum Matheon Mathematik für Schlüsseltechnologien Technische Universität Berlin Sekretariat MA 8-3 Tel. 030/314 29 486 Straße des 17. Juni 136 Fax 030/314 79 282 10623 Berlin sechel(a)math.tu-berlin.de http://www.math.tu-berlin.de/~sechel

3 3

Adding WKT/WKB To Geo Module
by Zachary DeLuca 03 Nov '13

03 Nov '13

Hi All, apologies in advance for the long message, I have many documents that store WKB (base64-encoded) geometry data (going for speed not readability). I want to be able to do queries where I can use the geo predicate functions with the stored WKB geometry and a provided WKT geometry. Example: Sample document structure: <root><geoWKBdata type=xs:base64Binary/></root> Sample query: collection()/root[geo:intersects(*geo:fromWKB*(geoWKBData), * geo:fromWKT*("LINESTRING((0,0),(1,1))")) I have looked at the module code and the only problem is that all methods assume an input of GML. I don't want to just make functions to convert from WKB/WKT to GML on input because I think that would be very inefficient (slow). I could just hack something together for my own needs, but I would like some input so that ideally I can produce something good enough to contribute back to the project. Options: 1) Add copies of all methods to accept each possible encoding type (GML, WKB, WKT). I don't like this approach because it doesn't scale well, and I don't even know if it's possible? (Pretty sure you can't overload functions in XPath/XQuery) 2) Leave the Geo module the way it is and add "sister" modules for the additional encoding types. Yuck. 3) The only thing that makes sense, really. Define 3 new functions, *fromGML *, *fromBinary*, and *fromText* and change the signatures of all module functions to just accept Geometry objects. That way you can load your geometry however you want and then pass it to the desired function. I will also modify the functions *asText *and *asBinary *to accept a Geometry object, and add an additional *asGML* so that the many existing functions that already return GML (envelope, boundary, etc.) can instead return Geometry, and can then be converted as needed to the desired format. This should scale well too because if any future encoding formats are desired all you need to do is add *fromXYZ* and *asXYZ *functions. With these functions, you could also string together 2 calls to convert between any of the supported encoding types. Does this make sense? It seems easy enough, am I missing anything? Also, assume for a second that I implement #3. Refer to my sample document/query above. As I understand it, for each document in the collection, the back end will have to parse "LINESTRING((0,0),(1,1))" into a Geometry first in order to compare. Is there any way to make that happen only once for the duration of the query? Is it as easy as this?: let $data = geo:fromText("LINESTRING((0,0),(1,1))"); return collection()/root[geo:intersects(*geo:fromWKB*(geoWKBData), $data) This would work, right? (I'm new to XQuery, sorry) So, am I on the right track with this? Have I overlooked some absurdly simple solution to my problem? I would appreciate any and all input. As I said, I would like to go beyond meeting my own needs and actually get this into the code base. I'll leave you with this snippet taken from the EXPath Geo Module Spec: "The data model envisioned by EXPath Geo module is abstract in the sense that it may be possible for module implementers to support more than one encoding on input. Output data types are specified in GML and XML Schema, where appropriate. All that is necessary is that the input geometry be transformable to the model specified by OGC SF and supported by the EXPath implementation. -SNIP- *Implementations are not limited to GML, KML, nor even XML, on input. It is possible that geometries encoded as “Well Known Text”, GeoJSON, or even “Well Known Binary”, among other possibilities, could be supported by an implementation.*" Thanks, Zach

3 9

Error message
by Lars Johnsen 31 Oct '13

31 Oct '13

When trying to create a database from a folder of approximately 5000 collections (each containing between 200 and 500 files) the processed stopped after two hours with an error something like this: Line too long for a single database {filename} and {line number}. The file itself looks ok, with a single tag in the referenced position. What is the recommended procedure from here? All the best Lars G Johnsen National Library of Norway

2 1

request:http() and servlet context
by Alexander Ryabov 29 Oct '13

29 Oct '13

Hello guys. Are you going to implement request:http() function from http://exquery.github.io/expath-specs-playground/request-module-1.0-specifi… ? What I need is java's request.getContextPath(). Any workarounds? Thanks for your product, Alexander Ryabov

2 2

Fundamental problems with BaseX 7.7
by Werner Dworaczek 29 Oct '13

29 Oct '13

Hi Christian, after migrating to 7.7 I get the error message "No context item defined to evaluate 'root()'". I get this message every time when I am going to access the root node within any of my xQuery functions. This is bad since many of my functions does do exactly that, which wasn’t a problem yet. Why does the old style does not work any more and is there a comfortable workaround to avoid the need for re-writing all my xQuery code? Of course I could pass the root node as an argument to avoid this kind of error, which could improve flexibility, but it’s a lot of work. For test purposes I do have re-written some stuff to get it working with version 7.7 and when I tried to test it with the basex GUI I get "out of memory" errors and my scripts are aborted - actually all my scripts does obviously not work any more. Why does my stuff works great with BaseX 7.6 and not at all with BaseX 7.7. The upgrade seems to change some very general stuff under the hood and it cannot be reduced to some new functionality and minor signature changes for some xQuery built-in-functions. Is there something special with my stuff? I don’t think so. What I do in principle is the following: I first add an XML file info the DB, then I load and start an import xQuery which analyses the XML file just added and adds nodes into the database (update operations). When the import has finished I delete the XML file added originally. Executing the import xQuery works fine with 7.6 and the memory consumption is fortunately low, but the same script aborts after a few seconds with an "out of memory“ error when using BaseX 7.7 - same basic configuration used. It does not make any difference whether I test all stuff with the GUI or let it run automatically by using the client lib. By the way, I do use the perl client lib. It would be great if you could give me some hints how to proceed with 7.7. I have tried even 7.7.2 with no success. Thanks in advance, Regards, Werner

2 1

Re: [basex-talk] strange behaviour of the BaseXgui-editor
by Rob Stapper 26 Oct '13

26 Oct '13

Hi, An update concerning problem 2 The problem occurs when I change the signature of one or more functions in an imported module. If there are too many functioncalls in my main program triggering an error because of this change in signature of the called function than the errorstatusmessages in the editor window get out of sync. An work around is to split the main program in a small first file and a large second file. After debugging the first file I copy an amount of new code from the second file into the debugged first file and start debugging the new copied code. This is repeated until all code is copied into the first part and the second part is empty. Resumé: It is not the size of the program that triggers the sync-problem with the errorstatusmessage but the amount of errors, which in a large program is higher than in a small program. Hope this helps solving the problem. Regards, Rob Stapper Van: Rob Stapper [mailto:r.stapper@lijbrandt.nl] Verzonden: zaterdag 26 oktober 2013 13:45 Aan: 'basex-talk(a)mailman.uni-konstanz.de' Onderwerp: strange behaviour of the BaseXgui-editor Hi, I encountered a few (3) problems with the BasexGui-editor. I use the 7.8 beta release but the issues also occur in previous versions. Problem 1: this is a minor problem but maybe related to problem 2 which is ( for me) a major problem: If I open two ( small) packages of which one has no errors and one has errors then the errorstatus-message at the bottom of the editor doesnt synchronize correctly when switching files. If I switch from the incorrect packagefile to the correct packagefile the errormessage doesnt refresh to ok until I edit this file. Even after closing an activated incorrect packagefile the errormessage stays active. Clicking on the message even reopens the incorrect packagefile. Switching the focus from the correct packagefile to the incorrect packagefile however, doesnt show this behavior. In that case the errorstatus-message changes to the appropriate errormessage of the incorrect file. Problem 2: which is a major problem when working with big files ( 80 kB) I found that when editing a large(r) packagefile the Basexgui-editor doesnt recognize errors that occur after a certain point in the file. If errors occur after this point the errorstatus-message shows ok but I know that the file contains errors and if I try to install the file as a package I get an window with the message below. If the error occurs before that certain point then I get an correct errormessage. However if I delete the code which contains the error the error-message remains. Clicking on the message brings the cursor to the point where the deleted code with the error used to be, even after saving and closing the file. Errormessage ============================================================================ ============================================== Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 beta Java: Oracle Corporation, 1.7.0_45 OS: Windows Vista, x86 Stack Trace: java.lang.NullPointerException at org.basex.query.func.StaticFuncs.check(StaticFuncs.java:121) at org.basex.query.QueryParser.finish(QueryParser.java:312) at org.basex.query.QueryParser.parseLibrary(QueryParser.java:253) at org.basex.query.QueryContext.parseLibrary(QueryContext.java:197) at org.basex.query.util.pkg.RepoManager.installXQ(RepoManager.java:230) at org.basex.query.util.pkg.RepoManager.install(RepoManager.java:70) at org.basex.core.cmd.RepoInstall.run(RepoInstall.java:37) at org.basex.core.Command.run(Command.java:344) at org.basex.core.Command.exec(Command.java:320) at org.basex.core.Command.execute(Command.java:77) at org.basex.core.Command.execute(Command.java:89) at org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:178) ============================================================================ ============================================== Being a responsible Basex-user I does what it says and give you some feedback J Problem 3: This is an old issue that I addressed e few months ago but which you could not reproduce. I found a new clue which might help you solving this issue. The issue was when working in fullscreen mode (F11) in the BasexGUI and then saving a file with save as The save-messagebox gets the focus but disappears behind fullscreen basexgui-window. This has something to do with using a dual monitorsystem. On a single monitor system it works ok: The save-box is placed on top of the fullscreen Basexgui-window and gets the focus. On a dualmonitorsystem the save-box is placed behind the fullscreen Basexgui-window and gets the focus. I hope this insight helps you tackle this minor issue. Well, thats all folk. I hope you can solve the editor-problem soon because I have a really hard time debugging my (large(r)) programs. Regards, Rob Stapper

1 0

parse-xml removes CDATA in text content
by Erdal Karaca 25 Oct '13

25 Oct '13

Hi all, When using parse-xml(-fragment), wrapping CDATA sections are removed and the text content within the original CDATA is returned. For example: parse-xml-fragment("<newNode><data><![CDATA[{cdata}]]></data></newNode>") returns <newNode> <data>{cdata}</data> </newNode> But I need this: <newNode> <data><![CDATA[{cdata}]]></data> </newNode> Do I miss something? Thanks!

3 6

Full Text Module - ft:search function
by John Best 25 Oct '13

25 Oct '13

Dear Christian, The syntax of the ft:search is - *ft:search($db as xs:string, $terms as item()*, $options as item()) as text()** In the $options part, I have seen various options like - Any Word, All Words, Phrase (for Exact Phrase), fuzzy and wildcards. These are really very good features. I am using them extensively. But one thing, I think, is missing and that is the Window/Distance Options for proximity search. Can these options be implemented.. ?? -- Have a nice day JBest

3 5

Re: [basex-talk] suppressing pre-evaluating information in evaluate-chapter in query-info window of BaseX-GUI
by Christian Grün 25 Oct '13

25 Oct '13

Hi Rob, looking forward to your demo (..so this only occur when you are running a large code base?), Christian 2013/10/25 Rob Stapper <r.stapper(a)lijbrandt.nl>: > Hi Christian, > > 1) I just downloaded the latest 7.8 beta release and this issue also occurs > in this version. > 2) The issue also occurs even if I don't interrupt the program. > 3) I'll see if I can reproduce this issue in a demo-program which I'll send > you later. The program where this occurs is about 200 kB including modules. > Maybe this is why the issue occurs. > > Btw. I do like the map:serialize instruction in 7.8 version. I sure helps my > debugging this 200kB monster. However a good debugger would help much more > ;-)) ( sorry, old cow but I couldn't resist ) > > Regards, > Rob > > -----Oorspronkelijk bericht----- > Van: Christian Grün [mailto:christian.gruen@gmail.com] > Verzonden: vrijdag 25 oktober 2013 10:53 > Aan: Rob Stapper > CC: BaseX > Onderwerp: Re: [basex-talk] suppressing pre-evaluating information in > evaluate-chapter in query-info window of BaseX-GUI > > Hi Rob, > >> When using a trace-instruction, like this: let $dum := trace( >> $local:programName, 'programmaNaam: '), in a Xquery program in the >> BaseX-GUI >> >> I get pre-evaluating information of some functions mixed with my trace >> output in the Query-Info-window, see below. > > The Info View will always return both the evaluation and compilation info. > However, the output should be clearly separated: > _________________________________ > > Interrupted. > Evaluating: > - programmaNaam: D03084 > > Compiling: > - pre-evaluating function($911 as element(when)) as map(*) { ... > _________________________________ > > Did the mixup occur with the latest version or snapshot? And does the > problem also occur when you don’t interrupt the query. And my last > question: could you provide us with a little sample query that demonstrates > the issue (you can use prof:sleep(...) to delay the output)? > > Thanks, > Christian > > > >> To be able to follow the programflow, I only want to see my >> trace-output, in this case the programName. >> >> Can I suppress this extra pre-evaluating query info? >> >> >> >> This for your reply in advance. >> >> >> >> Kind regards , >> >> Rob Stapper >> >> ====================================================================== >> ====================================================================== >> == >> >> QUERY INFO WINDOW >> >> Error: >> >> Interrupted. >> >> Evaluating: >> >> - programmaNaam: D03084 >> >> - pre-evaluating function($911 as element(when)) as map(*) { >> function($evaluateStatement.valuedBranche as element(when)) as map(*) >> { >> cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatemen >> t.valuedBranche), >> koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche) >> , >> $nestedStatements.processor($evaluateStatement.valuedBranche/nestedSta >> tements)) >> }($911) } >> >> - pre-evaluating function($912 as element(when)) as map(*) { >> function($evaluateStatement.valuedBranche as element(when)) as map(*) >> { >> cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatemen >> t.valuedBranche), >> koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche) >> , >> $nestedStatements.processor($evaluateStatement.valuedBranche/nestedSta >> tements)) >> }($912) } >> >> - pre-evaluating function($913 as element(when)) as map(*) { >> function($evaluateStatement.valuedBranche as element(when)) as map(*) >> { >> cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatemen >> t.valuedBranche), >> koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche) >> , >> $nestedStatements >> >> >> >> >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk(a)mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >

1 0

suppressing pre-evaluating information in evaluate-chapter in query-info window of BaseX-GUI
by Rob Stapper 25 Oct '13

25 Oct '13

Hello, When using a trace-instruction, like this: let $dum := trace( $local:programName, 'programmaNaam: '), in a Xquery program in the BaseX-GUI I get pre-evaluating information of some functions mixed with my trace output in the Query-Info-window, see below. To be able to follow the programflow, I only want to see my trace-output, in this case the programName. Can I suppress this extra pre-evaluating query info? This for your reply in advance. Kind regards , Rob Stapper ============================================================================ ================================================================== QUERY INFO WINDOW Error: Interrupted. Evaluating: - programmaNaam: D03084 - pre-evaluating function($911 as element(when)) as map(*) { function($evaluateStatement.valuedBranche as element(when)) as map(*) { cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatement.valu edBranche), koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche), $nestedStatements.processor($evaluateStatement.valuedBranche/nestedStatement s)) }($911) } - pre-evaluating function($912 as element(when)) as map(*) { function($evaluateStatement.valuedBranche as element(when)) as map(*) { cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatement.valu edBranche), koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche), $nestedStatements.processor($evaluateStatement.valuedBranche/nestedStatement s)) }($912) } - pre-evaluating function($913 as element(when)) as map(*) { function($evaluateStatement.valuedBranche as element(when)) as map(*) { cobol:selection.valuedBranche.constructor(db:node-id($evaluateStatement.valu edBranche), koopa:evaluateStatement.object.Value($evaluateStatement.valuedBranche), $nestedStatements

2 1

Basex with Multithreading
by Erol Akarsu 25 Oct '13

25 Oct '13

I am working on crawling data. I can see it is taking a lot of time because xquery is pulling web pages one by one. But popular crawlers like apache Nutch has multithreading support so it can open multiple socket connections to multiple sites so that it can crawl very fast. Can we make add multithreading support basex? So it can run multiple xquery functions in parallel and then merge results? Initially, merging results can be done manually. At least, if we can distribute loads to different xquery functions, that would be great. Erol Akarsu

2 4

do not interpret text nodes as embedded expressions (Expecting '}' but found...)
by Erdal Karaca 23 Oct '13

23 Oct '13

Hi all, How can I process this query in basex: let $x := doc(<a>main(){int i = 0;}</a>) return replace value of node $x with "" There are text contents that contain, for example, c code with curly braces which I do not want to be interpreted as embeded expressions. As a workaround I could escape the curly braces, But, is there a better way/option to suppress interpreting text contents that look like embedded expressions? Thanks!

3 4

Out Of Main Memory error while creating BaseX DB
by elangovan MuthuSwamy 23 Oct '13

23 Oct '13

Hi All, I am using BaseX to evaluate Xpaths (Xqueries) for larger size of XML files. I have created BaseX database initially using *CreateDB*.execute(ctx) API. And every time when I need to evaluate Xpath I open database using Open("database name") API and get a context. Using this context I evaluate the xpath. Once I complete my evaluation I close the context using Close.execute(ctx) API. My application is running without any issues. If the server runs for few weeks, I have observed "Out Of Main memory error" while updating the BaseX database. Could any one please help me in this issue. Is there any possibility of memory leak in BaseX in my work flow? Note: I am using same CreateDB(...) API to update / overwrite the existing Database. XML file Size may vary from 3Mb to 10 Mb. -- Regards, Elango.

2 1

Cache compiled expressions for use with QueryProcessor
by Erdal Karaca 22 Oct '13

22 Oct '13

Hi all, We have lots of non dynamic (i.e. do not change at run-time) queries/expressions that are always parsed/compiled using a new QueryProcessor instance. How to cache compiled expressions for use with QueryProcessor? Or can we just cache QueryProcessor instances? If yes, are QueryProcessor instances thread-safe? Thanks!

2 4

java.nio.channels.OverlappingFileLockException
by EV Narasimham 22 Oct '13

22 Oct '13

Hi, I have 3 application modules. One module, creates the xml database, the second/third module execute queries on the database (no updates are being performed on the database). When the second and the third module try accessing the database, once module is able to query the database while the other module ends up with the below exception. org.basex.core.BaseXException: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 beta Java: Oracle Corporation, 1.7.0_25 OS: Linux, amd64 Stack Trace: java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255) at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152) at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:1017) at org.basex.io.random.TableDiskAccess.lck(TableDiskAccess.java:183) at org.basex.io.random.TableDiskAccess.sharedLock(TableDiskAccess.java:170) at org.basex.io.random.TableDiskAccess.<init>(TableDiskAccess.java:83) at org.basex.data.DiskData.init(DiskData.java:122) at org.basex.data.DiskData.<init>(DiskData.java:92) at org.basex.core.cmd.Open.open(Open.java:68) at org.basex.core.cmd.Open.run(Open.java:35) at org.basex.core.Command.run(Command.java:344) at org.basex.core.Command.exec(Command.java:320) at org.basex.core.Command.execute(Command.java:77) at org.basex.core.Command.execute(Command.java:89) Below are the options being set: context.globalopts.set(GlobalOptions.GLOBALLOCK, false) ; context.globalopts.set(GlobalOptions.PARALLEL, 1) ; //After referring to https://github.com/BaseXdb/basex/issues/574<https://github.com/BaseXdb/basex/issues/574> When the same exercise is being undertaken on a windows machine, the above behavior does not occur. Regards Narasimham <https://github.com/BaseXdb/basex/issues/574>

2 2

Prefetch DOM root node (no lazy loading) using QueryProcessor command
by Erdal Karaca 19 Oct '13

19 Oct '13

Hi all, When querying a DOM Node (from DB on file system, i.e. no in memory DB) using QueryProcessor command: will the whole Node be fetched from the database or will parts of the Node's children still access the file system if not loaded yet? Thanks!

2 3

browser does not execute redirects
by Florian Eckey 19 Oct '13

19 Oct '13

Hi guys, i have a problem with redirects in basex. I have following function: declare %restxq:path("anyPath") function { "Some XQuery Code", <restxq:redirect xmlns:restxq="http://exquery.org/ns/restxq ">/restxq/anyOtherPath</restxq:redirect> }; This function I call with http://localhost/restxq/anyPath in my browser (Chrome). So I expect, that the browser gets the redirect an executes it. But it only returns: <restxq:redirect xmlns:restxq="http://exquery.org/ns/restxq ">/restxq/anyOtherPath</restxq:redirect> instead of the redirected page. In the attachment there is a screenshot. Is there anyone with the same problem or a solution? Regards, Florian PS: Are there any BaseX developer meetings in Germany?

2 1

Implementation of fn:collection
by Jeremy Moseley 17 Oct '13

17 Oct '13

Hi Guys, I was trying to use the fn:collectino function today, but I am having trouble understanding the implementation. From past experience, fn:collection($uri) (where $uri points to a document with a list of docs within it) has returned a sequence of all the documents. It appears that BaseX does not implement it this way. I have a database where I am storing a large number of documents, and I would like to have several collections inside which are subsets of these documents. I need to open these subsets quickly, and I thought fn:collection would allow me to do this. Is there any way to easily open these subsets using fn:collection (or a similar high performance function)? As of right now I am solving the problem by using a for loop to traverse the documents, but this is not fast enough for my needs. Thanks, Jeremy

2 6

OAI-PMH
by Lars Johnsen 17 Oct '13

17 Oct '13

Hello all I am looking into the possibility of using BaseX as an OAI-PMH metadata provider and harvester, and wondered if anyone has experience with it for this purpose. Specifically using BaseX as a repository with the http-service with xquery scripts for accessing and providing metadata records. Presumably, there aren't any limitations on the database side, and since the OAI-PMH protocol is all XML (http://www.openarchives.org/pmh/) it seems like a good idea to try and make it work. So if people on this list have any experience, I would like to hear from you. thanks, Lars G Johnsen National Library of Norway

1 0

problem with basexhttp
by Lars Johnsen 15 Oct '13

15 Oct '13

BaseX is installed by administrators on one of our server machines. When starting the http server, the followng message is displayed: $ ./basexhttp ..../basex/bin/src/main/webapp/WEB-INF/web.xml not found. which is a bit strange since the webapp folder is a sister folder to the bin folder. So why is it looking for webapp in ..../bin/src/main/ ? The webapp folder in itself do appear to contain all the relevant folders and documents. As it is similar to a working setup on another machine. All the best Lars G Johnsen National Library of Norway

2 1

basex 7.7.2 milton-api pom not found
by Dustin Schultz 11 Oct '13

11 Oct '13

Hi, I'm getting a failed build based on a missing dependency related to basex-api: Could not resolve dependencies for project edu.utah.further.core:core-qunit:bundle:1.4.0-SNAPSHOT: Failure to find com.ettrema:milton-api:jar:1.8.1.4 in https://nexus.chpc.utah.edu/content/groups/public was cached in the local repository, resolution will not be reattempted until the update interval of nexus has elapsed or updates are forced -> [Help 1] I noticed that no explicit version is declared for the POM for basex-api which means that Maven will resolve the latest version. Shouldn't there be explicit versions? <dependency> <groupId>com.ettrema</groupId> <artifactId>milton-api</artifactId> </dependency> I can exclude and include 1.7 for now to resolve it but for the future. . . Thanks, Dustin

2 2

Constructing query result iterator takes as long as the query execution itself
by Erdal Karaca 11 Oct '13

11 Oct '13

Hi all, When using the QueryProcessor to execute a query, then, constructing an iterator from the Result object takes almost as long as the query execution itself. For example, if QueryProcessor.execute() consumes 100 ms, then Result.iter() takes an additional 75%. Same with Result.value(). Is there something I can boost up? Thanks! Erdal

2 4

Fwd: Rest paths and wildcards/regex
by Jeremy Moseley 10 Oct '13

10 Oct '13

Hi Guys, I was wondering if there was any way to implement wildcards and/or regex matching with the %rest:path annotation when using the RESTXQ module. I have several situations where I am matching similar numbers of arguments to different functions, or an unknown number of arguments to a single function, and I was trying to figure out the best way to accomplish this. Cheers, Jeremy

2 2

Computed namespaces: which one is wrong?
by Marco Lettere 09 Oct '13

09 Oct '13

Hello all, in 7.6 I used to write code like the following one: <a> {namespace { "" } { "eeeeee" }} </a> it uses to return this as (the expcted) result: <a xmlns="eeeeee"/> In 7.7 the same code snipped returns a runtime exception stating that namespace '' has been declared twice. I assume it's because a default namespace is created under the hood on the root node. Is it? Could I please have any help on this? Thanks a lot, M.

3 2

Re: [basex-talk] Export gzipped XML files
by Christian Grün 08 Oct '13

08 Oct '13

Hi Mike, > PS: how can I post this text to your answer so that it appears in the > posting thread? Just reply to the mailing list. > Thank you for answering my mail. In an other case I did in fact use the > archive module to zip XML files into an Excel file (xlsx) and it did the job > really good :-) Nice! > But in this case I wanted the user to be able to export the files via the > BaseX GUI... Let’s see if someone takes care of this.. Christian

1 0

Export gzipped XML files
by Mike Cobo 08 Oct '13

08 Oct '13

Hi, I created a database from gzipped XML files, then deleted some elements (using "delete node"). Now I want to export the files again as gzipped XML files. But when I use the "Database > Export..." function of the BaseX GUI the files are exported unzipped. Question: is it possible to export the files as gzipped XML files? Thx - Mike

2 1

Fwd: [homebrew] basex 7.7.2 (#23100)
by Jens Erat 07 Oct '13

07 Oct '13

I just bumped BaseX on Homebrew to 7.7.2, patch already got merged. Whoever's using Homebrew is just a brew update; brew upgrade basex away from the newest release. Regards, Jens -- Jens Erat [phone]: tel:+49-151-56961126 [mail]: mailto:email@jenserat.de [jabber]: xmpp:jabber@jenserat.de [web]: http://www.jenserat.de PGP: 350E D9B6 9ADC 2DED F5F2 8549 CBC2 613C D745 722B Anfang der weitergeleiteten Nachricht: > Von: Mike McQuaid <notifications(a)github.com> > Betreff: Aw: [homebrew] basex 7.7.2 (#23100) > Datum: 7. Oktober 2013 16:53:44 MESZ > An: mxcl/homebrew <homebrew(a)noreply.github.com> > Kopie: JensErat <email(a)jenserat.de> > Antwort an: mxcl/homebrew <reply+i-68992688-ffa65db8839fe5d83e9eccef8d1c043a081d3fe5-628441(a)reply.github.com> > > Closed #23100 via f7ace42. > > — > Reply to this email directly or view it on GitHub. >

1 0

xquery replace node adds spaces to inline content
by France Baril 07 Oct '13

07 Oct '13

Hi, I'm getting extra spaces after a node replace. Code: *let **$original* := <div>I love flowers (<specify/>). I love flowers: <specify/>.</div> *let* *$specify* := red, yellow and white ones *let* *$new* := *copy* *$copy* := *$original* *modify*(*for **$prompt* *in **$copy*//*specify* *return **replace* *node* *$prompt* *with* * $specify*) *return **$copy* I would expect $new to give: I love flowers (*red, yellow and white ones*). I love flowers: *red, yellow and white ones*. But I get extra spaces inside the parenthesis of the first sentence and before the period of the second sentence: I love flowers (* red, yellow and white ones** *). I love flowers: *red, yellow and white ones** *. You can try my .xqm on BaseX 7.7 1. Create a DB 'test' with chop white spaces to 'no'. 2. Run access http://*localhost:8984*/test-extra-spaces/test-1 from your browser. 3. Look at the .xml in the test DB. It has extra carriage return. It looks like the query assumed that was a block and it felt compelled to add a carriage return and indent. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 6

BaseX 7.7.2
by Christian Grün 07 Oct '13

07 Oct '13

Dear all, a new minor BaseX release is available; it provides the following new features and fixes: XQUERY • a CSV Module and serialization was added • the JSON serializer was updated (more to follow!) • some update checks in the modify clause were fixed • parsing of new map syntax was fixed (ignoring spaces) • tail call handling in built-in higher order functions was fixed API • a Russian translation was added (thanks to Oleksandr Shpak, Max Shamaev) • command-line arguments starting with '<' are interpreted as XQuery INDEXING • a bug was fixed in the updatable index structure (updindex=true) We are looking forward to your feedback, Christian, BaseX Team 2013

1 0

db:list($db) returns raw files, but not db:list($db, $path)
by France Baril 01 Oct '13

01 Oct '13

I'm currently on 7.7. The second function returns files from folders and subfolders at $path, but omits the folders that contain only raw files. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk October 2013