January 2014 - BaseX-Talk - mailman.uni-konstanz.de

JSON or JSONML output formatting
by Zachary Pride 16 Jul '14

16 Jul '14

Hello, I've been playing with BaseX lately and all-in-all am very impressed. Something I'm wrestling with however is the JSON output options. I've got various web applications that would really be simplified by receiving JSON straight away for the obvious scripting benefits. The JSON method has been giving me a lot of grief, stipulating rules I'm not sure how to follow. right now I have an element that "is typed as string and cannot be nested." I've been able to get JSONML to output but the JSON is this morass of nested Arrays... Attributes seem to get transformed into Objects but elements/tags and their values are pushed into Arrays for some rationale - which I suppose is on purpose. My question is how can I get Objects for simple key:value properties from <tag>value</tag> 's. Are there options I'm not utilizing? Would it be feasible to transform the XML output to some middle form first - setting it up to become Objects, before serializing it to JSON? Thanks! Zach Pride Associate Software Engineer Ultra Electronics, ProLogic 1000 Green River Drive, Ste. 201 Fairmont, WV 26554 zachary.pride(a)ultra-prologic.com Tel: +1 304 333 2680 ext.308 www.ultra-prologic.com This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. Please consider the environment before printing this email.

4 4

Dynamic Module Loading
by Jean-philippe Magué 19 May '14

19 May '14

Hello, Exist-db has an util:import-module<http://exist-db.org/exist/apps/fundocs/view.html?uri=http://exist-db.org/xq…>function that allows to dynamically import an XQuery module at run time. I haven't found anything equivalent in BaseX. Is that right ? I have also tried to see how to implement such a function directly in Java, but as far as I understand the module parsing process, functions prefix are checked at compile time. That would compromise any attempt to write such a function. Am I right ? Best, Jean-Philippe -- Jean-Philippe Magué Maître de Conférences en Humanités Numériques Responsable de l'Atelier des Humanités Numériques : ahn.ens-lyon.fr Ecole Normale Supérieure de Lyon +33 (0)4 26 23 38 08 -- "Using computers will therefore lead us to a more profound and systematic knowledge of human expression; in principle, it can help us to be more humanistic than before." Busa, 1980.

6 16

problem with namespaces in baseX - Namespaces are inserted only once in the database
by Ioannis Kavvouras 07 Feb '14

07 Feb '14

Hello, While trying to execute a replace query [1], we face the following problem: The new "capabilities" node contains a group of subnodes which have in their definition the same namespace definition (xmlns namespace). The problem is that in the result after the replacement the namespace definition is only in the first node (ows:ServiceIdentification). In the following nodes the majority of the attributes in the namespace definition are missing and as a consequence the xml file is corrupted as the definition of the elements are undefined. An example of a corrupted node where the attributes of the namespace definition are missing is mentioned at [2]. [1] https://dl.dropboxusercontent.com/u/78985205/query.txt [2] https://dl.dropboxusercontent.com/u/78985205/result.txt Regards Yannis

3 6

XML DOCTYPE Problem
by Martin Reckziegel 03 Feb '14

03 Feb '14

Hello everybody, i'm using basex 7.7.2 in a university based project. I'm trying to store TEI XML files in the database but there is an error storing certain valid files. Using a rest PUT request to store a file starting like this: <?xml version="1.0"?> <!DOCTYPE TEI.2 PUBLIC "-//TEI P4//DTD Main DTD Driver File//EN" "http://www.tei-c.org/Guidelines/DTD/tei2.dtd" [ <!ENTITY % TEI.XML "INCLUDE"> <!ENTITY % PersProse PUBLIC "-//Perseus P4//DTD Perseus Prose//EN" "http://www.perseus.tufts.edu/DTD/1.0/PersProse.dtd" > %PersProse; ]> <TEI.2> <teiHeader type="text" status="new"> .... results in this error: > "tlg0003.xml.xml" (Line 5): ']' expected, '<' found. (Line 5 is %PersProse;) I have no clue how to interpret the error since non of the mention characters are in that line. Maybe this is resulting in some internal replacement? Anyway deleting line 5 resolves the error (but of course does not solve my problem since i don't want to alter the files) The problematic files are all valid, at least according to http://www.validome.org/xml/validate/ and http://validator.w3.org/check so i wonder why they are rejected by basex? kind regards, Martin Reckziegel

2 10

Introspection bug in BaseX7.8 beta 4cfa54c ?
by jean-marc Mercier 01 Feb '14

01 Feb '14

Hello, As bug https://github.com/BaseXdb/basex/issues/839 has been closed, I tried to upgrade from BaseX7.8 6aeaebf to BaseX beta_4cfa54c. Unfortunately, this bug still appears in 4cfa54c, and I rolled back again to beta 6aeaebf . Did I misunderstoog something ? Cheers

2 8

Searching text using wildcards options
by John Best 31 Jan '14

31 Jan '14

Hi team, For the following query, using wildcards option, I am getting result as last 2 <a> nodes, but I am expecting the first 2 <a> nodes. !! let $a := <A> <a>Famu.</a> <a>Famu.Don</a> <a>FamuDon</a> <a>FamuDon.</a> </A> for $x in $a//a[text() contains text 'Famu..*' using wildcards] return $x Whats wrong? -- Have a nice day JBest

2 1

FW: How do I increase Java's heap size with the flag -Xmx<size>?
by DAIANE ROBERTA CANDIDA 31 Jan '14

31 Jan '14

Hello Dirk, You were right about the command used to increase Java's heap size, but my loading files don't work yet. The server has memory 988g When I put 500g in the option -Xmx it raised the error below: Error occurred during initialization of VM Unable to allocate bit map for parallel garbage collection for the requested heap size. Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. So I decreased it from 500 to 350 then the following error appears Out of Main Memory. You can try to: - increase Java's heap size with the flag -Xmx<size> - deactivate the text and attribute indexes. I already deactivated the indexes FTINDEX: OFF TEXTINDEX: OFF ATTRINDEX: OFF What should I do to import data into the basex? Regards, Daiane.

2 1

Use of attribute index
by Robert schlichtner 31 Jan '14

31 Jan '14

Hello, I found that a number of similar queries have quite different performance: xquery doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr']/v takes only 0.68ms, which is great. But xquery doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr']/v[1] takes 1479.81ms. If I change this to the equivalent (for my data) xquery (doc('mcev_temp_5/20140130_11_55_40.xml')//column[@name='KLV_m1_rdr'])/v[1] it runs fast again (0.53ms) Checking the query execution plan I found that only query 1 and 3 utilize the attribute index. I find this rather surprising, and I would like to ask if there is some general reason/rule why the second can not use the index, so I can avoid such 'bad' queries in the future. Thanks! (I am using BaseX 7.7.2 on Windows XP.) Regards, Robert

2 2

html and css
by Lars Johnsen 31 Jan '14

31 Jan '14

When running BaseX http-server, I wondered where resources like javascript and css should be located. The .xqm-file for the welcome RESTXQ module seems to fetch its svg and css from a static directory under webapp. However, when sending HTML code from within a home made query, it won't connect to any css neither within webapp nor webapp/static, nor even with an absolute path. Best Lars G Johnsen National Library of Norway

2 1

Parameter to xquery
by Lars Johnsen 30 Jan '14

30 Jan '14

Is it possible to pass parameters to xquery modules using BaseX scripting language? I tried something similar to to http-specification but had no luck. For example, if the code below is stored as add.xq, could $x and $y be supplied in a RUN add.xq command? declare variable $x external; declare variable $y external; let $res := $x + $y return $res All the best Lars G Johnsen National Library of Norway

2 1