August 2017 - BaseX-Talk - mailman.uni-konstanz.de

oXygen XML, content negotiation and #1220
by Omar Siam 20 Feb '18

20 Feb '18

Hi list! I like my oXygen editor to request raw XML data from my RESTxq endpoints to test XSL stylesheets. When I do this with RESTxq paths that have different %rest:produces it fails with the BASX0003 multiple functions error. Turns out oXygen sends application/xml, */* as Accept header without any quality. I understand that as documented in https://github.com/BaseXdb/basex/issues/1220 this is known not to work. My/our workaround is to branch in a single XQuery function using sth. like: if (some $a in tokenize(request:header("ACCEPT"), ',') satisfies $a = ('text/xml', 'application/xml')) then $xml else $xhtml I hope this is still on the agenda for 8.7. Best regards Omar Siam

3 7

Preparing BaseX 8.5.4 (please don't forget Issue #1341)
by Jan Dölle 20 Feb '18

20 Feb '18

Hi, we noticed you prepare release 8.5.4. Please don't forget to fix issue: SQL with BaseX 8.5.3 #1341 Thx Jan -- Jan Dölle E-Mail: basex-list(a)id1.de Telefon +49-69-244502-0 Home: www.id1.de Information Design One AG, Baseler Straße 10, 60329 Frankfurt am Main Registereintrag: Amtsgericht Frankfurt am Main, HRB 52596 Vorstand: Robert Peters, Aufsichtsrat: Christian Hecht (Vorsitz)

4 5

HTTP module
by Giuseppe Celano 10 Oct '17

10 Oct '17

Hi, I am accessing a RESTful API via the following command: curl -F data=(a)example.txt -F tokenizer= -F tagger= -F parser= http://lindat.mff.cuni.cz/services/udpipe/api/process > example2.txt I am wondering what the best way is to do that in BaseX. The service also has a URL syntax, as shown in the following example: http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&pars…. <http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&pars….> I have tried: http:send-request(<http:request method='get' href='http://lindat.mff.cuni.cz/services/udpipe/api/process?tokenizer&tagger&…'/>) and works perfectly; but I was trying to put the body of the request in http:body, but it does not work: http:send-request(<http:request method='get' href='http://lindat.mff.cuni.cz/services/udpipe/api/process'> <http:body media-type ="string"> tokenizer&tagger&parser&data=Děti pojedou k babičce. Už se těší. </http:body> </http:request>) I could invoke the curl command in BaseX, but maybe there is a more elegant way to send the content of the file (than adding it to the URL). Thanks. Ciao, Giuseppe Universität Leipzig Institute of Computer Science, Digital Humanities Augustusplatz 10 04109 Leipzig Deutschland E-mail: celano(a)informatik.uni-leipzig.de E-mail: giuseppegacelano(a)gmail.com Web site 1: http://www.dh.uni-leipzig.de/wo/team/ Web site 2: https://sites.google.com/site/giuseppegacelano/

4 10

json-to-xml and xpath
by Günter Dunz-Wolff 18 Sep '17

18 Sep '17

Dear all, I’m trying to get data out of json via xquery. This is my scenario: 1. Fetching data with fetch:text() calling a REST-API 2. Transforming the data with json-to-xml, so I’ll get something like <array xmlns="http://www.w3.org/2005/xpath-functions“> <map> <string key=„word1“>gehen</string> ... </map> ... </array> 3. In my xqm-file I have: let $json_xml := json-to-xml(my_fetched_json) 4. I try to get „gehen“ with $json_xml//string[@key='word1‘], but it yields nothing, also $json_xml//string yields nothing. Only $json_xml//text() yields all string-values into a long string. What am I doing wrong? Or is there another way, to work with JSON-Data to get values of a given key? Thanks in advance, Günter

9 14

Startup hooks or persisting jobs
by Kendall Shaw 18 Sep '17

18 Sep '17

Am I missing an existing way to run xquery at startup (basex web service running under tomcat)? I have jobs that I schedule, but I have to schedule them again if basex is shutdown. I can test for basex being started outside of basex and then execute queries, but if there is already a way to do this within basex, I would rather do that. Kendall

3 3

Best practice for storing timestamp information in XML
by Dave Day 31 Aug '17

31 Aug '17

Greetings List, I've got an 8 byte value that is the output of a Store Clock instruction on a mainframe. The value created by the instruction is a 64 bit hex value where bit 51 is equal to one microsecond. To get a value that is microseconds, the original clock value is shifted to the right 12 bits. The clock started at all 0's on January 1st, 1900. I need to be able to store and do basic math(addition and subtraction) on the value in microseconds. And, these values will need to be displayed on a browser in HH:MM:SS.TTTTTT format. If I create the decimal value for the integer on the mainframe when creating the XML record, I will have to go thru some conversion logic. There could be possibly millions of these records in one XML database. It seems to me to make more sense to create the value as a hexBinary element, and then have some code running within BaseX do the conversion to create the correct time value. Is this the way to do something like this? Regards, -- Dave Day

4 4

Old dog trying to learn some new tricks.
by Dave Day 29 Aug '17

29 Aug '17

Greetings BaseX list, I've got some very basic questions I was hoping I could get the answers to on this list. Questions really break down into two categories. My background is strictly on IBM mainframes, so please bear with me. 1)Some XML schema questions, and 2)Questions regarding how to configure/use BaseX for what I want to do. XML schema. I've got a record definition created by IBM that changes somewhat depending upon the release of the system. I want to create XML schema for each release dependent definition, and then make that definition available to BaseX. I thought using namespaces was the way to go, but now am not sure. What I was hoping to do was to connect to a running BaseX, and send the schema definitions that would be used to validate the XML. In reading doc, I see it is possible to create namespaces and use them, but the format has to be either a URL or a URN. Is it possible to create a URN for a namespace on the fly, and then tell the code later on which namespace to use? Regards, -- Dave Day

4 3

Test message. Just to see if it works.
by Dave Day 28 Aug '17

28 Aug '17

1 0

XUDY0016 error
by Britney Fox 25 Aug '17

25 Aug '17

Hello, I get this error: [XUDY0016] Documents in path '...' can only be replaced once. Code : XUDY0016 Description : In a replace expression, a target is replaced more than once. Examples : let $a := <x>x</x>/node() return (replace node $a with <a/>, replace node $a with <b/>) Is there a BaseX option to allow multiple "replace" in one query on the same document ?

2 1

Could not reserve enough space for object heap
by Bram Vanroy 25 Aug '17

25 Aug '17

Hi all I'm running into an issue with many databases. I.e. one server instance with millions of databases. When creating all of these, I found that the more databases are included on the instance, the slower further database generation got. For instance, I could see in the logs that in the first < 10.000 databases the creation happened smoothly with around 50ms per file of 1-4kB. However, when having more and more databases for this server instance, things got very slow: for an XML file of 1-4kB the logs show ~600ms. This is terribly slow, as you can imagine. At first I thought something was wrong with my hardware, but I checked on another system and the same issues arises. Then I thought maybe Java is doing something strange, so I figured I'd reboot and see if that cleared some stuff up. But now when I try to launch 'basex' or 'basexserver', I get the following message: Could not reserve enough space for 1433600KB object heap I googled the issue, and it was suggested that I added a JAVA option to my system's variable (I'm on Windows 10 64 bit, BaseX 8.6.4) indicating the memory it could use. I set that to 2048MB. But still the same issue persists. I have contacted the list before, with issues of generating millions of database with the same server instance, and this seems another one related to the problem. I am no expert AT ALL, but isn't it possible there is some sort of micro memory leak that only becomes apparent when creating an amount of databases of this magnitude? If not, other ideas are welcome as well. At least on how to get rid of the Java error mentioned above. Kind regards Bram Vanroy

5 10