- BaseX-Talk - mailman.uni-konstanz.de

Isilex on GIT
by xavierlaurent.salvador 08 Jan '18

08 Jan '18

I was told to post again this little news because of holydays, so sorry ;) if you wish to collaborate... it would be cool Hi List, just a small message to draw your attention on our new Git Repo dedicated to Isilex. We put all our stuff into : https://github.com/Isilex/download and all the web documentation at: https://isilex.github.io/easy-xml/ and https://isilex.github.io/easy-xml-fr/ Cheers, Envoyé depuis mon smartphone Samsung Galaxy.

1 0

How to set DBPath in BaseX version 8.6.7 as in version 7.3.1?
by Bang Pham Huu 05 Jan '18

05 Jan '18

Hello, I'm using BaseX version 7.3.1 and I can set dbpath where the collections are created with this code: new Set("dbpath", "/home/xxxx/basex-database").execute(context); However, when changing to BaseX version 8.6.7, this statement will throw exception "org.basex.core.BaseXException: Global option 'DBPATH' cannot be set." and instead it tries to create new collections to a default folder: /home/xxxx/BaseXData How can I set BaseX to work on existing dbpath folder (/home/xxxx/basex-database) as in version 7.3.1? Because I have existing data here and not the newly created one. Thanks,

2 1

BaseX Sharding with ActiveMQ & Docker
by James Sears 05 Jan '18

05 Jan '18

In the past I hit a scalability limit with BaseX - a billion+ nodes kind of a made querying it a bit slower than I liked. I thought I'd try and address this, so I’ve written some code and placed it in GitHub: https://github.com/jameshnsears/xqa-documentation What I've done is proof of concept, that's all - no way "finished". I'm emailing the list in the hope that what I've done so far might generate some constructive criticism. Maybe my approach has potential, maybe it doesn't? There are only four components so far, the first three are Docker containers: * an ActiveMQ instance * a load balancer * a shard * a command line client exists to load the XML, from file, into an ActiveMQ queue. The software requires close to zero configuration. For example, each shard you start will automatically receive XML from the load balancer. And the load balancer distributes XML so that each shard holds the same # of documents. There's a Travis project associated with the above link - it shows how easy it is to run the software end to end. So far my effort is all about ingesting the XML, before I move further I thought I'd canvass some feedback - so if anyone has any then please give it :-) Thanks.

2 1

Hundreds of thousands of java.io.IOException: Stream Closed in BaseX 7.3.1 from only catalina.out of Tomcat's log?
by Bang Pham Huu 05 Jan '18

05 Jan '18

Hello, I've been using BaseX (version 7.3.1 with Tomcat 8) to store an XML database from XML files and using XQuery to query the database. It works great before with simple Java servlet as I recall. After that, I updated to use Spring Boot (version 1.5.2) for this web application (only update from Java servlet to Spring Controller, the core to query BaseX doesn't change), and it seems this weird exception java.io.IOException: Stream Closed appears randomly by 100000 times in Tomcat's log (catalina.out). I tried to catch this exception in my web application but it is not able to catch. My web application's log (secore.log) also couldn't catch this error, only Tomcat's log (catalina.out) logs this error but with 100000 times (the log file is huge). Any idea to solve this problem will help me a lot? Here is the stack trace in catalina.out for 1 exception: https://pastebin.com/XGu7Vr2f And here is the configuration for log4j to log to both console and file (secore.log) and only console (catalina.out) contains this exception: https://pastebin.com/09ma3eyw Thanks,

2 1

Isilex on GitHub
by Xavier-Laurent SALVADOR 02 Jan '18

02 Jan '18

Hi List, just a small message to draw your attention on our new Git Repo dedicated to Isilex. We put all our stuff into : https://github.com/Isilex/download and all the web documentation at: https://isilex.github.io/easy-xml/ <https://isilex.github.io/easy-xml/> and https://isilex.github.io/easy-xml-fr/ Cheers, -- Ce message peut contenir des informations réservées exclusivement à son destinataire. Toute diffusion sans autorisation est interdite. Si vous n'en êtes pas le destinataire, merci de prendre contact avec l'expéditeur et de détruire ce message. *This email may contain material for the sole use of the intended recipient. Any forwarding without express permission is prohibited. If you are not the intended recipient, please contact the sender and delete all copies*.

2 1

Basex API: repeated execution of same query over different input
by Hondros, Constantine (ELS-AMS) 27 Dec '17

27 Dec '17

I want to be able to execute the same XQuery hundreds of thousands (even millions) of times over different XML input. Is there a way to avoid re-compiling the query itself every time? It looks to me like using either XQuery.execute(ctx) or the QueryProcessor class will end up re-parsing the query itself. I know that Basex is fast in this, but I will end up with a performance hit over time. Just wondering whether things have evolved since this thread: https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg03064.ht… Thanks, Constantine Hondros Senior Manager Content Analytics & Content Engineering Digital Transformation Elsevier BV Radarweg 29 | 1043 NX Amsterdam | the Netherlands Tel: +31 20 4852772 | Mob: +31610735630 E-mail: c.hondros(a)elsevier.com<mailto:m.nauta@elsevier.com> [cid:image001.jpg@01CBEEC6.C17A8AC0] Amsterdam | Chennai | Exeter | Oxford | Shannon | St. Louis ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1

Properly sending/receiving JSON?
by Robert Crews 24 Dec '17

24 Dec '17

First off, thank you for the fast answer to my previous question. Now, I'm having trouble understanding how to send JSON to BaseX. Ultimately, I want to send JSON and store it (allowing BaseX to convert it to XML first, of course). For now, however, I am having trouble just receiving the JSON data. Here's my test XQM file: module namespace hwxdocs = "urn:com:hortonworks:docs"; declare %rest:POST("{$body}") %rest:path("hello/json") %rest:consumes("application/json") %output:media-type("application/json") function hwxdocs:hello2( $body ) { "Request body: " || $body }; I send data with this command: curl -iL -X POST \ --header 'Content-Type: application/json' \ --header 'Accept: application/json' \ --data-binary '{"foo":{"bar":"baz"}}' \ http://localhost:8984/hello/json I expect to get Request body: {"foo":{"bar":"baz"}} (I’m assuming I can pass '{"foo":{"bar":"baz”}}’ to json:parse to convert to a BaseX XML that can be stored in the database.) However, instead, I get Request body: baz Can someone tell me what my error is? Thank you, Robert

2 1

Real time DB population using Nifi
by Juan Pablo Gardella 22 Dec '17

22 Dec '17

Hello team, First of all, congratulations for the awesome tool! BaseX is amazing. We are starting using it for querying some XML data that we are receiving from a queue. I've developed a Nifi processor based on https://github.com/BaseXdb/basex/blob/master/basex-examples/src/main/java/o… class. The problem that I'm facing is that write throughput is very slow. Do you know any way to increase the write throughput? All the XML files are stored in the same DB. So basically I'm doing: 1) open db 2) replace (xml id path, inputstream) Thanks, Juan

2 2

Handling exceptions in the Python Client API
by Jonathan Robie 21 Dec '17

21 Dec '17

I am now happily using BaseX from Jupyter Notebooks for Greek data - see these links: http://jonathanrobie.biblicalhumanities.org/blog/2017/12/08/jupyter-tutoria… http://jonathanrobie.biblicalhumanities.org/assets/greeksyntax-tutorial-pro… But I need to know how to handle exceptions, e.g. if the notebook user writes a query with an error in it. And I would also like to return some result if the query returns an empty sequence. Here is the current code: https://github.com/biblicalhumanities/greek-new-testament/blob/master/labno… How can I improve what I am doing? Jonathan

2 4

Setting a default collation for a database
by Jonathan Robie 19 Dec '17

19 Dec '17

I would like to set a default collation for a database, a collation that will be used for all queries unless the user asks for a different collation. My use case: a database in Greek will never be sensibly sorted using an English collation, and I don't want users to need to specify collations over and over. Is this possible? Jonathan

2 1