- BaseX-Talk - mailman.uni-konstanz.de

Feature request: RNG and Schematron validation
by Glatza, Philipp, le-tex 07 Jan '15

07 Jan '15

Just a short question: are there any plans to (not) support Schematron and/or RNG/RNC validation in the validation module? Philipp -- Philipp Glatza Content Engineering le-tex publishing services GmbH Weissenfelser Str. 84, 04229 Leipzig, Germany Phone +49 341 355356 128, Fax +49 341 355356 528 philipp.glatza(a)le-tex.de, http://www.le-tex.de Registergericht / Commercial Register: Amtsgericht Leipzig Registernummer / Registration Number: HRB 24930 Geschäftsführer: Gerrit Imsieke, Svea Jelonek, Thomas Schmidt, Dr. Reinhard Vöckler

3 3

Xquery update question
by Erol Akarsu 06 Jan '15

06 Jan '15

Hi, I have several xml document index keeping products features and have one master index file of products.. Currently, we have about 25 million products that have size about 25G xquery index size. My xquery application is reading features data from auxiliary xml document and enhancing master document. In order to do it, I am inserting data into master document with a generic insert command: insert node <FEATURES_NODE> into <PRODUCT_NODE> But xquery update is executing update process after all insert requests collected. But with huge size of my index, the memory of machine (35G) is exhausted easily and can NOT finish process. Is there way to execute individual xquery update requests one by one so that process can finish? Erol Akarsu

2 2

Fetching a binary document from BaseX with C# using the server API
by Boxstart, Bjorn 06 Jan '15

06 Jan '15

Hello, I'm currently working on the integration of BaseX in part of our .Net based software. One part of the functionality will be to store and retrieve binary files. I haven't been able to retrieve the raw files from the server yet using C#. I based my solution on the example of the C# client in the source code repository of BaseX. With my current solution I receive only the first few (3 to 7) bytes of the file (at least I think they are...). The code I have at the moment is: /// <summary> /// Retrieves a RAW document from the database. The database must be opened before executing this command. /// </summary> /// <param name="path">The path to the binary data to be retrieved</param> /// <returns>A byte array with the binary data</returns> public byte[] Retrieve(string path) { //stream.WriteByte((byte)BaseXCommand.QUERY); Send("RETRIEVE " + path); //Send(path); using (MemoryStream ms = new MemoryStream()) { Receive(ms); info = Receive(); if (!Ok()) { throw new IOException(info); } return ms.ToArray(); } } Can anybody please tell me what the problem with this solution can be or give me a hint for a correct way to retrieve the raw bytes? I know I can use the files on disk directly, but would rather not go that way. Thanks in advance for your reaction! Kind regards, Björn Boxstart

2 2

Question / Suggestion : Template mechanisms and operator overloading for XQUERY 3.++ ?
by jean-marc Mercier 06 Jan '15

06 Jan '15

Hello, I was wondering if it is possible to improve template programming and operator overloading with XQUERY 3.? 1) template programming : XQUERY provides a quite natural template mechanism using type switch and instance: declare function yell($animal) { if ($animal instance of element()) then return typeswitch($animal) case element(cow) return "Moo" default return "..." else "this is not an animal" }; However, I wonder whether it could be possible to provide such a mechanism directly at the interpreter level ? For instance, the following code seems coherent and concise : declare function yell($animal as element(cow) ) {"Moo"} declare function yell($animal as element() ) {".."} declare function yell($animal ) {"This is not an animal"} As far as I understand, XQUERY functions identification seems to be achieve through a couple (name, arity). Would it be difficult to extend it with (name,signature or predicate) ? 2) Operator overloading (quite linked to the previous question) I don't know how to overload operators with XQUERY. For instance I would like to define something like declare function array:operator+($left,$right){array:for -each-pair($left,$right,function($a + $b) { $a + $b } )} Is it possible ? I know that I can survive writing declare function array:plus($left,$right){array:for-each-pair($left,$right, function($a + $b) { $a + $b } )} but when one start to write algorithmic code, it is far easier and understandable to write $a+$b than array:plus($a,$b)

2 1

copy-namespaces declaration
by Alex R. Loayza 06 Jan '15

06 Jan '15

Hello, I've found this same issue on version 7.9: https://mailman.uni-konstanz.de/pipermail/basex-talk/2012-May/003294.html Is there now some fix I'm not aware of? Thank you. Alex

2 1

Out Of Memory
by Mansi Sheth 06 Jan '15

06 Jan '15

Hello, I have a use case, where I have to extract lots in information from each XML in each DB. Something like, attribute values of most of the nodes in an XML. For such, queries based goes Out Of Memory with below exception. I am giving it ~12GB of RAM on i7 processor. Well I can't complain here since I am most definitely asking for loads of data, but is there any way I can get these kinds of data successfully ? mansi-veracode:BigData mansiadmin$ ~/Downloads/basex/bin/basexhttp BaseX 8.0 beta b45c1e2 [Server] Server was started (port: 1984) HTTP Server was started (port: 8984) Exception in thread "qtp2068921630-18" java.lang.OutOfMemoryError: Java heap space at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.addConditionWaiter(AbstractQueuedSynchronizer.java:1857) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2073) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:744) -- - Mansi

5 17

Python client and BaseX 8.0
by Marc van Grootel 06 Jan '15

06 Jan '15

Hi, Anyone using the python client. I used it before, I think it was with 7.9, where it was still working. But now on a recent snapshot I cannot get my example to work anymore. I will report to maintainer but I would like to know if anyone could confirm having difficulties too. Anything changed in the protocol? I'm running on Python 2.7.8 :: Anaconda 2.0.1 (x86_64), on Mac that is. The error message occurs when trying to set up a session: /Users/marcvangrootel/Dropbox/notebooks/BaseXClient.py in __init__(self, host, port, user, password, receive_bytes_encoding, send_bytes_encoding) 129 # evaluate success flag 130 if not self.server_response_success(): --> 131 raise IOError('Access Denied.') 132 133 def execute(self, com): IOError: Access Denied. Thanks, --Marc

4 9

What's the best way to do some qualitative benchmarking?
by Marc van Grootel 06 Jan '15

06 Jan '15

Hi, For a few new blog posts I'm working on some examples where I compare traditional XQuery code with an Origami example. I am not looking for scientific answers but I do want to be able to do a more or less fair comparison. I noticed that when running code from the GUI timings can be quite different from running basex. Currently I do something like basex -V example/foo.xq or basex -r10 -V example/foo.xq What would be a honest way of including timings in an article. It's mainly for a qualitative assessment and comparing a traditional solution with an Origami solution. What to look for in the breakdown between parsing/compiling/evaluating and printing. Tips? Thanks, and I hope you are all having a good Xmas break. --Marc

2 1

Design finding "almost" duplicate xml files
by Mansi Sheth 02 Jan '15

02 Jan '15

Hello, I am trying to come up with a design, which just before insert a xml file into database, will warn us, that there is almost an identical xml file (with different name and different size) already stored in the database. "Almost identical" would be based on few elements of xml file such as: <root> <A name=""> <B name=""> <C name=""/> <C name=""/> . . </B> </A> . . . </root> "A" and "B" from above snippet but different "C". Element "A" could be repeated 100s of time in single xml file. Any pointers ? - Mansi

2 3

Fwd: Error Undefined Schema Name While Using schema-element(xbrli:item)
by ankit kumar 31 Dec '14

31 Dec '14

Ankit Kumar ---------- Forwarded message ---------- From: ankit kumar <ankitforstudy(a)gmail.com> Date: Wed, Dec 31, 2014 at 2:10 PM Subject: Error Undefined Schema Name While Using schema-element(xbrli:item) To: christian.gruen(a)uni-konstanz.de, alexander.holupirek(a)uni-konstanz.de, cg(a)basex.org, ms(a)basex.org *I am trying to run this xquery script using base-x gui. But i am getting this error as show by gui* *"Undefined Schema name Q{**http://www.xbrl.org/2003/instance <http://www.xbrl.org/2003/instance>**}item" by schema-element(xbrli:item) function.* *Please help me out.* *declare namespace xfi = "http://www.xbrl.org/2008/function/instance <http://www.xbrl.org/2008/function/instance>";* *declare namespace xbrli="http://www.xbrl.org/2003/instance <http://www.xbrl.org/2003/instance>";* *declare function xfi:test($a as schema-element(xbrli:item)) { let $b := 1 return $a};let $context :=//*return //*/xfi:test(.)* Ankit Kumar

1 0