- BaseX-Talk - mailman.uni-konstanz.de

Looks like...
by Scoobbs 21 Aug '15

21 Aug '15

*Looks like no one cares much for Ubuntu. I have version 7.7.2 installed, through the Ubuntu Software Center. It was just a matter of cliking here and there(actually no more than two clicks) and there I was. It even looks like BaseX realy works!!!Well, now that I have decided to try to use it, there came a message saying a new version is available, namely 8.2.3.Alright, I agreed I should update it. But then I was taken to a site where something should be downloaded, in order for the installation to happen. A 'file' or 'container' with a .jar extension should be it, I thought. But, then again, there seemed to be no executable(or, easily executable) file/module/app, whatever, was found. So I concluded I am not as clever as most of the people building BaseX are. And, I ask:- Why is there not an actually easy way to install the application? - Is it so damn hard to build a thing like that? - Why is it so simple to implement applications included in the cited Ubuntu Software Center, for simple minded people like me, who can use effective tools like BaseX seems to be but are not capable of understanding(much less to use, and retain in memory, tens of cryptic commands?Anyway, my intent is actually to ask someone(some good soul?) to update the Software Center so that one( I suppose many...) can fast-and-dirtly(sorry... this is just a way to show my frustration) use the tool.Thanks for any attention given to this request. And, if someone does anything like what I asked above, please just tell me where and what I must do. No need for replies nor attempts to teach me how to do it(I inclusively think maybe it is not that difficult to do as it is today, once one knows how to, but I am actually too old to learn new tricks...).Cordially, Scoobbs(who just thought he could build a simple database containing names, addresses, etc. about friends and family...)**=====================================================================================================PS: ** well, maybe, with some links to other variable attibutes of persons, like, courses attended, graduation data etc. etc.)*

2 1

Same XQuery faster 2nd+ time
by Philipp Steiner 21 Aug '15

21 Aug '15

Hi, i'm a student learning XPath/XQuery/BaseX and currently experiment with XQueries on large xml files in BaseX, hope i didn't miss something obvious :) Test: 1st FLOWR query on collection: ~700ms 2nd+ identical query same collection: just ~200ms ! ? My XML-files are OPTIMIZE'd on import, but the created indexes would influence the 1st query already. This is a great speed bump, but hard on tests that assume a first query on a recently imported new collection. So i wondered how this behavior could be explained & maybe turned off for testing purposes? Cheers, Philipp

2 2

basexserver start
by cmarchand＠oxiane.com 21 Aug '15

21 Aug '15

Hello, I want to monitor garbage collect on basex server. So, I've modified basexserver as this : BASEX_JVM="-Xmx6144m $BASEX_JVM -Xloggc:/home/basex/logs/79/azul/gc.log.$(date -u +%Y-%m-%d-%H-%M) \ -verbose:gc \ -XX:+PrintGCDateStamps \ -XX:+PrintGCDetails \ -XX:+PrintGCApplicationStoppedTime -javaagent:/usr/local/jHiccup/jHiccup.jar=-d,5000,-i,1000,-s,3,-l,/home/basex/logs/79/azul/hiccuplog,-c" # Run code java -cp "$CP" $BASEX_JVM "${vm_args[@]}" org.basex.BaseXServer "${general_args[@]}" The problem is I have only 2 seconds of monitoring. Does BaseXServer is a starter for another JVM ? How can I activate GC log on basex server ? Thanks in advance, Christophe

2 2

HTML 5 doctype in BaseX 8.2.1
by Wiemer, Sebastian 20 Aug '15

20 Aug '15

2 1

Performance and heavy load
by Martín Ferrari 20 Aug '15

20 Aug '15

Hi guys, I'm quite new to BaseX. I've read a bit already, but perhaps you can help so I can investigate further. We are having a performance problem with our BaseX server. We're running it on a VM, and hitting it from around 5 web servers. Under no stress, I get this timing from the log for a 1191 bytes file. 00:01:23.526 ww.aa.yy.xx:56312 admin REQUEST [PUT] http://basex.xxxxxx:8984/rest/PaymentLogs_1/WRP.BR-4273791-1_PaymentGateway… ww.aa.yy.xx:56312 admin 201 1 resource(s) replaced in 1401.17 ms. 1441.24 ms A call to /rest takes about 4-5 ms (it's called around once each 2 seconds, though it's not needed): 00:01:23.520 ww.aa.yy.zz:56312 admin REQUEST [GET] http://basex.xxxxxxxx:8984/rest00:01:23.524 ww.aa.yy.xx:56312 admin 200 4.67 ms Is the 1400 ms time normal for storing one xml file less than 2kb (storing a 10kb file took 1200 ms, so I'm not sure size mattered that much)? And also, when the load starts to get heavier, from 7 to 12 files per second, BaseX server quickly starts to get slower, then taking minutes to respond, until finally it starts giving errors about the database being currently opened by another process, and too many open files. Many connections remain in the CLOSE_WAIT state, and the server is no longer usable. Is it reasonable to expect to [PUT] more than 10 files per second, some of them taking more than 10kb? We're using it for logging, so that's a lot of xml files. If it's reasonable to use it that way, I'll dig more into optimizing it. Is anyone using it in a similar way? Thanks, Martín.

5 13

Re: [basex-talk] Converting to UTF-8 in SQL module
by Lizzi, Vincent 17 Aug '15

17 Aug '15

Thanks for sharing your solution! Vincent From: Tim Thompson [mailto:timathom@gmail.com] Sent: Monday, August 17, 2015 5:00 PM To: Lizzi, Vincent <Vincent.Lizzi(a)taylorandfrancis.com> Subject: Re: [basex-talk] Converting to UTF-8 in SQL module Thanks, Christian, Vincent. Following Christian's suggestion, I used the RAWTOHEX() function in my SQL query, then cast it to an xs:hexBinary and applied BaseX's convert:binary-to-string(). Seems to work perfectly. --Tim -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library On Mon, Aug 17, 2015 at 4:48 PM, Lizzi, Vincent <Vincent.Lizzi(a)taylorandfrancis.com<mailto:Vincent.Lizzi@taylorandfrancis.com>> wrote: Hi Tim, Oracle should able to convert its output to Unicode before returning query results to the client (BaseX). Are you using Oracle's JDBC driver? It might be helpful to look into Oracle's NLS_LANG setting or the 'convert' function. Vincent -----Original Message----- From: basex-talk-bounces(a)mailman.uni-konstanz.de<mailto:basex-talk-bounces@mailman.uni-konstanz.de> [mailto:basex-talk-bounces@mailman.uni-konstanz.de<mailto:basex-talk-bounces@mailman.uni-konstanz.de>] On Behalf Of Christian Grün Sent: Monday, August 17, 2015 3:23 PM To: Tim Thompson <timathom(a)gmail.com<mailto:timathom@gmail.com>> Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: Re: [basex-talk] Converting to UTF-8 in SQL module Hi Tim, > I am using the BaseX SQL module to query the Oracle database of a > library catalog. Its character data is encoded as ISO 2709 (MARC-8)[1] > and is stored in Oracle as US7ASCII. > > The data contains diacritics with combining characters like this: > http://www.fileformat.info/info/unicode/char/0301/index.htm I don't know enough about the encodings of Oracle, but "US7ASCII" sounds to me as if only 7 bits are used for each character. Do you know how non-ASCII characters, such as combining characters, are stored in that format? Maybe convert:string-to-hex and convert:binary-to-string [1] could be used to convert the result to the correct encoding. Basically, all we do in BaseX is using standard JDBC functionality [2]. If there is an easy way to fix the issue with JDBC, it should be easy to also get it working in XQuery. Christian [1] http://docs.basex.org/wiki/Conversion_Module [2] https://github.com/BaseXdb/basex/blob/master/basex-core/src/main/java/org/b…

2 1

Converting to UTF-8 in SQL module
by Tim Thompson 17 Aug '15

17 Aug '15

Hello, I am using the BaseX SQL module to query the Oracle database of a library catalog. Its character data is encoded as ISO 2709 (MARC-8)[1] and is stored in Oracle as US7ASCII. The data contains diacritics with combining characters like this: http://www.fileformat.info/info/unicode/char/0301/index.htm When I run the query in BaseX, all characters with combining accents are output as something like Ì Has anyone had experience handling this kind of encoding issue in BaseX, or does anyone have any solutions/approaches to recommend as a way to convert this data to UTF-8? Thanks in advance, Tim [1] https://en.wikipedia.org/wiki/ISO_2709 [2] http://www.fileformat.info/info/unicode/char/00e8/index.htm -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library <tat2(a)princeton.edu>

2 1

Concurrency Issue while loading documents.
by ankit kumar 17 Aug '15

17 Aug '15

Hi, We are adding number of documents concurrently to the Basex database using basex java api. Our application runs three threads in which each thread is adding documents to it by executing following instructions in java as given below. new Add("",new File(source).getAbsolutePath()).execute(context); while running our application sometimes throws the following error Java: Oracle Corporation, 1.7.0_71 OS: Windows 7, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 8 at org.basex.util.hash.TokenSet.index(TokenSet.java:161) at org.basex.util.hash.TokenSet.put(TokenSet.java:97) at org.basex.data.Namespaces.open(Namespaces.java:319) at org.basex.data.NSScope.open(NSScope.java:72) at org.basex.data.Data.insert(Data.java:775) at org.basex.query.up.atomic.Insert.apply(Insert.java:44) at org.basex.query.up.atomic.AtomicUpdateCache.applyUpdates(AtomicUpdateCache.java:297) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:281) at org.basex.core.cmd.Add.run(Add.java:66) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.core.Command.execute(Command.java:123) at com.myapp.MyDataBase.addSource(MyDataBase.java:85) at com.myapp.ProcessorLoader$1.run(ProcessorLoader.java:132) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) thanks, Anky

2 2

Resolving includes
by cmarchand＠oxiane.com 17 Aug '15

17 Aug '15

Hi, back to my questions on resolving modules includes. I want to produce a .XQ file that includes all the code contained in imported modules (via import module clause). My purpose is to produce a maven plugin to do this. I think such a code already exists in basex, and I would like to reuse it. Any entry-point will be much appreciated. Thanks in advance, Christophe

2 4

Trouble with wildcard lookup operator on maps?
by Marc van Grootel 15 Aug '15

15 Aug '15

Hi, Unless I'm not reading the spec[1] correctly then the following two snippets should have the same result: Example 1: let $map := map { 'a': (1,2,3), 'b': (4,5,6)} for $k in map:keys($map) return array { $map($k) } Example 2: let $map := map { 'a': (1,2,3), 'b': (4,5,6)} for $k in $map?* return array { $k } However, this is not the case. The first outputs, as I expected: ([1,2,3], [4,5,6]) The second, counter intuitively returns (on 8.2.3) this: ([1],[2],[3],[4],[5],[6]) The spec indicates that both examples result should be identical. Didn't check if the same is going on with arrays. Hmmm? [1] http://www.w3.org/TR/xquery-31/#id-lookup

2 2