- BaseX-Talk - mailman.uni-konstanz.de

strange behaviour of the BaseXgui-editor
by Rob Stapper 14 Dec '13

14 Dec '13

Hi, I encountered a few (3) problems with the BasexGui-editor. I use the 7.8 beta release but the issue's also occur in previous versions. Problem 1: this is a minor problem but maybe related to problem 2 which is ( for me) a major problem: If I open two ( small) packages of which one has no errors and one has errors then the errorstatus-message at the bottom of the editor doesn't synchronize correctly when switching files. If I switch from the incorrect packagefile to the correct packagefile the errormessage doesn't refresh to 'ok' until I edit this file. Even after closing an activated incorrect packagefile the errormessage stays active. Clicking on the message even reopens the incorrect packagefile. Switching the focus from the correct packagefile to the incorrect packagefile however, doesn't show this behavior. In that case the errorstatus-message changes to the appropriate errormessage of the incorrect file. Problem 2: which is a major problem when working with big files ( 80 kB) I found that when editing a large(r) packagefile the Basexgui-editor doesn't recognize errors that occur after a certain point in the file. If errors occur after this point the errorstatus-message shows 'ok' but I know that the file contains errors and if I try to install the file as a package I get an window with the message below. If the error occurs before that certain point then I get an correct errormessage. However if I delete the code which contains the error the error-message remains. Clicking on the message brings the cursor to the point where the deleted code with the error used to be, even after saving and closing the file. Errormessage ============================================================================ ============================================== Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.8 beta Java: Oracle Corporation, 1.7.0_45 OS: Windows Vista, x86 Stack Trace: java.lang.NullPointerException at org.basex.query.func.StaticFuncs.check(StaticFuncs.java:121) at org.basex.query.QueryParser.finish(QueryParser.java:312) at org.basex.query.QueryParser.parseLibrary(QueryParser.java:253) at org.basex.query.QueryContext.parseLibrary(QueryContext.java:197) at org.basex.query.util.pkg.RepoManager.installXQ(RepoManager.java:230) at org.basex.query.util.pkg.RepoManager.install(RepoManager.java:70) at org.basex.core.cmd.RepoInstall.run(RepoInstall.java:37) at org.basex.core.Command.run(Command.java:344) at org.basex.core.Command.exec(Command.java:320) at org.basex.core.Command.execute(Command.java:77) at org.basex.core.Command.execute(Command.java:89) at org.basex.gui.dialog.DialogProgress$1.run(DialogProgress.java:178) ============================================================================ ============================================== Being a responsible Basex-user I does what it says and give you some feedback J Problem 3: This is an old issue that I addressed e few months ago but which you could not reproduce. I found a new clue which might help you solving this issue. The issue was when working in fullscreen mode (F11) in the BasexGUI and then saving a file with 'save as .' The save-messagebox gets the focus but disappears behind fullscreen basexgui-window. This has something to do with using a dual monitorsystem. On a single monitor system it works ok: The save-box is placed on top of the fullscreen Basexgui-window and gets the focus. On a dualmonitorsystem the save-box is placed behind the fullscreen Basexgui-window and gets the focus. I hope this insight helps you tackle this minor issue. Well, that's all folk. I hope you can solve the editor-problem soon because I have a really hard time debugging my (large(r)) programs. Regards, Rob Stapper

2 4

Xquery for multiple files
by Mansour Al Akeel 14 Dec '13

14 Dec '13

Hello all, I am not sure if this can be done in XQuery, and if BaseX makes it possible, but I am trying to query all the files under a directory. This directory is copied through webdav. For example, I need to get all the files that have root <article>. Searching for how to do this, I came across this post, that shows how to do something similar with marklogic http://stackoverflow.com/questions/19243253/search-and-load-all-xml-files-i… How to do this in BaseX if possible ?? Thank you.

2 2

Is there a better way to do develop or test with c/s mode server?
by easy 13 Dec '13

13 Dec '13

Hi, all I found the Gui can only work with local mode, but I want do some xquery test / sandbox with basex server, only found can do in client mode, Is there some other way ?esp for restful web mode. thanks -- 此致 easy 莫愁前路无知己，天下谁人不识君。

3 2

fn:doc("c:/...")
by Hans-Juergen Rennau 13 Dec '13

13 Dec '13

Dear BaseX team, I'm a little confused by the behavior of the fn:doc function: doc('/c:/projects/foo.xml') yields this error msg: [FODC0002] Line 1: No text allowed before root element. Whereas these work: doc('c:/projects/foo.xml') doc('file://c:/projects/foo.xml') Is this a bug or a feature? At any rate the error msg is confusing. I've used the latest snapshot (20131211.173706). Kind regards, Hans-Juergen

2 1

basex retrieve command
by Kamineni, Rajeshwar 13 Dec '13

13 Dec '13

Hi I have a document added using the ADD command. How do I just view it without an XQUERY. I thought RETRIEVE command should work but doesn’t help. Are there any other ways?? Thanks Raj Kamineni [T] +1 571 434 5463 [M] +1 703 342 9358

2 1

Re: [basex-talk] Local variables holding retrieved data from BaseX
by Christian Grün 12 Dec '13

12 Dec '13

Hi Teena (cc @basex-talk), first of all, thanks for giving us details on your data and queries. To complete this: do you have a complete version of your query that shows us what are the values of $context, $project and $scopeName? As an example, I’m wondering what are the ancestor nodes of the <scopes> elements. > declare function foo:get-node-v1($context as element()?, $project as > element()?, $scopeName as xs:string) as element()? { > if (exists($project) = true()) then ( > $project/scopes/scope[@name=$scopeName]/item > ) > else () > }; The following query is equivalent, by the way (this is the beauty of XPath): declare function foo:get-node-v1($context as element()?, $project as element()?, $scopeName as xs:string) as element()? { { $project/scopes/scope[@name=$scopeName]/item }; If all your data is stored in the same database, it may be faster to open the database within the function. One more optimization could be to directly access the text index: declare function foo:get-node-v1($context as element()?, $project as element()?, $scopeName as xs:string) as element()? { { db:attribute("name-of-your-db", $scopeName, "name")/parent::scope }; You could also check out the latest stable snapshot of BaseX 7.8 [1], which inlines functions and may thus do this automatically. > When we call the first function in another > function and use it for further computation, it is always slower by 40 > seconds (when compared to second variation of the function). > What could be causing this? Difficult to say; we probably need to see your complete function call. > Are we still referencing to baseX document when > we do following instead of getting a local copy? > let $items := foo:get-node-v1($context, $project, $scopeName) Yes, the returned nodes still reference nodes in the database. Hope this helps, Christian [1] http://files.basex.org/releases/latest/

2 3

Throughput Issues
by Jeremy Moseley 12 Dec '13

12 Dec '13

Hi Guys, I am attempting to diagnose some throughput issues we are having with BaseX, and I was hoping to get some input on a couple of thread blocking issues I am noticing. Please see the Gist ( https://gist.github.com/jerezzprime/7901172) containing the thread dumps for reference. These thread dumps were generated while BaseX was handling a large number of requests produced using Apache Benchmark. All requests were being made against the same URL and the thread dumps were gathered over a 30 second period. The most common place for threads to be blocking is at org.basex.io.random.TableDiskAccess.read*. The threads are waiting for other threads to finish, since these method calls are synchronized. Is it possible to concurrently read from disk? Another place threads appear to be blocking is while waiting for the lock to call org.basex.http.RestXqModules.cache (another synchronized method). It seems like this should only be called once to parse the modules, and then all requests afterwards should be retrieved from the cache, but from the thread dumps it appears threads are still re-parsing the xquery modules. Is this expected behavior? Thanks, Jeremy

2 6

Fwd: Client Side transactions
by Charles Foster 12 Dec '13

12 Dec '13

For the purposes of the list. Begin forwarded message: > From: Charles Foster > Subject: Re: Client Side transactions > Date: 12 December 2013 20:47:36 GMT > To: rajeshwar.kamineni(a)neustar.biz > > Hi Raj, > > BaseX doesn't support client side transactions, but does support ACID transactions within the context of 1 query, i.e. all updates / inserts / deletes within the context of one query will either succeed or fail [1]. > > To update a document in place, you can always use XQuery Update Facility [2], or you could overwrite the document by re-inserting it with BaseX XQJ. > > In BaseX XQJ 1.2.x, performing an insert with a URI which already exists in the Database will create duplicate fragments (not good), so you would have to delete the previous document first prior to inserting. As of BaseX XQJ 1.3.x which is scheduled to be released soon, you won't need to worry about any of that. > > Just to help you along, the source code for the XQJ2 interfaces can be found here: > > https://github.com/cfoster/xqj2/ > > Which includes the insertItem [3] method. > > Kind Regards, > > Charles > > [1] http://docs.basex.org/wiki/Transaction_Management > [2] http://docs.basex.org/wiki/XQuery_Update > [3] https://github.com/cfoster/xqj2/blob/master/src/main/java/com/xqj2/XQConnec… > > > > On 12 Dec 2013, at 20:10, rajeshwar.kamineni(a)neustar.biz wrote: > >> Raj Kamineni: >> >> Hi >> >> When using setAutoCommit(false) on a connection, >> I got Client Side transactions are not supported. >> >> Any suggestions on alternative ways? >> >> Also, I am looking for a way to update the entire document in basex using XQJ >> >> xqc = baseXRepository.getConnection(); >> XQItem item = xqc.createItemFromDocument(policyDoc,null,null); >> xqc.insertItem(policy.getPolicyId(),item, null); >> >> How do I go about updating when I inserted a document using the above code. >> >> Thanks >> Raj >> >

1 0

ConnectionPoolXQDataSource
by Charles Foster 12 Dec '13

12 Dec '13

For the purposes of the list. Begin forwarded message: > From: Charles Foster > Subject: Re: ConnectionPoolXQDataSource > Date: 12 December 2013 20:41:44 GMT > To: rajeshwar.kamineni(a)neustar.biz > > Hi Raj, > > There is the class: > > net.xqj.basex.BaseXConnectionPoolXQDataSource > > Which is an implementation of ConnectionPoolXQDataSource [1]. > > However, as far as I'm aware. No Connection Pool Manager yet exists for XQJ. So you would have to write your own. If you were to write your own, then using instances of ConnectionPoolXQDataSource is definitely the way to go. > > I plan to write an XQJ Connection Pool Manager at some point in the future, but it won't be free. If you know of someone who is willing to pay the development of an XQJ Connection Pooler Mechanism, then I'm up for making this a priority of other pieces of work I've got on. > > BaseX supports ACID transactions within the context of a single running XQuery, but doesn't support client transactions. > > Both Sedna and MarkLogic do support client transactions though. > > To find out if an XQJ implementation supports client side transactions, amongst other things, you can inspect at its XQMetaData [2], specifically the "boolean isTransactionSupported()" method. > > Kind Regards, > > Charles > > [1] http://xqj.net/javadoc/javax/xml/xquery/ConnectionPoolXQDataSource.html > [2] http://xqj.net/javadoc/javax/xml/xquery/XQMetaData.html > > On 12 Dec 2013, at 17:29, rajeshwar.kamineni(a)neustar.biz wrote: > >> Raj Kamineni: >> >> Just wondering if there is an implementation of this ConnectionPoolXQDataSource for baseX. >> >> I have background in the JDBC SQL so I am thinking in terms of connection pool to database. >> >> Also, I got an error: Client side transaction are not supported. Is it the baseX that doesn't support it or is it the xqj driver that is unable to handle it now.. >> >> thanks >> Raj >> Sr. Architect >> Neustar. >> >

1 0

basex errors
by Kamineni, Rajeshwar 12 Dec '13

12 Dec '13

I am running basexhttp in service mode. At the same time I was using base client to add/delete some documents. I got this error suddenly. >add /root/policy_testdata/policy_template_6.xml Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Oracle Corporation, 1.7.0_40 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 3 at org.basex.io.random.TableDiskAccess.flush(TableDiskAccess.java:124) at org.basex.data.DiskData.finishUpdate(DiskData.java:212) at org.basex.core.cmd.Add.run(Add.java:109) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.ClientListener.run(ClientListener.java:145) Then I got this when I exited the basexclient >open neuhub_pdp_store Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Oracle Corporation, 1.7.0_40 OS: Linux, amd64 Stack Trace: java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(FileLockTable.java:255) at sun.nio.ch.SharedFileLockTable.add(FileLockTable.java:152) at sun.nio.ch.FileChannelImpl.tryLock(FileChannelImpl.java:1056) at org.basex.io.random.TableDiskAccess.lck(TableDiskAccess.java:183) at org.basex.io.random.TableDiskAccess.sharedLock(TableDiskAccess.java:170) at org.basex.io.random.TableDiskAccess.<init>(TableDiskAccess.java:83) at org.basex.data.DiskData.init(DiskData.java:122) at org.basex.data.DiskData.<init>(DiskData.java:92) at org.basex.core.cmd.Open.open(Open.java:68) at org.basex.core.cmd.Open.run(Open.java:35) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.ClientListener.run(ClientListener.java:145) Then I stopped the server OPTIMIZE Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Oracle Corporation, 1.7.0_40 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - #used blocks: 0 - #total locks: 0 - access: -1 (0 > -1] at org.basex.util.Util.notexpected(Util.java:53) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:488) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:189) at org.basex.data.Data.kind(Data.java:282) at org.basex.index.resource.Docs.docs(Docs.java:87) at org.basex.index.resource.Docs.init(Docs.java:75) at org.basex.index.resource.Resources.init(Resources.java:64) at org.basex.core.cmd.Optimize.optimize(Optimize.java:80) at org.basex.core.cmd.Optimize.run(Optimize.java:42) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.ClientListener.run(ClientListener.java:145) > INSPECT Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Oracle Corporation, 1.7.0_40 OS: Linux, amd64 Stack Trace: java.lang.RuntimeException: Data Access out of bounds: - pre value: 0 - #used blocks: 0 - #total locks: 0 - access: -1 (0 > -1] at org.basex.util.Util.notexpected(Util.java:53) at org.basex.io.random.TableDiskAccess.cursor(TableDiskAccess.java:488) at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:189) at org.basex.data.Data.kind(Data.java:282) at org.basex.core.cmd.Inspect.inspect(Inspect.java:50) at org.basex.core.cmd.Inspect.run(Inspect.java:27) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.server.ClientListener.run(ClientListener.java:145) Thanks Raj Kamineni [T] +1 571 434 5463 [M] +1 703 342 9358

2 9