- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Multiple db:replace() = slower updates with 7.8
by Christian Grün 04 Apr '14

04 Apr '14

Hi France, our latest release includes the fix for the slow-downs you encountered. Best, Christian On Wed, Apr 2, 2014 at 10:29 PM, France Baril <france.baril(a)architextus.com> wrote: > Performance is definitely back. This is great. The big drawback is that Java > 7 will only work with 64 bits applications on Mac OS and Antenna House that > we use for PDF in xquery through the java API only run on 32 bits on Mac OS > X. > > Anyhow, the end-client runs a Windows shop, so we'll manage. > > Big thanks! > > > On Wed, Apr 2, 2014 at 2:56 PM, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> > I can't think of any issue. I was looking in the documentation. Might be >> > interesting to add a note somewhere about Java 7 :-). >> > >> > Thanks! >> >> Yes, this will definitely be documented soon ;) >> >> >> > >> > >> > On Wed, Apr 2, 2014 at 2:47 PM, Christian Grün >> > <christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> > Does Basex 8 use Java 7? >> >> >> >> Exactly. As Java 6 is not supported by Oracle anymore, and as we >> >> didn't get much votes against this consideration one year ago [1], we >> >> felt that it's finally time to switch. Beside that, Java 7 gives us >> >> much better native OS support for handling files on disk. This is why >> >> the BaseX 7.8.x versions will be the last that will be based on Java >> >> 6. >> >> >> >> Do you think you'll encounter problems migrating to Java 7? >> >> >> >> Christian >> >> >> >> [1] >> >> >> >> https://mailman.uni-konstanz.de/pipermail/basex-talk/2013-February/004724.h… >> >> >> >> >> >> >> >> > On Wed, Apr 2, 2014 at 2:31 PM, Christian Grün >> >> > <christian.gruen(a)gmail.com> >> >> > wrote: >> >> >> >> >> >> > basexhttp returns an error and logs out: >> >> >> >> >> >> Are you using Java 7? >> >> >> >> >> >> >> >> >> > >> >> >> > NoName:~ archie$ /Applications/basex/bin/basexhttp ; exit; >> >> >> > >> >> >> > Exception in thread "main" java.lang.UnsupportedClassVersionError: >> >> >> > org/basex/BaseXHTTP : Unsupported major.minor version 51.0 >> >> >> > >> >> >> > at java.lang.ClassLoader.defineClass1(Native Method) >> >> >> > >> >> >> > at java.lang.ClassLoader.defineClassCond(ClassLoader.java:637) >> >> >> > >> >> >> > at java.lang.ClassLoader.defineClass(ClassLoader.java:621) >> >> >> > >> >> >> > at >> >> >> > >> >> >> > >> >> >> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:141) >> >> >> > >> >> >> > at java.net.URLClassLoader.defineClass(URLClassLoader.java:283) >> >> >> > >> >> >> > at java.net.URLClassLoader.access$000(URLClassLoader.java:58) >> >> >> > >> >> >> > at java.net.URLClassLoader$1.run(URLClassLoader.java:197) >> >> >> > >> >> >> > at java.security.AccessController.doPrivileged(Native Method) >> >> >> > >> >> >> > at java.net.URLClassLoader.findClass(URLClassLoader.java:190) >> >> >> > >> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:306) >> >> >> > >> >> >> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) >> >> >> > >> >> >> > at java.lang.ClassLoader.loadClass(ClassLoader.java:247) >> >> >> > >> >> >> > logout >> >> >> > >> >> >> > >> >> >> > [Process completed] >> >> >> > >> >> >> > >> >> >> > >> >> >> > On Wed, Apr 2, 2014 at 1:49 PM, France Baril >> >> >> > <france.baril(a)architextus.com> >> >> >> > wrote: >> >> >> >> >> >> >> >> Timing is good, I should be able to try the new snapshot today. >> >> >> >> >> >> >> >> >> >> >> >> On Wed, Apr 2, 2014 at 12:55 PM, Christian Grün >> >> >> >> <christian.gruen(a)gmail.com> wrote: >> >> >> >>> >> >> >> >>> Hi France, >> >> >> >>> >> >> >> >>> we are also working towards some important commercial deadlines, >> >> >> >>> which >> >> >> >>> is why our mailing list feedback takes more time than expected >> >> >> >>> (open >> >> >> >>> source life would be so comfortable without financial pressure.. >> >> >> >>> ;). >> >> >> >>> However, I have now uploaded a new 8.0 snapshot [1], and I would >> >> >> >>> be >> >> >> >>> glad to get your feedback if it fixes the problems you >> >> >> >>> encountered. >> >> >> >>> You may as well think about exporting and reimporting your >> >> >> >>> database >> >> >> >>> (or applying OPTIMIZE ALL on it), as we have also minimized the >> >> >> >>> storage of redundant namespaces in the latest version. >> >> >> >>> >> >> >> >>> Looking forward to your response, >> >> >> >>> Christian >> >> >> >>> >> >> >> >>> [1] http://files.basex.org/releases/latest/ >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> On Wed, Apr 2, 2014 at 6:25 PM, France Baril >> >> >> >>> <france.baril(a)architextus.com> wrote: >> >> >> >>> > Ok, thanks for the update. >> >> >> >>> > >> >> >> >>> > We are dependent on this to make the next release to our >> >> >> >>> > production >> >> >> >>> > server, >> >> >> >>> > so if you have an idea on timing, it would really help us >> >> >> >>> > adapt. >> >> >> >>> > >> >> >> >>> > France >> >> >> >>> > >> >> >> >>> > >> >> >> >>> > On Tue, Apr 1, 2014 at 11:43 AM, Christian Grün >> >> >> >>> > <christian.gruen(a)gmail.com> >> >> >> >>> > wrote: >> >> >> >>> >> >> >> >> >>> >> Hi France, >> >> >> >>> >> >> >> >> >>> >> sorry for lettting you wait. We've already solved part of the >> >> >> >>> >> problem, >> >> >> >>> >> but we would first like to shed some more light on another >> >> >> >>> >> related >> >> >> >>> >> issue before relasing a new patch version. >> >> >> >>> >> >> >> >> >>> >> Christian >> >> >> >>> >> ____________________________________ >> >> >> >>> >> >> >> >> >>> >> On Tue, Apr 1, 2014 at 5:26 PM, France Baril >> >> >> >>> >> <france.baril(a)architextus.com> wrote: >> >> >> >>> >> > Any news on this issue? >> >> >> >>> >> > >> >> >> >>> >> > >> >> >> >>> >> > On Tue, Mar 25, 2014 at 2:30 PM, France Baril >> >> >> >>> >> > <france.baril(a)architextus.com> >> >> >> >>> >> > wrote: >> >> >> >>> >> >> >> >> >> >>> >> >> Yes, we do use namespaces. >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> On Tue, Mar 25, 2014 at 2:29 PM, Christian Grün >> >> >> >>> >> >> <christian.gruen(a)gmail.com> wrote: >> >> >> >>> >> >>> >> >> >> >>> >> >>> We may have found a first evidence for the slow down. Do >> >> >> >>> >> >>> your >> >> >> >>> >> >>> documents use namespaces? >> >> >> >>> >> >>> >> >> >> >>> >> >>> >> >> >> >>> >> >>> On Tue, Mar 25, 2014 at 2:41 PM, Christian Grün >> >> >> >>> >> >>> <christian.gruen(a)gmail.com> wrote: >> >> >> >>> >> >>> > Hi France, >> >> >> >>> >> >>> > >> >> >> >>> >> >>> > sorry, I know that an answer to your e-mail is still >> >> >> >>> >> >>> > pending. >> >> >> >>> >> >>> > If >> >> >> >>> >> >>> > you >> >> >> >>> >> >>> > should manage to build a self-contained example, it >> >> >> >>> >> >>> > could >> >> >> >>> >> >>> > help >> >> >> >>> >> >>> > us to >> >> >> >>> >> >>> > find the culprit. >> >> >> >>> >> >>> > >> >> >> >>> >> >>> > Best, >> >> >> >>> >> >>> > Christian >> >> >> >>> >> >>> > >> >> >> >>> >> >>> > >> >> >> >>> >> >>> > On Wed, Mar 19, 2014 at 6:59 PM, France Baril >> >> >> >>> >> >>> > <france.baril(a)architextus.com> wrote: >> >> >> >>> >> >>> >> Hi, >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> We run batch processes on our files in order to send >> >> >> >>> >> >>> >> them >> >> >> >>> >> >>> >> out >> >> >> >>> >> >>> >> to >> >> >> >>> >> >>> >> translation >> >> >> >>> >> >>> >> in xliff format (xml format for translations). >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> I run a piece of code that: >> >> >> >>> >> >>> >> 1. applies transformations >> >> >> >>> >> >>> >> 2. file:writes the resulting files (for debug >> >> >> >>> >> >>> >> purposes) >> >> >> >>> >> >>> >> 3. and then db:replaces the resulting files. >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> If I send 5 files into the process, it takes a few >> >> >> >>> >> >>> >> seconds >> >> >> >>> >> >>> >> before >> >> >> >>> >> >>> >> the >> >> >> >>> >> >>> >> files >> >> >> >>> >> >>> >> appear on the file system. Yet full process with the >> >> >> >>> >> >>> >> db:replace >> >> >> >>> >> >>> >> takes >> >> >> >>> >> >>> >> 2 >> >> >> >>> >> >>> >> minutes to complete. >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> When I send 60 files... the process never ends. All >> >> >> >>> >> >>> >> files >> >> >> >>> >> >>> >> are >> >> >> >>> >> >>> >> available on >> >> >> >>> >> >>> >> the file system and are valid, which means I am fairly >> >> >> >>> >> >>> >> certain >> >> >> >>> >> >>> >> that >> >> >> >>> >> >>> >> the >> >> >> >>> >> >>> >> freeze doesn't occur because of an error in one of the >> >> >> >>> >> >>> >> files. >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> There is no error message in the terminal window. Is >> >> >> >>> >> >>> >> possible >> >> >> >>> >> >>> >> that >> >> >> >>> >> >>> >> something >> >> >> >>> >> >>> >> was changed after 7.7 that would affect performance? >> >> >> >>> >> >>> >> On >> >> >> >>> >> >>> >> our >> >> >> >>> >> >>> >> production >> >> >> >>> >> >>> >> server, which is on 7.7 we can run 100+ files in just >> >> >> >>> >> >>> >> a >> >> >> >>> >> >>> >> few >> >> >> >>> >> >>> >> minutes. >> >> >> >>> >> >>> >> Maybe >> >> >> >>> >> >>> >> there are new server settings that we missed? >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> For reference, here is the code. I understand that >> >> >> >>> >> >>> >> updates >> >> >> >>> >> >>> >> are >> >> >> >>> >> >>> >> all >> >> >> >>> >> >>> >> performed >> >> >> >>> >> >>> >> at the end of the process, which is why we get the >> >> >> >>> >> >>> >> debug >> >> >> >>> >> >>> >> files >> >> >> >>> >> >>> >> first, >> >> >> >>> >> >>> >> but >> >> >> >>> >> >>> >> the lag time between the time where we get all files >> >> >> >>> >> >>> >> on >> >> >> >>> >> >>> >> the >> >> >> >>> >> >>> >> file >> >> >> >>> >> >>> >> system and >> >> >> >>> >> >>> >> the db:replace seems huge. >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> declare updating function >> >> >> >>> >> >>> >> translation:transform-to-xliff($menu-id >> >> >> >>> >> >>> >> as >> >> >> >>> >> >>> >> xs:string, $lang as xs:string*, $package-number as >> >> >> >>> >> >>> >> xs:string){ >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> let $menu := menu:xml-get-menu($menu-id, 'en-us') >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> (: Need to translate menu and its topics without >> >> >> >>> >> >>> >> getting >> >> >> >>> >> >>> >> duplicated >> >> >> >>> >> >>> >> topics twice:) >> >> >> >>> >> >>> >> (: Always send the reusable strings from writers >> >> >> >>> >> >>> >> and >> >> >> >>> >> >>> >> from >> >> >> >>> >> >>> >> dev... >> >> >> >>> >> >>> >> doesn't >> >> >> >>> >> >>> >> cost anything if no new string anyway :) >> >> >> >>> >> >>> >> let $file-ids := ($menu-id, for $id in >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> distinct-values($menu/descendant::*[name()='topicref']/data(@id-ref))[1] >> >> >> >>> >> >>> >> return $id, >> >> >> >>> >> >>> >> 'stringreferences', >> >> >> >>> >> >>> >> 'stringreferencestransform') >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> return (for $file-id in >> >> >> >>> >> >>> >> distinct-values($file-ids) >> >> >> >>> >> >>> >> let $file := >> >> >> >>> >> >>> >> db:open('en-us')/*[@id=$file-id] >> >> >> >>> >> >>> >> let $skl-href := 'skeletons/' || >> >> >> >>> >> >>> >> $package-number >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> '/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> substring-after($file/base-uri(), 'en-us/') >> >> >> >>> >> >>> >> let $file-with-preserve := >> >> >> >>> >> >>> >> copy $copy := $file >> >> >> >>> >> >>> >> modify(if >> >> >> >>> >> >>> >> (exists($copy/@xml:space)) >> >> >> >>> >> >>> >> then () >> >> >> >>> >> >>> >> else insert node attribute >> >> >> >>> >> >>> >> {'xml:space'}{'preserve'} into $copy) >> >> >> >>> >> >>> >> return $copy >> >> >> >>> >> >>> >> let $all-trans-files := >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> xliff-transformer:create-translation-files($file-with-preserve, >> >> >> >>> >> >>> >> $package-number, $menu-id, $lang, $skl-href) >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> let $skeleton := $all-trans-files[1] >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> let $xliffs := for $xliff in >> >> >> >>> >> >>> >> $all-trans-files[position() >> >> >> >>> >> >>> >> != 1] >> >> >> >>> >> >>> >> return $xliff >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> let $debug := >> >> >> >>> >> >>> >> file:write('Debug-xliff/skls/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> tokenize($skl-href, '/')[last()], $skeleton) >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> return (db:replace('Translation-management', >> >> >> >>> >> >>> >> $skl-href, >> >> >> >>> >> >>> >> $skeleton), >> >> >> >>> >> >>> >> for $xliff in $xliffs >> >> >> >>> >> >>> >> let $target-lang := >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> $xliff/descendant::*[name()='file']/data(@target-language) >> >> >> >>> >> >>> >> let $lang-pack-name := >> >> >> >>> >> >>> >> concat($target-lang,'_', >> >> >> >>> >> >>> >> $package-number) >> >> >> >>> >> >>> >> let $file-loc-end := $menu-id || >> >> >> >>> >> >>> >> '/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> $lang-pack-name ||'/' || >> >> >> >>> >> >>> >> substring-after($file/base-uri(), >> >> >> >>> >> >>> >> 'en-us/') >> >> >> >>> >> >>> >> (:let $debug := >> >> >> >>> >> >>> >> file:append('debug-ids.xml', >> >> >> >>> >> >>> >> '
' >> >> >> >>> >> >>> >> || $file-loc-end):) >> >> >> >>> >> >>> >> let $file-loc := if >> >> >> >>> >> >>> >> (exists($xliff/descendant::*[@translate='yes'])) >> >> >> >>> >> >>> >> then >> >> >> >>> >> >>> >> 'xliff-to-translate/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> $file-loc-end >> >> >> >>> >> >>> >> else >> >> >> >>> >> >>> >> 'xliff-no-new-segment/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> $file-loc-end >> >> >> >>> >> >>> >> let $debug := >> >> >> >>> >> >>> >> file:write('Debug-xliff/' >> >> >> >>> >> >>> >> || >> >> >> >>> >> >>> >> tokenize($file-loc, '/')[last()], $xliff) >> >> >> >>> >> >>> >> return >> >> >> >>> >> >>> >> db:replace('Translation-management', >> >> >> >>> >> >>> >> $file-loc, >> >> >> >>> >> >>> >> $xliff) >> >> >> >>> >> >>> >> ) >> >> >> >>> >> >>> >> ) >> >> >> >>> >> >>> >> }; >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> -- >> >> >> >>> >> >>> >> France Baril >> >> >> >>> >> >>> >> Architecte documentaire / Documentation architect >> >> >> >>> >> >>> >> france.baril(a)architextus.com >> >> >> >>> >> >>> >> (514) 572-0341 >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> _______________________________________________ >> >> >> >>> >> >>> >> BaseX-Talk mailing list >> >> >> >>> >> >>> >> BaseX-Talk(a)mailman.uni-konstanz.de >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> >> >> >> >>> >> >>> >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> >> >>> >> >>> >> >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> >> >> >> >>> >> >> -- >> >> >> >>> >> >> France Baril >> >> >> >>> >> >> Architecte documentaire / Documentation architect >> >> >> >>> >> >> france.baril(a)architextus.com >> >> >> >>> >> >> (514) 572-0341 >> >> >> >>> >> > >> >> >> >>> >> > >> >> >> >>> >> > >> >> >> >>> >> > >> >> >> >>> >> > -- >> >> >> >>> >> > France Baril >> >> >> >>> >> > Architecte documentaire / Documentation architect >> >> >> >>> >> > france.baril(a)architextus.com >> >> >> >>> >> > (514) 572-0341 >> >> >> >>> > >> >> >> >>> > >> >> >> >>> > >> >> >> >>> > >> >> >> >>> > -- >> >> >> >>> > France Baril >> >> >> >>> > Architecte documentaire / Documentation architect >> >> >> >>> > france.baril(a)architextus.com >> >> >> >>> > (514) 572-0341 >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> >> -- >> >> >> >> France Baril >> >> >> >> Architecte documentaire / Documentation architect >> >> >> >> france.baril(a)architextus.com >> >> >> >> (514) 572-0341 >> >> >> > >> >> >> > >> >> >> > >> >> >> > >> >> >> > -- >> >> >> > France Baril >> >> >> > Architecte documentaire / Documentation architect >> >> >> > france.baril(a)architextus.com >> >> >> > (514) 572-0341 >> >> > >> >> > >> >> > >> >> > >> >> > -- >> >> > France Baril >> >> > Architecte documentaire / Documentation architect >> >> > france.baril(a)architextus.com >> >> > (514) 572-0341 >> > >> > >> > >> > >> > -- >> > France Baril >> > Architecte documentaire / Documentation architect >> > france.baril(a)architextus.com >> > (514) 572-0341 > > > > > -- > France Baril > Architecte documentaire / Documentation architect > france.baril(a)architextus.com > (514) 572-0341

1 0

Re: [basex-talk] Is there a C++ Implementation
by Maximilian Gärber 04 Apr '14

04 Apr '14

Hi, there is a .NET version called nxdb. I converted the jars using IKVM some time ago myself and it run just fine. Also, since it is BSD licensed, one could use Excelsior JET to generate native code. If you just want a processor (not a xmldb) you could try Zorba XQuery as well, that is C++ Regards, Max 2014-04-04 6:49 GMT+02:00 Alex Taylor <support(a)novixys.com>: > Hi > > This software BaseX is excellent. Really good at processing large files. > > I would like to know if there is a C++ implementation of the core engine, or > there are plans for developing a C++ implementation? > > Thanks in advance. > -- > Alex Taylor > Senior Developer > Novixys Software > http://www.novixys.com > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

1 0

Is there a C++ Implementation
by Alex Taylor 04 Apr '14

04 Apr '14

Hi This software BaseX is excellent. Really good at processing large files. I would like to know if there is a C++ implementation of the core engine, or there are plans for developing a C++ implementation? Thanks in advance. -- Alex Taylor Senior Developer Novixys Software http://www.novixys.com

2 1

Re: [basex-talk] server class trouble
by Dirk Kirsten 04 Apr '14

04 Apr '14

Hi Jason, I am glad you figured it out - Problems that solve themselve are my favorite ones :-) I just cc'ed the mail to the mailing list so everyone can benefit from the information. I still want to point out that the problem is not the opening of the database, but the way you do it. You did use the local way and the local database access and client/server way are not synchronized, so you run into this error. Instead the content of your openDB() function you could have initialized your session before and then executed: session.execute("Open adsss") This way, the transaction monitor would be taking care of the synchronization. Cheers, Dirk On 03/04/14 18:52, Jason Ricles wrote: > I actually figured it out, when I opened up the database in the open db > method, I made a lock be put on the database. > > > On Thu, Apr 3, 2014 at 12:03 PM, Jason Ricles < > jason.ricles(a)mikrossystems.com> wrote: > >> Here is the rest of the code minus the import statements. I added some >> comments as well to help you. Also how can I invoke this parallel through >> the java program or do I send a command to the server telling it how many >> parallel to run with the keyword parallel? >> public class Basex{ >> //where i invoke the context class >> static Context context = new Context(); >> static ClientSession session=null; >> static BaseXServer server = null; >> public static void main(String[] args) throws IOException, >> InterruptedException { >> System.out.println("Sample of BaseX used with server client:"); >> Context context = new Context(); >> if(context.databases.listDBs().isEmpty() == true) >> { >> buildDB(); >> } >> else >> openDB(); >> //where i make the server and the session >> BaseXServer server = new BaseXServer(); >> session = new ClientSession(context, "admin", "admin"); >> queryDB(server); >> System.out.print("program exit and clean up\n"); >> programExit(server); >> } >> >> //builds the database if one does not exist >> public static void buildDB() throws BaseXException >> { >> System.out.println("Creating a database and populating"); >> new CreateDB("adsss").execute(context); >> new Add("adsss","/home/jricles/Desktop/adss.xml").execute(context); >> new Optimize().execute(context); >> } >> >> >> >> public static void programExit(BaseXServer server) throws IOException >> { >> context.closeDB(); >> context.close(); >> server.stop(); >> session.close(); >> } >> >> //opens the database so that it may be queried >> public static void openDB() throws IOException >> { >> String db = new Open("adsss").execute(context); >> } >> >> //queries the database on the server >> public static void queryDB(BaseXServer server) throws IOException, >> InterruptedException >> { >> try >> { >> session.setOutputStream(System.out); >> session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); >> session.query("doc('adsss')/*").execute(); >> System.out.println(); >> } >> catch(IOException e) >> { >> System.out.println("clean exit"); >> System.out.println(e); >> server.stop(); >> System.exit(0); >> } >> } >> } >> >> On Thu, Apr 3, 2014 at 11:48 AM, Dirk Kirsten <dk(a)basex.org> wrote: >> >>> Hello Jason, >>> >>> this class exist, but it is a testing class, so it is not included in >>> the jar file. See here for the source code of the class: >>> >>> https://github.com/BaseXdb/basex/blob/master/basex-core/src/test/java/org/b… >>> >>> I guess the OverlappingFileLockException should not occur. Do you do >>> anything besides that code snippet, like executing other quires as well >>> in parallel. Are you properly using the same context for this? >>> A small SSCCE might help to reproduce this. >>> Maybe you can also set PARALLEL (see >>> https://docs.basex.org/wiki/Options#PARALLEL) to 1. >>> >>> Cheers, >>> Dirk >>> >>> On 03/04/14 16:24, Jason Ricles wrote: >>>> To whom it may concern, >>>> >>>> I am trying to see what stuff I can do with the server class and keep >>>> running into a org.basex.core.BaseXException: >>>> java.nio.channels.OverlappingFileLockException error. With the following >>>> code >>>> >>>> session.setOutputStream(System.out); >>>> session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); >>>> session.query("doc('adsss')/*").execute(); >>>> System.out.println(); >>>> >>>> To figure out the problem and correct it through trial and error to >>> learn >>>> how to use BaseX in java better, I am trying to use the following class >>>> from the import server.* statement I imported at the beginning of the >>> code >>>> http://docs.basex.org/javadoc/org/basex/server/LockingTest.html. >>> However it >>>> gives me an error that this class does not exist in the Server import. >>> I am >>>> curious if this javadoc is out of date, or if it is incorrect in >>> something >>>> that I might be doing in my code. >>>> >>>> Thanks, >>>> >>>> Jason Ricles >>>> >>>> >>>> >>>> _______________________________________________ >>>> BaseX-Talk mailing list >>>> BaseX-Talk(a)mailman.uni-konstanz.de >>>> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >>>> >>> >>> -- >>> Dirk Kirsten, BaseX GmbH, http://basex.org >>> |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz >>> |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: >>> | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle >>> `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 >>> >> >> > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

logging in basex-api (restxq)
by Maximilian Gärber 03 Apr '14

03 Apr '14

Hi, I'd like to use log4j with basex-api but cannot figure out how to make this work. Currently, everything goes to the console. The basex-api POM defines a dependency on slf4j-nop which as far as I undertand logs to dev/null Do I need to change the basex-api POM file to replace it with the slf4j log4j adapter? And: what setting do I need to change the target output of the trace() function? My web app POM contains these settings: .... <dependency> <groupId>log4j</groupId> <artifactId>log4j</artifactId> <version>1.2.17</version> </dependency> <dependency> <groupId>org.eclipse.jetty</groupId> <artifactId>jetty-server</artifactId> <version>${jettyVersion}</version> </dependency> <dependency> <groupId>org.basex</groupId> <artifactId>basex-api</artifactId> <version>${BaseXVersion}</version> ... Regards, Max

3 2

Performance of matches() vs castable as xs:integer
by Hondros, Constantine (ELS-AMS) 03 Apr '14

03 Apr '14

Hello all, I'm scanning millions of XML records imported from CSV looking for instances of 'bib_rec_id' which are non-numeric. Which of these two is if-statements likely to complete earlier? for $a in (/csv/record/bib_rec_id) return if ($a castable as xs:integer) then ... blah or if (matches($a, '^[0-9]+$')) then ... blah Yes - I'm trying it out now, but I suspect it will be quicker to ask than wait for either query to complete. TIA. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 1

server class trouble
by Jason Ricles 03 Apr '14

03 Apr '14

To whom it may concern, I am trying to see what stuff I can do with the server class and keep running into a org.basex.core.BaseXException: java.nio.channels.OverlappingFileLockException error. With the following code session.setOutputStream(System.out); session.execute("XQUERY doc('/home/jricles/Desktop/adsss.xml')"); session.query("doc('adsss')/*").execute(); System.out.println(); To figure out the problem and correct it through trial and error to learn how to use BaseX in java better, I am trying to use the following class from the import server.* statement I imported at the beginning of the code http://docs.basex.org/javadoc/org/basex/server/LockingTest.html. However it gives me an error that this class does not exist in the Server import. I am curious if this javadoc is out of date, or if it is incorrect in something that I might be doing in my code. Thanks, Jason Ricles

1 0

Multiple db:replace() = slower updates with 7.8
by France Baril 02 Apr '14

02 Apr '14

Hi, We run batch processes on our files in order to send them out to translation in xliff format (xml format for translations). I run a piece of code that: 1. applies transformations 2. file:writes the resulting files (for debug purposes) 3. and then db:replaces the resulting files. If I send 5 files into the process, it takes a few seconds before the files appear on the file system. Yet full process with the db:replace takes 2 minutes to complete. When I send 60 files... the process never ends. All files are available on the file system and are valid, which means I am fairly certain that the freeze doesn't occur because of an error in one of the files. There is no error message in the terminal window. Is possible that something was changed after 7.7 that would affect performance? On our production server, which is on 7.7 we can run 100+ files in just a few minutes. Maybe there are new server settings that we missed? For reference, here is the code. I understand that updates are all performed at the end of the process, which is why we get the debug files first, but the lag time between the time where we get all files on the file system and the db:replace seems huge. *declare* *updating* *function* *translation:transform-to-xliff*(*$menu-id* *as **xs:string*, *$lang* *as **xs:string**, *$package-number* *as **xs:string* ){ *let **$menu* := *menu:xml-get-menu*(*$menu-id*, 'en-us') (: Need to translate menu and its topics without getting duplicated topics twice:) (: Always send the reusable strings from writers and from dev... doesn't cost anything if no new string anyway :) *let* *$file-ids* := (*$menu-id*, *for **$id* *in **distinct-values*( *$menu*/descendant::*[*name*()='topicref']/*data*(*@id-ref*))[1] *return * *$id*, 'stringreferences', 'stringreferencestransform') *return *(*for **$file-id* *in **distinct-values*(*$file-ids*) *let* *$file* := *db:open*('en-us')/*[*@id*=*$file-id*] *let* *$skl-href* := 'skeletons/' || *$package-number* || '/'|| *substring-after*(*$file*/*base-uri*(), 'en-us/') *let* *$file-with-preserve* := *copy* *$copy* := *$file* *modify*(*if* (*exists*(*$copy*/*@xml:space*)) *then *() *else **insert* *node* *attribute* {'xml:space' }{'preserve'} *into* *$copy*) *return **$copy* *let* *$all-trans-files* := *xliff-transformer:create-translation-files*(*$file-with-preserve*, *$package-number*, *$menu-id*, *$lang*, *$skl-href*) *let* *$skeleton* := *$all-trans-files*[1] *let* *$xliffs* := *for **$xliff* *in **$all-trans-files*[ *position*() != 1] *return **$xliff* *let* *$debug* := *file:write*('Debug-xliff/skls/' || *tokenize*(*$skl-href*, '/')[*last*()], *$skeleton*) *return *(*db:replace*('Translation-management', *$skl-href*, *$skeleton*), *for **$xliff* *in **$xliffs* *let* *$target-lang* := *$xliff*/descendant::*[*name* ()='file']/*data*(*@target-language*) *let* *$lang-pack-name* := *concat*(*$target-lang*,'_', *$package-number*) *let* *$file-loc-end* := *$menu-id* || '/' || *$lang-pack-name* ||'/' || *substring-after*(*$file*/*base-uri*(), 'en-us/') (:let $debug := file:append('debug-ids.xml', '
' || $file-loc-end):) *let* *$file-loc* := *if* (*exists*(*$xliff*/ descendant::*[*@translate*='yes'])) *then *'xliff-to-translate/' || *$file-loc-end* *else *'xliff-no-new-segment/' || *$file-loc-end* *let* *$debug* := *file:write*('Debug-xliff/' || *tokenize*(*$file-loc*, '/')[*last*()], *$xliff*) *return **db:replace*('Translation-management', *$file-loc*, *$xliff*) ) ) }; -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 6

Attribute cannot be serialized !!
by John Best 02 Apr '14

02 Apr '14

Dear Team, I have downloaded the latest source code of BaseX, by latest I mean just a half hour ago. When I run it through Eclipse, I am getting error - [SENR0001] Attributes cannot be serialized:db:open-pre("docdb",7). This comes when, I try to get ONLY attributes .... -- Have a nice day JBest

4 6

WEBDAV bug when changing admin password in 7.8.1
by Maud Ingarao 02 Apr '14

02 Apr '14

Hi :) We are experiencing a strange bug in 7.8.1 After installing and before changing the admin password is everything ok (client connexion, rest and restxq connexions, webdav connexion...) But as soon as we change the admin password (best practice ? :p), the webdav connexion becomes impossible, and so the restxq connexion with a 404, while the rest connexion remains ok, like the client one. WEBDAV example : With the admin/admin password : mingarao@l100318:~$ cadaver http://localhost:8984/webdav Authentication required for BaseX on server `localhost': Username: admin Password: dav:/webdav/> ls Listing collection `/webdav/': succeeded. Coll: input 0 avril 1 16:49 Coll: my 0 avril 1 16:50 Coll: test 0 avril 1 16:49 dav:/webdav/> After changing the admin password mingarao@l100318:~$ cadaver http://localhost:8984/webdav Could not open collection:*-> doesn't even ask for a login/password* Impossible de s'authentifier auprès du serveur: missing realm in Basic challenge dav:/webdav/? ls The `ls' command can only be used when connected to the server. Try running `open' first (see `help open' for more details). dav:/webdav/? open http://localhost:8984/webdav Could not open collection: Impossible de s'authentifier auprès du serveur: missing realm in Basic challenge dav:/webdav/? Thanks a lot :) Maud -- /« Ne travaillez jamais »/ *Maud Ingarao* IHPC (UMR 5037) Institut d'histoire de la pensée classique, de l'Humanisme aux Lumières Ecole Normale Supérieure de Lyon - Site Descartes - Bureau R322 15 Parvis René Descartes - BP7000 - 69342 Lyon CEDEX 07 +33 4 37 37 65 79 - maud.ingarao(a)ens-lyon.fr /Je suis absente le vendredi | Out of office on Fridays/ http://pensee-classique.ens-lyon.fr | http://institutdesanti.ens-lyon.fr http://ahn.ens-lyon.fr | http://forge.cbp.ens-lyon.fr/ http://www.mutec.huma-num.fr | http://www.projet-plume.org http://www.cahier.paris-sorbonne.fr/

4 6