December 2015 - BaseX-Talk - mailman.uni-konstanz.de

[bxerr:BXDB0002] Too many open files
by Mansi Sheth 07 Dec '15

07 Dec '15

Hello, I am importing BaseX, with tons of XML files. Currently I have roughly 1600 databases, I am starting basexhttp service, to access it over a web service endpoint, thru a xquery file. Using BaseX 8.2.3. I am receiving below error: [bxerr:BXDB0002] Resource "/veracode/msheth/BaseXDB/bi_output_713/inf.basex (Too many open files)" not found. basexhttp, is running with 10240M virtual memory. I can share the xquery file, if thats needed. Has anyone experienced this before ? Is there a limit on no of databases supported by BaseX ? Is there some configuration option, which I can use to close already queried database ? Thanks, - Mansi

4 5

running http server and GUI at the same time safely?
by C. M. Sperberg-McQueen 03 Dec '15

03 Dec '15

On the page about transaction management [1], the wiki says: As the standalone versions of BaseX (command-line, GUI) cannot be synchronized with other BaseX instances, we generally recommend working with the client/server architecture if concurrent write operations are to be performed. Am I right to interpret this as meaning that I can work safely in the BaseX GUI interface while the http version (or a servlet version) of BaseX is running at the same time, if any of the following conditions are observed? 1 The GUI and the server or servlet have different settings for DBPATH. 2 They are working with different databases. 3 One or the other of the interfaces is only reading, not writing, the database. Apart from wishing to understand the situation in general terms, the practical question I'm currently wondering about is how to make it safe for myself to have a version of BaseX running in the background managing a local database or two through a Web interface, while still being able to pop in to the GUI from time to time to do some quick queries. I rarely want to use the GUI for the databases for which I have Web interfaces, so if it's necessary to use a separate DBPATH, I could probably live with that. But sometimes it's convenient, so if I can get by, relying on point 3, that would be excellent. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

2 1

AUTOOPTIMIZE - was true now false
by James Ball 02 Dec '15

02 Dec '15

Hello, I’m trying out AUTOOPTIMIZE for the first time and I’m not getting what I expect. Running: BaseX 8.3 beta ec9b627 A new database is created with a single document which has TEXTINDEX, ATTRINDEX, UPDINDEX and AUTOOPTIMISE all set to true. This is what INFO DATABASE shows (as I expect): Indexes Up-to-date: true TEXTINDEX: true ATTRINDEX: true FTINDEX: false TEXTINCLUDE: ATTRINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: true AUTOOPTIMIZE: true MAXCATS: 100 MAXLEN: 96 Now I add a new document (or more than one) to the database. I expect that Up-to-date will still be true and that AUTOOPTIMIZE will still be true. But what I see is both are now false: Indexes Up-to-date: false TEXTINDEX: true ATTRINDEX: true FTINDEX: false TEXTINCLUDE: ATTRINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: true AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 Perhaps this is the expected behaviour and I’ve misunderstood AUTOOPTIMIZE? Or is there a bug? Many thanks, James

3 4

Re: [basex-talk] Sizing BaseX Server
by Christophe Marchand 01 Dec '15

01 Dec '15

Ok, thanks a lot, Dirk. I had the same feeling, SSD, lot of RAM, big procs, etc... The problem I have is the server will be a virtual machine, and I have to give sizing infos to infra to let them provision VMs... Thanks again, Christophe Le 01/12/2015 15:06, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Re: Sizing BaseX Server (Dirk Kirsten) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 1 Dec 2015 15:06:03 +0100 > From: Dirk Kirsten <dk(a)basex.org> > To: Christophe Marchand <cmarchand(a)oxiane.com> > Cc: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] Sizing BaseX Server > Message-ID: <565DA94B.2090809(a)basex.org> > Content-Type: text/plain; charset="utf-8" > > Hello Christophe, > > that's easy: The more you got, the better it is ;) > > More serious: It is hard, if not impossible, to tell. This very much > depends on your use case and how you intend to use BaseX in your > process. As a traditional database and having lots of read/write access, > you are most likely I/O bound. However, you can also do complex > operations using XQuery, so you could be CPU bound. > > I find it almost always beneficial to use SSDs instead of traditional > HDDs, but again: If you never touch the disk at all, this wouldn't make > a difference (but it also decreases the BaseX startup time, which is nice). > > The use cases just differs to much for BaseX - you can use BaseX > embedded into your smartphone application or on a large zServer, so it > is really though to give a general advice. For a practicable approach I > would always recommend you run your application at some standard server > and take a look using Java profiling where BaseX is bound and then > increase the according component. > > Cheers > Dirk > > On 12/01/2015 01:51 PM, Christophe Marchand wrote: >> Hello, >> >> I'm looking at documentation about sizing a basex server computer. >> What's best : kind of processor, number of cores, RAM, disk-system, >> according to database size. >> >> Is there something in documentation on these subjects ? >> >> Best regards, >> Christophe >> >> >> -- >> >> >> Christophe MARCHAND >> >> Consultant Formateur >> cmarchand(a)oxiane.com <mailto:cmarchand@oxiane.com> >> LD : (+33)1 84 19 19 76 >> GSM : +33 (0)6 23 41 09 17 >> >> oxiane >> >> 98, avenue du G?n?ral Leclerc >> 92100 Boulogne-Billancourt >> Standard : (+33)1 55 60 76 72 >> Fax : (+33)1 55 60 76 73 >> www.oxiane.com <http://www.oxiane.com> >> >> >> Notre catalogue formations 2015 >> >> Notre catalogue formations 2015 >> <http://www.oxiane.com/wp-content/uploads/2014/12/Oxiane_Catalogue-Formation…> >>

2 1

Sizing BaseX Server
by Christophe Marchand 01 Dec '15

01 Dec '15

Hello, I'm looking at documentation about sizing a basex server computer. What's best : kind of processor, number of cores, RAM, disk-system, according to database size. Is there something in documentation on these subjects ? Best regards, Christophe -- Christophe MARCHAND Consultant Formateur cmarchand(a)oxiane.com <mailto:cmarchand@oxiane.com> LD : (+33)1 84 19 19 76 GSM : +33 (0)6 23 41 09 17 oxiane 98, avenue du Général Leclerc 92100 Boulogne-Billancourt Standard : (+33)1 55 60 76 72 Fax : (+33)1 55 60 76 73 www.oxiane.com <http://www.oxiane.com> Notre catalogue formations 2015 Notre catalogue formations 2015 <http://www.oxiane.com/wp-content/uploads/2014/12/Oxiane_Catalogue-Formation…>

2 1

XML Prague: Little Update
by Christian Grün 01 Dec '15

01 Dec '15

Hi all, We are currently assembling the talks for our XML Prague User Meeting. You will soon find more information on our Lanyrd conference page [1]. For example, it’s not settled yet if the meeting will take place in the morning or afternoon (afternoon would be our favorite). We are still looking for speakers; please let us know if you are interested! All the best, Christian [1] http://lanyrd.com/2016/basex/

1 0

Running BaseX under Tomcat on a commercial Java hosting provider
by C. M. Sperberg-McQueen 01 Dec '15

01 Dec '15

In case there are other users of XQuery who are looking for a way to get an XQuery engine on the Web but are not sure how to go about it, I have described my adventures setting up one approach (running BaseX 7.9 under Tomcat 6 on a commercial Java hosting provider) in a blog post today, hoping that it might enable someone else to do it with less trouble and confusion than I had: http://cmsmcq.com/mib/?p=1368 When time allows, I expect to upgrade my Tomcat to Tomcat 7 so that I can install a current BaseX; I'll update the post then with information for BaseX 8.*. if those who understand Java development and deployment better than I do (or wish to do) find errors in the exposition or simpler ways to get things set up, I would be glad to have them pointed out. I'd also be interested in speculations as to why setting the default user in web.xml seems not to have worked, but at this point I doubt that it's worth significant effort to solve that problem. -- **************************************************************** * C. M. Sperberg-McQueen, Black Mesa Technologies LLC * http://www.blackmesatech.com * http://cmsmcq.com/mib * http://balisage.net ****************************************************************

3 2