- BaseX-Talk - mailman.uni-konstanz.de

Performance and benchmark
by Florent Gallaire 30 Dec '14

30 Dec '14

Hello, I have evaluated XML databases for an important project, and I'm very happy with BaseX which has great fonctionnalities and is very easy to use. I'm now about deploying my project in production, so I have new questions. My database has 400 000 XML resource files for a total 2.4 Go size, so it should work fine (http://docs.basex.org/wiki/Statistics) 1) What are the CPU/RAM quantityies recommanded to use BaseX in production ? 2) Is there a benchmark to run to have an evaluation of the CPU/RAM quantities from a BaseX point of view ? 3) What about the JVM options ? In particular should I change the "-Xmx512m" default value ? What will be the best value ? 4) With my database, on a t2.micro EC2 instance (1 VCPU + 1 Go RAM), BaseX is unusable. On a powerful shared server (16 VCPU + 16 Go RAM) it works fine (until I exceed my 512Mb personal hosting limitation). On my shared server, a request like "curl 'http://mydomain/rest/database/file.xml?query=/a/direct/path' takes 1.5 second. It seems to me that it's a lot and should be faster as I give the good resource file and the complete path to BaseX, so there is no computation to do. What do you think about it ? 5) How many simultaneous requests can handle BaseXHTTP ? Best regards Florent -- FLOSS Engineer & Lawyer

3 6

element or attribute
by Florent Gallaire 29 Dec '14

29 Dec '14

Hello, When creating a XML file for usage as database with BaseX, is there some policy about when it's good to use an element and when it's good to use an attribut ? Cheers, Florent -- FLOSS Engineer & Lawyer

2 2

Reg : Multi Threading While Adding XMLS
by Chandrasekhar 29 Dec '14

29 Dec '14

Dear Christian We are adding the xml's to the collection database one by one(sequentially),For we are implemented multithreading concept to add the xml's to database,but at basex server level the server is adding the xmls sequentially. In our case we are opening the database and adding xmls,and also from that directory(which is having the xml's ) ,this directory can have the thousand's of xml's ,from this we need to add some particular xml's to the database, that's the reason we are adding one by one xml's to the database. Is their any way to achieve the multithreading to add xml's to database for improving the performence while adding the xml's to the database. Thanks Chandrasekhar The information contained in this e-mail and any accompanying documents may contain information that is confidential or otherwise protected from disclosure. If you are not the intended recipient of this message, or if this message has been addressed to you in error, please immediately alert the sender by reply e-mail and then delete this message, including any attachments. Any dissemination, distribution or other use of the contents of this message by anyone other than the intended recipient is strictly prohibited.

1 0

Editor Background Color
by Alex R. Loayza 25 Dec '14

25 Dec '14

Hello, I’m new toBaseX, and I’m trying to customize the GUI, by changing the background color ofthe Editor panel. I always use dark themes in IDEs because brightwhites hurt my eyes. However,I’ve found no way to change that setting in Base X. The Options / Colorssetting in the main menu effects changes to panels other than the Editor. Is there away to customize this? Thank youvery much for any help, and especially for having built this great product andmaking it open source! Bestregards, Alex

3 5

Preparing for Origami 0.4: new blog post on HTML templating
by Marc van Grootel 24 Dec '14

24 Dec '14

Hi all, I am preparing for a new release for Origami[1]: 0.4. This will make it almost feature complete. I introduce the most important new function which helps to build an HTML view from HTML templates. An example is described in detail in a new blog post. See http://xokomola.com/2014/12/23/xquery-origami-3.html Merry Christmas, --Marc [1] https://github.com/xokomola/origami

1 0

Use xquery:eval or not?
by Marc van Grootel 23 Dec '14

23 Dec '14

Hi, I would like to ask some advice. For my Origami[1] library I'm exploring different ways of providing more powerful selectors for nodes in a template document. As this is for a templating library I would like to offer string based selectors and am considering if I should go for CSS-style selectors or XPath selectors. I started on CSS selectors to be able to select nodes with selectors like "p#id" and "li.class" but to do this properly it involves quite a bit of string manipulation in order to support more advanced stuff. Being in a language that already has XPath in it, it would be much more natural and powerful to use XPath selectors. This led me to look at xquery:eval. So far I resisted using eval but the code is a lot simpler that way. Implementing CSS-style selectors would probably lead me down a path with a lot more ugly string manipulation. I'm aware that it's better to express these things in XQuery code and that is also possible. But it's so much nicer to read this: xf:extract(xf:select('li'), $doc) then this: xf:extract(function($node) { $node/li }, $doc) I'm interested in pros and cons of using xquery:eval with XPath string-selectors. How is the performance? Other downsides (such as being non-standard)? Thanks --Marc [1] https://github.com/xokomola/origami

4 11

Need help to query
by Florent Gallaire 23 Dec '14

23 Dec '14

Hello, I need some help to query a database of thousands of xml files. They are structured only with elements with no attributes : file1.xml <A> <B> <C>value</C> </B> <D> <E>text</E> </D> </A> file2.xml <A> <B> <C>value</C> </B> <D> <E>text</E> </D> </A> and so on file3.xml, file4.xml.... Having the value of the <C> element, I would like to have the text of the <E> element. What is the good query to do this ? Best regards Florent -- FLOSS Engineer & Lawyer

3 4

Disk full caused by huge index
by Ludovic Kuty 23 Dec '14

23 Dec '14

Dear users, Can I remove the file txtl.basex and still get an access to my data ? BaseX of course will be stopped. My HDD is full and I can't optimize all because BaseX times out. Then I would like to deactivate the UPDINDEX option on my already existing DB. I already read the thread https://mailman.uni-konstanz.de/pipermail/basex-talk/2014-July/006942.html ( UPDINDEX and ever growing index size ) and was well aware of the problem but I didn't know that it would grow so fast. total 214335012 -rw-r--r-- 1 root root 1620720 Dec 23 02:54 atv.basex -rw-r--r-- 1 root root 2300192644 Dec 23 02:54 atvl.basex -rw-r--r-- 1 root root 337605 Dec 23 02:54 atvr.basex -rw-r--r-- 1 root root 15 Dec 23 02:54 idp.basex -rw-r--r-- 1 root root 137256 Dec 23 02:54 inf.basex -rw-r--r-- 1 root root 631959552 Dec 23 02:54 tbl.basex -rw-r--r-- 1 root root 1220641 Dec 23 02:54 tbli.basex -rw-r--r-- 1 root root 146626967 Dec 23 02:54 txt.basex -rw-r--r-- 1 root root 216396026742 Dec 23 02:54 txtl.basex -rw-r--r-- 1 root root 838900 Dec 23 02:54 txtr.basex TIA, Ludovic Kuty

2 3

file names with [] and base-uri
by Andy Bunce 22 Dec '14

22 Dec '14

Hi, If I create a database with a file with [] in the name e.g. *bracket[in]name.xml *then /*/base-uri(.) gives the error [XQST0046] URI 'bracket[in]name/bracket[in]name.xml' is invalid. Query: /*/base-uri(.) Is this correct behavior? /Andy

2 2

Bug in array:fold-left?
by Marc van Grootel 21 Dec '14

21 Dec '14

Hi, I think I've spotted a bug in array:fold-left (using 20141219 snapshot) array:tail([1,2,3]) => [2,3] array:fold-left( array:tail([1,2,3]), (), function($result, $fn) { ($result, $fn) } ) => (1,2) Using array:fold-right in the above example returns (2,3). -- --Marc

2 2