- BaseX-Talk - mailman.uni-konstanz.de

basex trouble
by Ветошкин Владимир 23 May '18

23 May '18

Hello! Sorry for my English. May I ask you some questions here or I have to write them on github? -- С уважением, Ветошкин Владимир Владимирович

2 1

New BaseX setup
by France Baril 23 May '18

23 May '18

Hi, In one of my projects, we are trying to refactor our code so it uses a node.js client. We have extensive functions that do more than just get data in our .xqm. They were implemented around the http server and our web application was calling the REST functions we implemented using jquery AJAX request. All the examples we looked at in the documentation that don't use the http server pass entire queries as a string to the server. We were wondering if we can call functions from our .xqm modules directly (ex. namespace:do-this(param0, param1)) or if any request that uses functions from our .xqm files need to pass through the rest API. If we can call our .xqm functions more directly, could you point us to an example to help us understand how it would work? Thanks! -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

4 4

(no subject)
by Kirsten, Dirk 23 May '18

23 May '18

Dear list, I tried to insert a huge XML document (english wikipedia). When doing so and using the default parser I got the following warning: "/my/path/enwiki-latest-pages-articles.xml" (Line 61696838): JAXP00010004: The accumulated size of entities is "50,000,001" that exceeded the "50,000,000" limit set by "FEATURE_SECURE_PROCESSING". I solved this by setting the environment variables: -DentityExpansionLimit=2147480000 -DtotalEntitySizeLimit=2147480000 -Djdk.xml.totalEntitySizeLimit=2147480000 So it seems this is a security measure from JXB. Would it be possible to set these values by default or at least be able to change the limit with the GUI or BaseX options? Cheers Dirk Dirk Kirsten ______________________________ Senacor Technologies AG D?sseldorfer Stra?e 13 65760 Eschborn M +49 (151) 4435 1967 Dirk.Kirsten(a)senacor.com www.senacor.com Senacor Technologies Aktiengesellschaft - Sitz: Eschborn - Amtsgericht Frankfurt am Main - Reg.-Nr.: HRB 105546 Vorstand: Matthias Tomann, Marcus Purzer - Aufsichtsratsvorsitzender: Daniel Gr?zinger Diese E-Mail inklusive Anlagen enth?lt vertrauliche und/oder rechtlich gesch?tzte Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrt?mlich erhalten, informieren Sie bitte den Absender und vernichten Sie diese E-Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail ist nicht gestattet. This e-mail including any attachments may contain confidential and/or privileged information. If you are not the intended recipient (or have received this e-mail in error) please notify the sender immediately and destroy this e-mail. Any unauthorized copying, disclosure or distribution of the materials in this e-mail is strictly forbidden.

2 1

Re: [basex-talk] BaseX-Talk Digest, Vol 101, Issue 37
by Kristian Kankainen 22 May '18

22 May '18

I have a setup using rsync to keep database directory copies synchronized with a master over the network. It works very well for me.22. mai 2018 10:16 kirjutas kuupäeval Alexander Holupirek <alex(a)holupirek.de>: > > Hi Martin, > > export/import is one option. backup/restore another [1]. > And a third could be to copy the database directory (provided the servers have a more or less similar setup). > > Cheers, > Alex > > [1] http://docs.basex.org/wiki/Backups (can also be done via DBA [2]) > [2] http://docs.basex.org/wiki/DBA > > > On 21. May 2018, at 18:32, Martin Lourduswamy <martin.louis(a)gmail.com> wrote: > > > > Hi, > > I would like to know how to copy a database from one server to another server, please let me know. > > Is it export and get and load xml or is there another way to do it, thanks for the clarification, > > Regards > > Martin Lourduswamy > > > > On Mon, May 21, 2018 at 6:00 AM, <basex-talk-request(a)mailman.uni-konstanz.de> wrote: > > Send BaseX-Talk mailing list submissions to > > basex-talk(a)mailman.uni-konstanz.de > > > > To subscribe or unsubscribe via the World Wide Web, visit > > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > or, via email, send a message with subject or body 'help' to > > basex-talk-request(a)mailman.uni-konstanz.de > > > > You can reach the person managing the list at > > basex-talk-owner(a)mailman.uni-konstanz.de > > > > When replying, please edit your Subject line so it is more specific > > than "Re: Contents of BaseX-Talk digest..." > > > > > > Today's Topics: > > > > 1. Fwd: BaseX performance improvements (Christian Gr?n) > > 2. Re: BaseX performance improvements (Christian Gr?n) > > > > > > ---------------------------------------------------------------------- > > > > Message: 1 > > Date: Sun, 20 May 2018 18:51:03 +0200 > > From: Christian Gr?n <christian.gruen(a)gmail.com> > > To: Martin Lourduswamy <martin.louis(a)gmail.com>, BaseX > > <basex-talk(a)mailman.uni-konstanz.de> > > Subject: [basex-talk] Fwd: BaseX performance improvements > > Message-ID: > > <CAP94bnPHW=NqzXxY-cfubGSLzWLoiiPzj_WfNj6tWYZFg0DtJA(a)mail.gmail.com> > > Content-Type: text/plain; charset="UTF-8" > > > > Hi Martin (cc to the list), > > > > > 1. each XML node => 500 bytes > > > 2. total size of XML DB => 10million nodes(which will grow continuously as > > > new files are added). > > > > So one node is one document, right? I?m just asking because, in the > > XML terminology, each XML document has nodes itself: element nodes, > > attributes nodes, text nodes, etc. > > > > If you are working with millions of documents, it can be helpful to > > work with a "daily" database, which contains auxiliary references on > > documents that have been deleted or updated. If there is a time > > interval in which no people access your database (e.g. each night), > > you can merge these databases and recreate your index structures. If > > you query your database, you can a few more lines of XQuery: first > > check your daily database, and (if it doesn?t contain the required > > document) look up the document in your fully indexed database. > > > > > I have to do a update of the nodes as I need to replace them. I chose delete > > > + insert instead of replace > > > > Please note that a replace operation can be much faster: If the > > structure of the updated document is similar to the old document, the > > document can be replace in-place. > > > > > Also, I am thinking of indexing on the node id, as that is like the primary > > > key on which I base my operations, any suggestions might also be helpful, > > > > Here it may also be interesting to know if you will only address > > documents or arbitrary nodes of your document. In the first case, > > addressing the document path via db:open should be sufficient [1]. In > > the latter case, you could possibly use the existing function > > db:node-id [2]. > > > > Hope this helps, > > Christian > > > > [1] http://docs.basex.org/wiki/Databases > > [2] http://docs.basex.org/wiki/Database_Module#db:node-id > > > > > > > > > Thanks again, > > > Regards > > > Martin Lourduswamy > > > > > > On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n <christian.gruen(a)gmail.com> > > > wrote: > > >> > > >> Hi Martin, > > >> > > >> > I am new to BaseX, I would like ot speed up XQuery of insert and delete > > >> > and > > >> > replace through options. > > >> > > >> Welcome to the list. As there are numerous ways to do updates in > > >> BaseX, feel free to give us more information on your insert and delete > > >> operations. Do you work with large single documents or many small > > >> documents? How large is your database? > > >> > > >> > While I query basex through perl, and try to > > >> > connect through GUI, the perl connection aborts. Is there a parameters > > >> > for > > >> > parallel connections, please let me know. > > >> > > >> I can?t tell why your perl connection is interrupted by opening the > > >> GUI (because they should be completely independent from each other). A > > >> step-by-step description on how you proceeded might be helpful. > > >> > > >> Because there is no coupling between GUI and the client/server > > >> architecture, however, you should avoid running updates outside the > > >> GUI. Please check out [1] for more information. > > >> > > >> Best, > > >> Christian > > >> > > >> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations > > >> > > >> > > >> > > >> > > > >> > Thanks, > > >> > Regards > > >> > Martin Lourduswamy > > > > > > > > > > > > ------------------------------ > > > > Message: 2 > > Date: Sun, 20 May 2018 18:56:45 +0200 > > From: Christian Gr?n <christian.gruen(a)gmail.com> > > To: Martin Lourduswamy <martin.louis(a)gmail.com>, BaseX > > <basex-talk(a)mailman.uni-konstanz.de> > > Subject: Re: [basex-talk] BaseX performance improvements > > Message-ID: > > <CAP94bnN6w7ZaaNu43AqdzrKYsaqaxKGSamRNP8zy3fmEEJZ6Hg(a)mail.gmail.com> > > Content-Type: text/plain; charset="UTF-8" > > > > > Java heap space at C:\Users\lourduswamym\oracle_scripts/BaseXClient.pm line > > > 213. > > > > How much memory have you assigned to BaseX [1]? > > > > > Actually the error on the server log. The insert operation was taking 1+minutes due to slow network and then the error happened. I have been running this server instance continuously for 1 day with continuous insert from a per script. > > > > If you create a new database, you can specify a directory with the > > files that are to be initially added to your database. This might save > > you a lot of time. > > > > > So I think I should be careful to run only one single process of client at a > > > time or make sure memory is enough to handle multiple client operations, > > > please let me know your thoughts, > > > > If your documents are small, you shouldn?t usually encounter any > > errors. But it might have to do with the large number of documents you > > are dealing with. One more option is to distribute your docs across > > multiple databases (you can access all of them via a single XQuery > > expression). > > > > Best, > > Christian > > > > [1] http://docs.basex.org/wiki/Start_Scripts > > > > > > > > > > > Thanks again, > > > Regards > > > Martin Lourduswamy > > > > > > On Sun, May 20, 2018 at 9:48 AM, Martin Lourduswamy <martin.louis(a)gmail.com> > > > wrote: > > >> > > >> Hi, > > >> > > >> Thanks for the clarifications. My database is > > >> > > >> DB Size: > > >> ====== > > >> 1. each XML node => 500 bytes > > >> 2. total size of XML DB => 10million nodes(which will grow continuously as > > >> new files are added). > > >> 3. I will be having multiple DB's of same size and more size as the DB > > >> continuously grows > > >> > > >> I have to do a update of the nodes as I need to replace them. I chose > > >> delete + insert instead of replace for each of the node through perl, as I > > >> will make sure there are no duplicate nodes left in the database.(just a > > >> precaution that even if some nodes get duplicated, through some other > > >> processes I will be able to remove them by delete) > > >> > > >> DB Speed: > > >> ======== > > >> I will disable logging as it might speed up the database operations. > > >> > > >> DB Architecture > > >> ============ > > >> 1 server(windows or Linux) running baseX > > >> multiple client computers trying to query the same machine for select > > >> through fn:doc(...) API to get the data through perl > > >> then do a delete + insert from perl > > >> > > >> I would like to know if you think this might work for production and any > > >> suggestion for data retrieval and update > > >> Any changes to the way I architecture it might help > > >> > > >> Also, I am thinking of indexing on the node id, as that is like the > > >> primary key on which I base my operations, any suggestions might also be > > >> helpful, > > >> Thanks again, > > >> Regards > > >> Martin Lourduswamy > > >> > > >> On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n > > >> <christian.gruen(a)gmail.com> wrote: > > >>> > > >>> Hi Martin, > > >>> > > >>> > I am new to BaseX, I would like ot speed up XQuery of insert and delete > > >>> > and > > >>> > replace through options. > > >>> > > >>> Welcome to the list. As there are numerous ways to do updates in > > >>> BaseX, feel free to give us more information on your insert and delete > > >>> operations. Do you work with large single documents or many small > > >>> documents? How large is your database? > > >>> > > >>> > While I query basex through perl, and try to > > >>> > connect through GUI, the perl connection aborts. Is there a parameters > > >>> > for > > >>> > parallel connections, please let me know. > > >>> > > >>> I can?t tell why your perl connection is interrupted by opening the > > >>> GUI (because they should be completely independent from each other). A > > >>> step-by-step description on how you proceeded might be helpful. > > >>> > > >>> Because there is no coupling between GUI and the client/server > > >>> architecture, however, you should avoid running updates outside the > > >>> GUI. Please check out [1] for more information. > > >>> > > >>> Best, > > >>> Christian > > >>> > > >>> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations > > >>> > > >>> > > >>> > > >>> > > > >>> > Thanks, > > >>> > Regards > > >>> > Martin Lourduswamy > > >> > > >> > > > > > > > > > End of BaseX-Talk Digest, Vol 101, Issue 37 > > ******************************************* > > >

1 0

Re: [basex-talk] BaseX-Talk Digest, Vol 101, Issue 37
by Martin Lourduswamy 22 May '18

22 May '18

Hi, I would like to know how to copy a database from one server to another server, please let me know. Is it export and get and load xml or is there another way to do it, thanks for the clarification, Regards Martin Lourduswamy On Mon, May 21, 2018 at 6:00 AM, <basex-talk-request(a)mailman.uni-konstanz.de > wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Fwd: BaseX performance improvements (Christian Gr?n) > 2. Re: BaseX performance improvements (Christian Gr?n) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Sun, 20 May 2018 18:51:03 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: Martin Lourduswamy <martin.louis(a)gmail.com>, BaseX > <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] Fwd: BaseX performance improvements > Message-ID: > <CAP94bnPHW=NqzXxY-cfubGSLzWLoiiPzj_WfNj6tWYZFg0DtJA(a)mail.gmail. > com> > Content-Type: text/plain; charset="UTF-8" > > Hi Martin (cc to the list), > > > 1. each XML node => 500 bytes > > 2. total size of XML DB => 10million nodes(which will grow continuously > as > > new files are added). > > So one node is one document, right? I?m just asking because, in the > XML terminology, each XML document has nodes itself: element nodes, > attributes nodes, text nodes, etc. > > If you are working with millions of documents, it can be helpful to > work with a "daily" database, which contains auxiliary references on > documents that have been deleted or updated. If there is a time > interval in which no people access your database (e.g. each night), > you can merge these databases and recreate your index structures. If > you query your database, you can a few more lines of XQuery: first > check your daily database, and (if it doesn?t contain the required > document) look up the document in your fully indexed database. > > > I have to do a update of the nodes as I need to replace them. I chose > delete > > + insert instead of replace > > Please note that a replace operation can be much faster: If the > structure of the updated document is similar to the old document, the > document can be replace in-place. > > > Also, I am thinking of indexing on the node id, as that is like the > primary > > key on which I base my operations, any suggestions might also be helpful, > > Here it may also be interesting to know if you will only address > documents or arbitrary nodes of your document. In the first case, > addressing the document path via db:open should be sufficient [1]. In > the latter case, you could possibly use the existing function > db:node-id [2]. > > Hope this helps, > Christian > > [1] http://docs.basex.org/wiki/Databases > [2] http://docs.basex.org/wiki/Database_Module#db:node-id > > > > > Thanks again, > > Regards > > Martin Lourduswamy > > > > On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n < > christian.gruen(a)gmail.com> > > wrote: > >> > >> Hi Martin, > >> > >> > I am new to BaseX, I would like ot speed up XQuery of insert and > delete > >> > and > >> > replace through options. > >> > >> Welcome to the list. As there are numerous ways to do updates in > >> BaseX, feel free to give us more information on your insert and delete > >> operations. Do you work with large single documents or many small > >> documents? How large is your database? > >> > >> > While I query basex through perl, and try to > >> > connect through GUI, the perl connection aborts. Is there a parameters > >> > for > >> > parallel connections, please let me know. > >> > >> I can?t tell why your perl connection is interrupted by opening the > >> GUI (because they should be completely independent from each other). A > >> step-by-step description on how you proceeded might be helpful. > >> > >> Because there is no coupling between GUI and the client/server > >> architecture, however, you should avoid running updates outside the > >> GUI. Please check out [1] for more information. > >> > >> Best, > >> Christian > >> > >> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations > >> > >> > >> > >> > > >> > Thanks, > >> > Regards > >> > Martin Lourduswamy > > > > > > > ------------------------------ > > Message: 2 > Date: Sun, 20 May 2018 18:56:45 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: Martin Lourduswamy <martin.louis(a)gmail.com>, BaseX > <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] BaseX performance improvements > Message-ID: > <CAP94bnN6w7ZaaNu43AqdzrKYsaqaxKGSamRNP8zy3fmEEJZ6Hg@mail. > gmail.com> > Content-Type: text/plain; charset="UTF-8" > > > Java heap space at C:\Users\lourduswamym\oracle_scripts/BaseXClient.pm > line > > 213. > > How much memory have you assigned to BaseX [1]? > > > Actually the error on the server log. The insert operation was taking > 1+minutes due to slow network and then the error happened. I have been > running this server instance continuously for 1 day with continuous insert > from a per script. > > If you create a new database, you can specify a directory with the > files that are to be initially added to your database. This might save > you a lot of time. > > > So I think I should be careful to run only one single process of client > at a > > time or make sure memory is enough to handle multiple client operations, > > please let me know your thoughts, > > If your documents are small, you shouldn?t usually encounter any > errors. But it might have to do with the large number of documents you > are dealing with. One more option is to distribute your docs across > multiple databases (you can access all of them via a single XQuery > expression). > > Best, > Christian > > [1] http://docs.basex.org/wiki/Start_Scripts > > > > > > Thanks again, > > Regards > > Martin Lourduswamy > > > > On Sun, May 20, 2018 at 9:48 AM, Martin Lourduswamy < > martin.louis(a)gmail.com> > > wrote: > >> > >> Hi, > >> > >> Thanks for the clarifications. My database is > >> > >> DB Size: > >> ====== > >> 1. each XML node => 500 bytes > >> 2. total size of XML DB => 10million nodes(which will grow continuously > as > >> new files are added). > >> 3. I will be having multiple DB's of same size and more size as the DB > >> continuously grows > >> > >> I have to do a update of the nodes as I need to replace them. I chose > >> delete + insert instead of replace for each of the node through perl, > as I > >> will make sure there are no duplicate nodes left in the database.(just a > >> precaution that even if some nodes get duplicated, through some other > >> processes I will be able to remove them by delete) > >> > >> DB Speed: > >> ======== > >> I will disable logging as it might speed up the database operations. > >> > >> DB Architecture > >> ============ > >> 1 server(windows or Linux) running baseX > >> multiple client computers trying to query the same machine for select > >> through fn:doc(...) API to get the data through perl > >> then do a delete + insert from perl > >> > >> I would like to know if you think this might work for production and any > >> suggestion for data retrieval and update > >> Any changes to the way I architecture it might help > >> > >> Also, I am thinking of indexing on the node id, as that is like the > >> primary key on which I base my operations, any suggestions might also be > >> helpful, > >> Thanks again, > >> Regards > >> Martin Lourduswamy > >> > >> On Sun, May 20, 2018 at 9:28 AM, Christian Gr?n > >> <christian.gruen(a)gmail.com> wrote: > >>> > >>> Hi Martin, > >>> > >>> > I am new to BaseX, I would like ot speed up XQuery of insert and > delete > >>> > and > >>> > replace through options. > >>> > >>> Welcome to the list. As there are numerous ways to do updates in > >>> BaseX, feel free to give us more information on your insert and delete > >>> operations. Do you work with large single documents or many small > >>> documents? How large is your database? > >>> > >>> > While I query basex through perl, and try to > >>> > connect through GUI, the perl connection aborts. Is there a > parameters > >>> > for > >>> > parallel connections, please let me know. > >>> > >>> I can?t tell why your perl connection is interrupted by opening the > >>> GUI (because they should be completely independent from each other). A > >>> step-by-step description on how you proceeded might be helpful. > >>> > >>> Because there is no coupling between GUI and the client/server > >>> architecture, however, you should avoid running updates outside the > >>> GUI. Please check out [1] for more information. > >>> > >>> Best, > >>> Christian > >>> > >>> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations > >>> > >>> > >>> > >>> > > >>> > Thanks, > >>> > Regards > >>> > Martin Lourduswamy > >> > >> > > > > > End of BaseX-Talk Digest, Vol 101, Issue 37 > ******************************************* >

2 1

about special characters
by BitRider001 22 May '18

22 May '18

Hi, I just joined the mailing list due to a problem I'm having displaying and storing special characters. I started with a CSV and created a database from it and the CSV is in UTF-8. However, when I query the special characters become garbled. I'm using the GUI in Windows 10. It starts with this in the CSV: <name>Cañelas</name> Then ends up with this when I export the query result into a text file: <name>ï£¼Caï¿½ï£¼las</name> Help please. Bit

5 10

Re: [basex-talk] BaseX performance improvements
by Christian Grün 20 May '18

20 May '18

> Java heap space at C:\Users\lourduswamym\oracle_scripts/BaseXClient.pm line > 213. How much memory have you assigned to BaseX [1]? > Actually the error on the server log. The insert operation was taking 1+minutes due to slow network and then the error happened. I have been running this server instance continuously for 1 day with continuous insert from a per script. If you create a new database, you can specify a directory with the files that are to be initially added to your database. This might save you a lot of time. > So I think I should be careful to run only one single process of client at a > time or make sure memory is enough to handle multiple client operations, > please let me know your thoughts, If your documents are small, you shouldn’t usually encounter any errors. But it might have to do with the large number of documents you are dealing with. One more option is to distribute your docs across multiple databases (you can access all of them via a single XQuery expression). Best, Christian [1] http://docs.basex.org/wiki/Start_Scripts > Thanks again, > Regards > Martin Lourduswamy > > On Sun, May 20, 2018 at 9:48 AM, Martin Lourduswamy <martin.louis(a)gmail.com> > wrote: >> >> Hi, >> >> Thanks for the clarifications. My database is >> >> DB Size: >> ====== >> 1. each XML node => 500 bytes >> 2. total size of XML DB => 10million nodes(which will grow continuously as >> new files are added). >> 3. I will be having multiple DB's of same size and more size as the DB >> continuously grows >> >> I have to do a update of the nodes as I need to replace them. I chose >> delete + insert instead of replace for each of the node through perl, as I >> will make sure there are no duplicate nodes left in the database.(just a >> precaution that even if some nodes get duplicated, through some other >> processes I will be able to remove them by delete) >> >> DB Speed: >> ======== >> I will disable logging as it might speed up the database operations. >> >> DB Architecture >> ============ >> 1 server(windows or Linux) running baseX >> multiple client computers trying to query the same machine for select >> through fn:doc(...) API to get the data through perl >> then do a delete + insert from perl >> >> I would like to know if you think this might work for production and any >> suggestion for data retrieval and update >> Any changes to the way I architecture it might help >> >> Also, I am thinking of indexing on the node id, as that is like the >> primary key on which I base my operations, any suggestions might also be >> helpful, >> Thanks again, >> Regards >> Martin Lourduswamy >> >> On Sun, May 20, 2018 at 9:28 AM, Christian Grün >> <christian.gruen(a)gmail.com> wrote: >>> >>> Hi Martin, >>> >>> > I am new to BaseX, I would like ot speed up XQuery of insert and delete >>> > and >>> > replace through options. >>> >>> Welcome to the list. As there are numerous ways to do updates in >>> BaseX, feel free to give us more information on your insert and delete >>> operations. Do you work with large single documents or many small >>> documents? How large is your database? >>> >>> > While I query basex through perl, and try to >>> > connect through GUI, the perl connection aborts. Is there a parameters >>> > for >>> > parallel connections, please let me know. >>> >>> I can’t tell why your perl connection is interrupted by opening the >>> GUI (because they should be completely independent from each other). A >>> step-by-step description on how you proceeded might be helpful. >>> >>> Because there is no coupling between GUI and the client/server >>> architecture, however, you should avoid running updates outside the >>> GUI. Please check out [1] for more information. >>> >>> Best, >>> Christian >>> >>> [1] http://docs.basex.org/wiki/Startup#Concurrent_Operations >>> >>> >>> >>> > >>> > Thanks, >>> > Regards >>> > Martin Lourduswamy >> >> >

1 0

Set indent no at database label (globally)
by DK Singh 18 May '18

18 May '18

Hi All, I have to set indent='no' at the database label how can i achieve this, i have gone thorough the documentation and found that either we can do: (1) declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization <https://www.google.com/url?q=http://www.w3.org/2010/xslt-xquery-serializati…> "; declare option output:indent "no"; but the problem is that all the XQUERY module i have library module so it is throwing error. so is there any option. Regards Dharmendra Kumar Singh

2 7

Re: [basex-talk] BaseX weird error
by halit tiryaki 18 May '18

18 May '18

I'm using the C# driver. but still, it doesn't look like a high level problem. neither a query problem. thats why I didn't post some code snippets. To make sure, I just tried to execute the INSPECT command in the CLI. same exception. Also the db:optimize fails with the same exception, although with a different stacktrace, which I will post below. Altough the race condition point of two processes interfering is a good point, I'm currently having trouble to do anything useful with a session from which a race condition would matter. If, then it must have happened while the import was running along with the other, non-importing process. As I mentioned in the first post, while the import process was still ongoing, the other process already started to have the exception at a very late progress of the import. After the import was done, I was still able to operate on the db as normal, but only with the session in the process which did the long-run import. To restore the second process its session state to normal, I restarted the webapplication, which closes both sessions. After that, I'm no longer to operate on the db. Not even directly from the CLI. Seems it is a sort of a persisted data state which the low level basex code can't handle when trying to reread it into to the memory. I 've already googled around for the same exception in BaseX, seems it was an issue in some older versions too. here the stacktrace when running db:optimize: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 9.0.2 beta Java: Oracle Corporation, 1.8.0_151 OS: Linux, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 52 at org.basex.util.hash.TokenSet.key(TokenSet.java:128) at org.basex.data.Data.name(Data.java:388) at org.basex.io.serial.Serializer.node(Serializer.java:414) at org.basex.io.serial.Serializer.node(Serializer.java:158) at org.basex.io.serial.Serializer.node(Serializer.java:345) at org.basex.io.serial.Serializer.node(Serializer.java:158) at org.basex.io.serial.Serializer.serialize(Serializer.java:109) at org.basex.core.cmd.OptimizeAll$DBParser.parse(OptimizeAll.java:200) at org.basex.build.Builder.parse(Builder.java:77) at org.basex.build.DiskBuilder.build(DiskBuilder.java:77) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:122) at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:124) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:157) at org.basex.query.QueryContext.iter(QueryContext.java:341) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) at org.basex.core.cmd.AQuery.query(AQuery.java:92) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:257) at org.basex.core.Command.execute(Command.java:93) at org.basex.server.ClientListener.run(ClientListener.java:140) On Wed, May 9, 2018 at 11:45 AM, Alexander Holupirek <alex(a)holupirek.de> wrote: > Hi, > > (please also respond to the list. Others might have suggestions as well > ;-) > > it still would be great if you could provide even more details. For > instance, what programming language do you use?Ideally include a Short, > Self Contained, Correct (Compilable), Example (SSCCE) [1] in order to let > people reproduce the behaviour. > > From a high level perspective, are you sure the sessions do not > interfere? Do you additionally work with BaseXGUI on the database, while > your program is importing? > > Cheers, > Alex > > > [1] http://sscce.org/ > > > On 9. May 2018, at 09:26, halit tiryaki <halit.tiryaki(a)gmail.com> wrote: > > > > hello, thanks for the fast response. > > > > It happened in the process of a large Import. There were two processes > with each a respective Session to BaseX. One process with the Open session > which did the Import was doing fine. The Second process however Starter > having the mentioned exception. After stopping Both processes and > restarting the app, no basex Session is now able to operate normal. > > > > The ArrayIndexOutOfBoundsException already comes in executing the > command INSPECT. > > > > The db-Info returns following: > > > > > > info db: > > Database Properties > > NAME: XXX > > SIZE: 5877 kB > > NODES: 124051 > > DOCUMENTS: 5497 > > BINARIES: 0 > > TIMESTAMP: 2018-05-09T05:20:44.000Z > > UPTODATE: false > > > > Resource Properties > > INPUTPATH: > > INPUTSIZE: 0 b > > INPUTDATE: 2018-05-09T04:32:10.539Z > > > > Indexes > > TEXTINDEX: true > > ATTRINDEX: true > > TOKENINDEX: false > > FTINDEX: false > > TEXTINCLUDE: /item_User/node()/User:Email > > ATTRINCLUDE: /item_UserImage/node()/UserImage:Id > > TOKENINCLUDE: > > FTINCLUDE: /item_XXX/node()/XXX:[german] > > LANGUAGE: English > > STEMMING: false > > CASESENS: false > > DIACRITICS: false > > STOPWORDS: > > UPDINDEX: true > > AUTOOPTIMIZE: false > > MAXCATS: 100 > > MAXLEN: 96 > > SPLITSIZE: 0 > > Alexander Holupirek <alex(a)holupirek.de> schrieb am Mi., 9. Mai 2018 > 08:44: > > Hi, > > > > could you please provide some more details? > > The best would be a reproducible example. > > > > Thanks, > > Alex > > > > > > > On 9. May 2018, at 06:50, halit tiryaki <halit.tiryaki(a)gmail.com> > wrote: > > > > > > Hello, > > > > > > got a serious problem here. any ideas? thanks > > > > > > Improper use? Potential bug? Your feedback is welcome: > > > Contact: basex-talk(a)mailman.uni-konstanz.de > > > Version: BaseX 9.0.2 beta > > > Java: Oracle Corporation, 1.8.0_151 > > > OS: Linux, amd64 > > > Stack Trace: > > > java.lang.ArrayIndexOutOfBoundsException: 4288 > > > at org.basex.io.random.TableDiskAccess.read1(TableDiskAccess.java:151) > > > at org.basex.data.Data.kind(Data.java:294) > > > at org.basex.query.value.node.DBNode$4.next(DBNode.java:332) > > > at org.basex.query.value.node.DBNode$4.next(DBNode.java:323) > > > at org.basex.query.expr.path.IterStep$1.next(IterStep.java:38) > > > at org.basex.query.expr.path.IterStep$1.next(IterStep.java:32) > > > at org.basex.query.QueryContext.next(QueryContext.java:392) > > > at org.basex.query.expr.path.IterPath$1.next(IterPath.java:50) > > > at org.basex.query.expr.path.IterPath$1.next(IterPath.java:34) > > > at org.basex.query.expr.ParseExpr.item(ParseExpr.java:58) > > > at org.basex.query.expr.ParseExpr.atomItem(ParseExpr.java:84) > > > at org.basex.query.func.fn.FnConcat.item(FnConcat.java:20) > > > at org.basex.query.expr.ParseExpr.value(ParseExpr.java:71) > > > at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:177) > > > at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:72) > > > at org.basex.query.expr.path.CachedPath.nodeIter(CachedPath.java:36) > > > at org.basex.query.expr.path.AxisPath.iter(AxisPath.java:69) > > > at org.basex.query.expr.gflwor.For$1.next(For.java:107) > > > at org.basex.query.expr.gflwor.OrderBy$1.sort(OrderBy.java:73) > > > at org.basex.query.expr.gflwor.OrderBy$1.next(OrderBy.java:54) > > > at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:72) > > > at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:177) > > > at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:87) > > > at org.basex.query.QueryContext.next(QueryContext.java:392) > > > at org.basex.query.scope.MainModule$1.next(MainModule.java:122) > > > at org.basex.core.cmd.AQuery.query(AQuery.java:94) > > > at org.basex.core.cmd.XQuery.run(XQuery.java:22) > > > at org.basex.core.Command.run(Command.java:257) > > > at org.basex.core.Command.execute(Command.java:93) > > > at org.basex.server.ClientListener.run(ClientListener.java:140) > > > >

2 6

Documentation inquiries
by Marco Lettere 16 May '18

16 May '18

Hi all, investigating the new features tagged 9.x, I discovered a lot of great stuff. I have teo smaller questions ... I'd like to know whether the new "-c flag" for the Basex Http Server in [1] means that one can request a script of commands to be executed once at startup of the server. Is there a way to do something equivalent also at server shutdown? In [2] with the new Service it is said that one could write jobs.xml file inside the database directory. I couldn't find the specification of the syntax of this file anywhere. Do you have some hints? Bye, Marco. [1] http://docs.basex.org/wiki/Command-Line_Options#HTTP_Server [2] http://docs.basex.org/wiki/Jobs_Module#Services

2 1