September 2015 - BaseX-Talk - mailman.uni-konstanz.de

sql error
by michele.greco2＠email.it 05 Sep '15

05 Sep '15

Hi, I wrote this xquery,who want to save the query result in myql.   declare namespace pkg="http://schemas.microsoft.com/office/2006/xmlPackage"; declare namespace w="http://schemas.openxmlformats.org/wordprocessingml/2006/main"; sql:init("com.mysql.jdbc.Driver"), let $conn:= sql:connect("jdbc:mysql://localhost:3306/DbName","user","password") return (let $q:= "insert into person values("","||nome||","","","","","","")" return sql:execute($conn,$q)), for $document in collection("curriculum") let $c:= document-uri($document) order by $c return <nome> {for $e in doc($c)//w:tc[.//text()="Nome"]  return $e/./following::text()except   (for $x in doc($c)//w:tc[.//text()="Indirizzo"] return $x//following::text()) }</nome>     but this is my error: [XPDY0002] nome: no context value bound. where am i wrong? -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Registra i domini che desideri ed inizia a creare il tuo sito web Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13323&d=5-9

3 2

Re: [basex-talk] size on collection in the time
by Christophe Marchand 03 Sep '15

03 Sep '15

James, you are right, OPTIMIZE ALL solves the problem. The txt.basex was growing at each replace, other files staying almost identical. Thanks a lot ! Best regards, Christophe Le 03/09/2015 21:20, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Xquery collections (michele.greco2(a)email.it) > 2. Re: Xquery collections (Dirk Kirsten) > 3. Re: size on collection in the time (Marc) > 4. Re: size on collection in the time (Christophe Marchand) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 3 Sep 2015 17:48:23 +0200 > From: michele.greco2(a)email.it > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] Xquery collections > Message-ID: <22e8f2f70298a35093e933ab65f26489(a)wm10.email.it> > Content-Type: text/plain; charset="iso-8859-1" > > > Hello I Michele i'm new to basex, > i created a collection with different documents .xml. > I want to know how to query the entire collection e its documents at one > xquery. > I'm trying,but i can't. >   > Thanks. > MG > >   > > > > > > > -- > ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli > Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… > > Sponsor: > Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, sincronizzazione dati e backup > Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13324&d=3-9 >

1 0

Re: [basex-talk] size on collection in the time
by Christophe Marchand 03 Sep '15

03 Sep '15

James, you are right, OPTIMIZE ALL solves the problem. Thanks a lot ! Best regards, Christophe Le 03/09/2015 21:20, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Xquery collections (michele.greco2(a)email.it) > 2. Re: Xquery collections (Dirk Kirsten) > 3. Re: size on collection in the time (Marc) > 4. Re: size on collection in the time (Christophe Marchand) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 3 Sep 2015 17:48:23 +0200 > From: michele.greco2(a)email.it > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] Xquery collections > Message-ID: <22e8f2f70298a35093e933ab65f26489(a)wm10.email.it> > Content-Type: text/plain; charset="iso-8859-1" > > > Hello I Michele i'm new to basex, > i created a collection with different documents .xml. > I want to know how to query the entire collection e its documents at one > xquery. > I'm trying,but i can't. >   > Thanks. > MG > >   > > > > > > > -- > ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli > Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… > > Sponsor: > Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, sincronizzazione dati e backup > Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13324&d=3-9 >

1 0

Re: [basex-talk] size on collection in the time
by Christophe Marchand 03 Sep '15

03 Sep '15

Hi Dirk, attached a simple test-case to reproduce the problem. data.xml is a file that contains attributes and text. Each time you run run.sh, data.xml is re-created, with current-dateTime() in. So each time, the file content is changed. The file size does not change (date format ensures it). reload.bxs deletes the file from the collection and add it back to the collection. run.sh displays the size of files in the collection. Each time you start run.sh, file size grows. You need to modify run.sh to set the correct directories locations. You have to add saxon9he.jar to run it. I hope this will help, Christophe Le 03/09/2015 15:27, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Re: size on collection in the time (Marc) (cmarchand(a)oxiane.com) > 2. Re: Unexpected error: Improper use? Potential bug? > (Pierre-Yves JALLUD) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Thu, 03 Sep 2015 14:59:53 +0200 > From: cmarchand(a)oxiane.com > To: basex-talk(a)mailman.uni-konstanz.de > Subject: Re: [basex-talk] size on collection in the time (Marc) > Message-ID: <2fe47eb3ff5f77da91888afed19d2d72(a)oxiane.com> > Content-Type: text/plain; charset="us-ascii" > > > > I confirm the problem : on another database (same data, same script.xbs, > different server), we have exactly the same problem : the database grows > each time the script is run. > > I'm going to prepare a test-case with small public data tonight. > > Best regards, > > Christophe > > Hello Dirk, > We use a BaseX script (.xbs) with a list of REPLACE. > We try to investigate this point if this is reproducable or not. > If I find this problem again, I take a copy of the collection before to > delete her. > > Thank you for answer. > > Marc > Le 03/09/2015 09:52, Dirk Kirsten a ?crit : > >> Hello Marc, >> >> sure, a replace should lead to a true replace, i.e. the old data will be >> dropped. So this sounds like a bug, but it is difficult to replicate >> from what you describe. >> >> Do you think it would be possible to make the issue reproducable, maybe >> also with a smaller data set? Also, how exactly do you add documents or >> do you also do any queries and maybe other updating queries? >> >> Cheers >> Dirk >> >> On 09/02/2015 05:36 PM, Marc wrote: >> >>> Hi, >>> I have a remark about the size of the files of a collection. >>> We do a lot of updates (REPLACE) with an attributes index but without >>> a text index. >>> I see that the size of the files grows up in the time we arrive until >>> 30Go until the limit of the filessytems quota. >>> When I drop the collection and recreate it from the last version of >>> the files the size was only 6Go. >>> >>> We will redo the test with the time, but I just want to know if the >>> program clears the disk use when he does a REPLACE? >>> >>> Marc > ------------------------------ > > Message: 4 > Date: Thu, 3 Sep 2015 10:01:05 +0200 > From: Marc <Marc.Liste(a)free.fr> > To: Dirk Kirsten <dk(a)basex.org> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] (no subject) > Message-ID: <55E7FE41.5080205(a)free.fr> > Content-Type: text/plain; charset=iso-8859-15; format=flowed > > I forgot to give this precision, we use the 7.9 version on this server. > > Marc > Le 01/01/1970 01:00, a ?crit : > >> Hello Dirk, >> We use a BaseX script (.xbs) with a list of REPLACE. >> We try to investigate this point if this is reproducable or not. >> If I find this problem again, I take a copy of the collection before to >> delete her. >> >> Thank you for answer. >> >> Marc >> Le 03/09/2015 09:52, Dirk Kirsten a ?crit : Hello Marc, >> >> sure, a replace should lead to a true replace, i.e. the old data will be >> dropped. So this sounds like a bug, but it is difficult to replicate >> from what you describe. >> >> Do you think it would be possible to make the issue reproducable, maybe >> also with a smaller data set? Also, how exactly do you add documents or >> do you also do any queries and maybe other updating queries? >> >> Cheers >> Dirk >> >> On 09/02/2015 05:36 PM, Marc wrote: Hi, >> I have a remark about the size of the files of a collection. >> We do a lot of updates (REPLACE) with an attributes index but without >> a text index. >> I see that the size of the files grows up in the time we arrive until >> 30Go until the limit of the filessytems quota. >> When I drop the collection and recreate it from the last version of >> the files the size was only 6Go. >> >> We will redo the test with the time, but I just want to know if the >> program clears the disk use when he does a REPLACE? >> >> Marc > End of BaseX-Talk Digest, Vol 69, Issue 5 > ***************************************** >

1 0

Re: [basex-talk] size on collection in the time
by James Ball 03 Sep '15

03 Sep '15

Marc, Are you using the updatable index? UPDINDEX true. If so, if you look back through the list Christian and I had an exchange on this as I was experiencing an ever growing index - a replace always appended to the end of the index. IIRC the logic is a bit better now in that if on a replace there is enough room in the index structure to reuse slots it will, but if not it will be appended. And the db will reuse empty slots while the database remains open. I can’t remember which is the first version where this change was made, sorry. I had a DB the other day that had got to 14GB but was only around 600MB once I did a full optimise. My suggestion is next time to try a full optimise instead of dropping the collection and see if that helps. Regards, James > > Message: 1 > Date: Wed, 2 Sep 2015 17:36:19 +0200 > From: Marc <Marc.Liste(a)free.fr> > To: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] size on collection in the time > Message-ID: <55E71773.7050102(a)free.fr> > Content-Type: text/plain; charset=iso-8859-15; format=flowed > > Hi, > I have a remark about the size of the files of a collection. > We do a lot of updates (REPLACE) with an attributes index but without a > text index. > I see that the size of the files grows up in the time we arrive until > 30Go until the limit of the filessytems quota. > When I drop the collection and recreate it from the last version of the > files the size was only 6Go. > > We will redo the test with the time, but I just want to know if the > program clears the disk use when he does a REPLACE? > > Marc

2 1

Xquery collections
by michele.greco2＠email.it 03 Sep '15

03 Sep '15

Hello I Michele i'm new to basex, i created a collection with different documents .xml. I want to know how to query the entire collection e its documents at one xquery. I'm trying,but i can't.   Thanks. MG   -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Caselle con tuo dominio su piattaforma Zimbra, fino a 30 GB di spazio, sincronizzazione dati e backup Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13324&d=3-9

2 1

Basex 8.2.3 data not shown, until OS restart
by Mansi Sheth 02 Sep '15

02 Sep '15

Hello, This is something very weird. I import bunch of XML files, into this latest version of based using Java API. When trying to access this data (via basex command line client or REST), doesn't show any databases at all. These databases shows up only after restarting OS. Is this a known issues ? or just me ? - Mansi

2 1

Finding document based on filename
by Mansi Sheth 01 Sep '15

01 Sep '15

Hello, I would be having 100s of databases, with each database having 100 XML documents. I want to devise an algorithm, where given a part of XML file name, i want to know which database(s) contains it, or null if document is not currently present in any database. Based on that, add current document into the database. This is to always maintain latest version of a document in DB, and remove the older version, while adding newer version. So far, only way I could come up with is: for $db in all-databases: open $db $fileNames = list $db for eachFileName in $fileNames: if $eachFileName.contains(sub-xml filename): add to ret-list-db return ret-list-db Above algorithm, seems highly inefficient, Is there any indexing, which can be done ? Do you suggest, for each document insert, I should maintain a separate XML document, which lists each file inserted etc. Once, i get hold of above list of db, I would be eventually deleting that file and inserting a latest version of that file(which would have same sub-xml file name). So, constant updating of this external document also seems painful (Map be ?). Also, would it be faster, using XQUERY script files, thru java code, or using Java API for such operations ? How do you all deal with such operations ? - Mansi

4 5

Selective indexes
by Martín Ferrari 01 Sep '15

01 Sep '15

Hi Dirk, I didn't want to hijack the other thread, so I started a new one :) I've read https://github.com/BaseXdb/basex/issues/59 and I think it's great!. I have a slightly different request though that I was holding back because I didn't want to sound abusive, but now that you brought it up... I might be mistaken as I haven't really debugged the code, but I believe that indexing could maybe take so long (for our use case anyway) because it indexes all the values in the xml documents. So I wonder whether it would be beneficial for the indexing speed to be able to state which specific fields to index instead of all of them. This would allow for having fast regularly used queries, without impacting insertions that much. I can explain our use case quickly: we store XML files that are interchanged with third parties. We have lots of them all the time, so insertion speed is critical. Query speed on the other hand is not critical, though obviously having fast queries is a lot better than having slow ones. But it becomes more important as the queries lock the db for writing too, aside from feeling "if I just could index this one field", hehe. If we could just index the fields that we run most of our queries against, it would be perfect. Right now, I think we can get away with organizing resources inside directories and that would be enough as that seems to work perfectly (we'll perform a couple more tests with high volume), but I thought it would be really cool if we could have a similar insertion speed to what's achieved without indexing, by just indexing some fields (again, *guessing* that the cause of the decrease in speed is due to indexing all fields in the documents, which may or may not be the case). Thanks! Martín.

2 2

Re: [basex-talk] BaseX and MySQL: Driver can't be initialized
by Ulrike Schaper - SideStep Business Solutions GmbH 01 Sep '15

01 Sep '15

Thanks everybody, starting the GUI from command line did the trick. Best regards, Ulrike.

1 0