April 2015 - BaseX-Talk - mailman.uni-konstanz.de

GUI feature request "Add as import"
by Andy Bunce 03 Jan '16

03 Jan '16

Hi, I often find myself adding module imports in the GUI and I wonder if the following suggestion might speed up that process. Add a new menu item to the filelist right click context menu "Add as import" when the file selection is a XQuery module. The action would be to add a line to the current edit window source with import module namespace {$prefix} = '{$namespace}' at {$path}; Where $prefix and $namespace} are read from the source of the selected file, and $path is calculated from the relative path from the edit file source to the selected filelist source. The line would be inserted at a suitable place in the prologue or at the current location if that is too tricky. /Andy

2 4

Slow query
by Menashè Eliezer 03 Aug '15

03 Aug '15

Hello, I wonder if the attached query can be optimised. I'm attaching all relevant information. Basex 7.9, Debian, powerful server. This is just an example. The queries will be built based on a compilation of a search form. So reordering the conditions for having smaller subset right from the begging isn't relevant. Any help would be appreciated. 40 seconds are not acceptable. -- With kind regards, Menashè

2 45

Position of matched tokens in a full-text query
by Javier Couto 22 May '15

22 May '15

Hi, Sorry if this is too basic, but I’m trying to get the positions of the matched tokens in a full-text query, and I can’t find the way to do it. I imagine something like: for $sentence in //sentence where $sentence[text() contains text { ‘DNA', ‘oxidation' }] return <positions>ft:SOME-FUNCTION-FOR-TOKENS-POSITIONS($sentence[text() contains text { ‘DNA', ‘oxidation' }])</positions> Is this possible? Thank you in advance, Javier

3 10

Bug in declare base-uri
by Hans-Juergen Rennau 18 May '15

18 May '15

Dear BaseX team, I think there is a bug in the determination of the static base URI in the special case that a base URI declaration contains a relative URI equal to or starting with "..". Consider this declaration:declare base-uri ".."; The effect should be that relative URIs are resolved against the PARENT directory of the directory containing the query. If the query is located at, say, file:///a/b/c/query.xq, I would expect the static base-uri to be /a/b/, so that a URI like "abc.xml" would be resolved to file:///a/b/abc.xml. However, the static base URI as determined by BaseX in this case misses the trailing /, it is: file:///a/bThe effect is that a URI like "abc.xml" would be resolved to file:///a/abc.xmlIn other words: URIs are resolved against the "GRAND-PARENT" directory of the query. Final remark: the effect of resolving URIs against the parent directory of the query is achieved by the surprising base URI declaration: declare base-uri "."; which is not what I would expect. Conclusion: the way to achieve a resolving of relative URIs against the parent directory of the query should be achieved by the base URI declaration ".." - and no other value. Kind regards,Hans-Juergen Full example:Query ( file file:///projects/infospace/pcol/test.xq); declare base-uri ".."; declare variable $uri external; string-join(( 'query-file: file:///projects/infospace/pcol/test.xq', concat('static-base-uri: ', static-base-uri()), concat('resolve-uri("try.xml")=', resolve-uri("try.xml")) ), '
') Output:query-file: file:///projects/infospace/pcol/test.xq static-base-uri: file:///C:/projects/infospace resolve-uri("try.xml")=file:/C:/projects/try.xml

2 4

Running commands on BaseX on Tomcat
by Kristian Kankainen 06 May '15

06 May '15

Hello! I have BaseX 8.11 running on Tomcat and need to execute some commands or XQuery for deploying xml files from elsewhere. I allready have a XQuery function for this and can do it on my local setup using for example the basexclient. My problem is that the Tomcat is available only through HTTP and I wouldn't like to open up the function for the outside world using RESTXQ. Is there a way to "talk" with the BaseX in the Tomcat? I have full access to the machine via SSH. Another way I thought of would be to just upload the data folder from my local setup, but it doesn't feel the right way to do it. Best regards Kristian K

2 10

Querying a subset
by Menashè Eliezer 04 May '15

04 May '15

Hello, I'm using Java org.xmldb.api package for accessing the Basex server (xmldb:basex://...) After getting the resultSet I need to make further queries about the requested subset (for reporting, etc.) I have seen that getId() cannot be used since the Resource will be anonymous if it is obtained as the result of a query. Source: http://xmldb-org.sourceforge.net/xapi/api/index.html The queries are not fixed and are based on end user selection. I couldn't find a way to have a direct access/reference to a document. In my case the ID is simply the filename, but it doesn't seem to be so efficient. I wonder if creating a temporal collection for the subset would be faster than making query/queries similar to the following example in which there are only two ids, but I can have thousands of them: let $ids := ('360836','300139') for $x in collection("collection_name") let $filename := substring-after(base-uri($x),'/') let $id := substring-before($filename,'.') where $id = $ids return ... -- With kind regards, Menashè

2 5

Poor runtime performance of node insertion in BaseX 8.1.1 (compared to BaseX 7.6)
by Werner Dworaczek 03 May '15

03 May '15

Hi Christian, I have found that BaseX 8.1.1 has a very poor performance in comparison to BaseX 7.6 regarding inserting XML elements into an XML document. In my application I very often add new data to the DB by using a construct like this insert node local:recordsWithObjectType(‚Type') into /rootDoc local:recordsWithObjectType() is an xQuery function returning typically several thousand XML nodes which has to be inserted info a given root document. Running this kind of stuff on BaseX 7.6 I typically have a runtime of 500 ms when adding round about 3.000 nodes. Running the exact same stuff on BaseX 8.1.1 (same data) the runtime is about 5.000 ms (factor 10 more). Is there a way to boost the insert performance in BaseX 8.1.1 to a value comparable to BaseX 7.6? Thanks in advance, Werner

2 1

BaseX trace() output
by cmarchand＠oxiane.com 30 Apr '15

30 Apr '15

in basexGui, running trace((),'foo') displays this in Info panel : Evaluating: - fooempty-sequence() Query: trace((),'foo') Result: - Hit(s): 0 Items - Updated: 0 Items - Printed: 0 Bytes - Read Locking: none - Write Locking: none Timing: - Parsing: 0.75 ms - Compiling: 0.05 ms - Evaluating: 0.35 ms - Printing: 0.27 ms - Total Time: 1.43 ms Query plan: <QueryPlan> <FNInfo name="trace(value,label)"> <Empty size="0"/> <Str value="foo" type="xs:string"/> </FNInfo> </QueryPlan> There is no output, but in the query plan. Is this what is expected ? Le 2015-04-30 12:00, basex-talk-request(a)mailman.uni-konstanz.de a écrit : > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk [1] > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > Today's Topics: > > 1. Re: Database files across multiple directories > (julia.jacobson(a)arcor.de) > 2. Re: Database files across multiple directories (Christian Gr?n) > 3. Re: Where are the debugging infos emit by trace(...) > (Christian Gr?n) > 4. Re: Database files across multiple directories (Goetz Heller) > 5. Running commands on BaseX on Tomcat (Kristian Kankainen) > 6. Re: Running commands on BaseX on Tomcat (Christian Gr?n) > > ---------------------------------------------------------------------- > > Message: 1 > Date: Wed, 29 Apr 2015 17:59:53 +0200 (CEST) > From: julia.jacobson(a)arcor.de > To: basex-talk(a)mailman.uni-konstanz.de > Cc: heller(a)hellerim.de > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: > <1680192231.162639.1430323193071.JavaMail.ngmail(a)webmail22.arcor-online.net> > > Content-Type: text/plain; charset=ISO-8859-1 > > Thanks a lot for your answers so far. What I was thinking of as a use case are many small xml-Documents in many different (sub)directories that should be used together as one database, like for example one xml file for one address and address arranged into folders according to towns so one would have 9 xml files in a folder named "berlin" and 5 ones in another folder named "munich" and so on. > Does BaseX create an index of these files so that I could for example query for example for persons with the same name? If I want to change something in these files, will the changes be also made in the xml documents? > > Kind regards, > Julia > > ------------------------------ > > Message: 2 > Date: Wed, 29 Apr 2015 18:14:56 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: julia.jacobson(a)arcor.de > Cc: Goetz Heller <heller(a)hellerim.de>, BaseX > <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: > <CAP94bnMhv9j1CNP0x-ovEh-jAH-6gT=Xydk48mtU+mynLQQZoQ(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Julia, > >> Does BaseX create an index of these files so that I could for example query for example > for persons with the same name? > > BaseX will create a database from these files. This can e.g. be done > by starting the GUI, choosing "Database" ? "New?", selecting your XML > directory, and pressing OK. > > All documents will then be stored, and the textual contents will be > indexed. Next, you can use XQuery, which is not only a query language, > but a powerful programming language, to do all kinds of things with > the data. See e.g. [1 [2]] or [2 [3]] for some examples. You probably don't > want to do that by yourself, but XQuery can be used to write full web > applications. > >> If I want to change something in these files, will the changes be also made in the xml documents? > > Currently, there is no automatic synchronisation between databases and > local file directories, so you'll either have to export the database > after updates, or create a new database after files have been changed. > > Cheers, > Christian > > [1] http://docs.basex.org/wiki/XQuery_3.0 [4] > [2] http://www.w3schools.com/xquery/ [3] > > If I want to change something in these files, will the changes be > also made in the xml documents? > >> Kind regards, >> Julia > > ------------------------------ > > Message: 3 > Date: Wed, 29 Apr 2015 18:25:21 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: cmarchand <cmarchand(a)oxiane.com> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Where are the debugging infos emit by > trace(...) > Message-ID: > <CAP94bnMnA7Sb6LbRHpi0fLp-ODpqr-XmR0munVVN8Jqh8z2G4w(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Christophe, > >> I'm looking for the trace() output in gui and server mode... I've checked >> System.out / System.err, but nothing. > > In the client/server mode, trace output will be redirected to the > client (try -V on command-line, or use SET QUERYINFO ON and > query.info() when using one of the bindings). In the GUI, the output > wil be visible in the Info panel. > > Hope this helps, > C. > > ------------------------------ > > Message: 4 > Date: Wed, 29 Apr 2015 19:37:47 +0200 > From: "Goetz Heller" <heller(a)hellerim.de> > To: <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Database files across multiple directories > Message-ID: <00ec01d082a3$35b09730$a111c590$(a)hellerim.de> > Content-Type: text/plain; charset="iso-8859-1" > > Hi Julia, > this looks to me as if you had hybrid data - some relational (tabular) data > (addresses etc.) and other semi-structured data. If so, then think about > storing the tabular data in a relational database management system (RDBMS) > like Maria SQL or MS SQL Server and accessing it from within your xQueries. > This is something which can be achieved very easily since the BaseX > implementation accommodates adding Java code to your queries simply by > dropping your jar files into the lib directory and adding a namespace > declaration to the prolog of your query - it's just a snap. You can do > anything you want with the relational data - insert, update, delete, and, of > course, select, you can run stored procedures, and still access your XML > data as easily, combine results from both sources, create great reports, and > so on. > > Think of xQuery as a domain-specific language (DSL) for querying XML data, > just as SQL is a DSL for dealing with relational data, which you can enhance > according to your needs. > > If you need to modify only the relational part of the data, you can do this > easily via the RDBMS since this is standard, and BaseX still remains the > perfect choice for handling the XML part of your data. Although many RDBMSs > offer also some XML and even xQuery functionality, compared to a system like > BaseX this is only rudimentary. E.g. Oracle and SQL Server implement only > xQuery 1.0, and even this only partially. > > I did something similar with BaseX and SQL Server, and - just as a proof of > concept - also with Oracle. E.g., you can create SQL code with xQuery on the > fly so it incorporates current context data, and pass it to some generic > database access function. With JDBC, you've got the glue to connect to a > wide range of database servers. > > I did not figure out whether you can make a database server and BaseX > participate in the same distributed transaction because I had no necessity > to do so; maybe Christian can tell you something more about it. > > Kind regards, > > Goetz > > -----Urspr?ngliche Nachricht----- > Von: julia.jacobson(a)arcor.de [mailto:julia.jacobson@arcor.de] > Gesendet: Mittwoch, 29. April 2015 18:00 > An: basex-talk(a)mailman.uni-konstanz.de > Cc: heller(a)hellerim.de > Betreff: Re: [basex-talk] Database files across multiple directories > > Thanks a lot for your answers so far. What I was thinking of as a use case > are many small xml-Documents in many different (sub)directories that should > be used together as one database, like for example one xml file for one > address and address arranged into folders according to towns so one would > have 9 xml files in a folder named "berlin" and 5 ones in another folder > named "munich" and so on. > Does BaseX create an index of these files so that I could for example query > for example for persons with the same name? If I want to change something in > these files, will the changes be also made in the xml documents? > > Kind regards, > Julia > > ------------------------------ > > Message: 5 > Date: Thu, 30 Apr 2015 10:12:23 +0300 > From: Kristian Kankainen <kristian(a)keeleleek.ee> > To: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: [basex-talk] Running commands on BaseX on Tomcat > Message-ID: <5541D5D7.5000301(a)keeleleek.ee> > Content-Type: text/plain; charset=utf-8; format=flowed > > Hello! > > I have BaseX 8.11 running on Tomcat and need to execute some commands or > XQuery for deploying xml files from elsewhere. I allready have a XQuery > function for this and can do it on my local setup using for example the > basexclient. > > My problem is that the Tomcat is available only through HTTP and I > wouldn't like to open up the function for the outside world using > RESTXQ. Is there a way to "talk" with the BaseX in the Tomcat? I have > full access to the machine via SSH. Another way I thought of would be to > just upload the data folder from my local setup, but it doesn't feel the > right way to do it. > > Best regards > Kristian K > > ------------------------------ > > Message: 6 > Date: Thu, 30 Apr 2015 10:47:23 +0200 > From: Christian Gr?n <christian.gruen(a)gmail.com> > To: Kristian Kankainen <kristian(a)keeleleek.ee> > Cc: BaseX <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] Running commands on BaseX on Tomcat > Message-ID: > <CAP94bnNjxDFGo8ttNeE0c4v7FfYgCoDtHc=K-fDgZo=RNC65Lw(a)mail.gmail.com> > Content-Type: text/plain; charset=UTF-8 > > Hi Kristian, > >> My problem is that the Tomcat is available only through HTTP and I wouldn't >> like to open up the function for the outside world using RESTXQ. Is there a >> way to "talk" with the BaseX in the Tomcat? > > Have you already thought about adding the DBA interface [1 [2]]? It might > be extended with new functionality to store and invoke server-side > code, and you can already use it to run arbitrary XQuery expressions. > > Another choice is our classical REST interface, which can also be used > to run server-side queries or command scripts. > > Just remember that these interfaces can potentially be accessed by > other people as well, even those who are not supposed to access it, so > you should e.g. change the default admin password, etc. > > Best, > Christian > > [1] http://docs.basex.org/wiki/DBA [2] > > I have full access to the > >> machine via SSH. Another way I thought of would be to just upload the data >> folder from my local setup, but it doesn't feel the right way to do it. >> >> Best regards >> Kristian K > > End of BaseX-Talk Digest, Vol 64, Issue 58 > ****************************************** Links: ------ [1] https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk [2] http://docs.basex.org/wiki/DBA [3] http://www.w3schools.com/xquery/ [4] http://docs.basex.org/wiki/XQuery_3.0

2 1

Re: [basex-talk] Database files across multiple directories
by Goetz Heller 29 Apr '15

29 Apr '15

Small correction; I should have said "reference each database with doc()" instead of "open each database". My apologies. Kind regards, Goetz

3 3

Where are the debugging infos emit by trace(...)
by cmarchand＠oxiane.com 29 Apr '15

29 Apr '15

!hi ! I'm looking for the trace() output in gui and server mode... I've checked System.out / System.err, but nothing. Any idea ? Christophe

2 1