January 2013 - BaseX-Talk - mailman.uni-konstanz.de

Trying to learn BaseX
by Kenneth Ellested 05 Jan '13

05 Jan '13

Hi, I'm new to BaseX and researching it at the moment, and therefore I have a couple of questions starting to build up. 1. Modules seems to be compiled on every request in the GUI. Adding something like "funqtx" to the imported modules increases the query overhead by ~50ms. Is there a way to precompile modules, other than writing a native java plugin (or is this actually just a GUI designed feature, making you able to edit module files in between requests)? 2. What are collections good for as opposed to storing documents individually. I'm looking for a way to generate sequential ID's, and currently uses a method described on the list, where the count is hold in a containing node like <somecollection nextid="1234"><item id="1"> . <item id="1233"></somecollection> I'm not sure but I think I've seen other XML databases use document collections for keeping automated track of document id's - is there something similar for BaseX? 3. How do you make sure that you are not overwriting documents with stale data. Do you use locking attributes (optimistic locking)? 4. I like the idea of being able to reshape the data with greater ease in the future, but at the same time it's also a little scary to have data stored in a form that is not structured in terms of what values a field may take and so on. I know that XML schemas or DTD's might help in this, but what kind of impact can be expected when introducing such validation mechanisms (in particular on inserts and updates). I'm sure some of it depends on the complexity of the documents, but are the Schema for example cached so that it does not need to be read and parsed on each request? I'm generally impressed with the speed and feature set of BaseX, and I'm happy to see that you have also included Session variables to help in building web applications to run directly of the server. Unfortunately I will also need binary storage (load/save files over http) for the particular application that we have under development/design and I'm not sure whether this is possible in the current release (I've read something about XQuery only being able to handle UTF8). It's a little hard to search the mailing list (have you considered a forum J) for questions regarding specific areas of interest, so I hope that my questions are not already answered 300 times in the past - and please forgive me if that's the case. It would be of great help if there was more information on how to get started with designing an application for BaseX. I mean, when you still think RDBM's it's not obvious how to navigate and find solutions within the BaseX paradigms. It might help to see a real world BaseX application, addressing a classic application preferably including handling of errors, transactions and locking. Best regards Kenneth

2 1

example .basexperm files please
by pw＠themail.co.uk 03 Jan '13

03 Jan '13

hello list are there any examples of .basexperm files? what form are the permissions in? [i.e. 0777, or -rwxrwxrwx, or some other form] Is the separator a space or a tab? [does it matter?] thanks Pete

1 0

Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs
by David Stuebe 02 Jan '13

02 Jan '13

Hi Chris I did look at the Query Info in the Gui and it seems you are correct. The complex query I created is not utilizing the full text index. Details here: https://gist.github.com/4438473 The gist contains query info for the complex search that I created and for a simple one that just executes the 'contains text' clause. The compile statement for the simple query includes the following line: "applying full-text index" The complex query does not… So what to do now? How do I figure out why basex is not using the full text index as the initial step in limiting the results of my search? Thanks David From: "basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>" <basex-talk-request(a)mailman.uni-konstanz.de<mailto:basex-talk-request@mailman.uni-konstanz.de>> Reply-To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Date: Tue, 1 Jan 2013 06:00:02 -0500 To: "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: BaseX-Talk Digest, Vol 37, Issue 1 Message: 1 Date: Mon, 31 Dec 2012 20:56:01 +0100 From: Christian Gr?n <christian.gruen(a)gmail.com<mailto:christian.gruen@gmail.com>> To: David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> Cc: Kyle Wilcox <KWilcox(a)asascience.com<mailto:KWilcox@asascience.com>>, "basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>" <basex-talk(a)mailman.uni-konstanz.de<mailto:basex-talk@mailman.uni-konstanz.de>> Subject: Re: [basex-talk] Initial xquery for full text and geospatial search of ISO 19115 docs Message-ID: <CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q(a)mail.gmail.com<mailto:CAP94bnPneuWguMGL-k2ZMw6gCD4WQNc82KBR5es8h+BrZ1fs2Q@mail.gmail.com>> Content-Type: text/plain; charset=windows-1252 Hi David, thanks for the insight into your project. It may be that the full-text index is not utilized by your XQuery expression. Did you have a look at the query info (e.g. via GUI, InfoView, or -V on command line)? Did you manage to write simpler queries that are processed faster? Best, Christian ___________________________ On Mon, Dec 31, 2012 at 7:31 PM, David Stuebe <DStuebe(a)asascience.com<mailto:DStuebe@asascience.com>> wrote: Hi Basex Folks I have written a simple minded xquery script which can be used in a post to search ISO 19115 metadata documents. As I am a newbie to xquery and basex I expect that is much that I could do to improve performance, but currently searches take up to 15 seconds. The server hardware is not blazing fast and we are running inside tomcat? but that is certainly not acceptable for a database which is still quiet small. Initially it was fine, responding in less than a second, but when we expanded from less than 100 docs to about 35000 the time grew at least linearly. I am hoping this is due to my poor xquery programming or a setting on the server. Here is the query we are running using a post request with the declared variables at the bottom filled in by the UI: https://github.com/asascience-open/glos_catalog/blob/master/queries/full_se… Here are some of the ISO xml documents that we have in our basex DB: https://github.com/asascience-open/glos_catalog/tree/master/ISOs It is used by this site: http://explorer.glos.us/ To provide geospatial metadata search. Fill in a text value like "water" or "temperature" in the search box in the top right? The server is here: http://64.9.200.113:8080/BaseX73/ User Name: user Password: glos ACL: read only I am hoping it is as simple as a setting on the basex server. Here is the current server info: info database Database Properties Name: glos Size: 422 MB Nodes: 17045388 Documents: 34922 Binaries: 0 Timestamp: 27.12.2012 00:58:03 Resource Properties Timestamp: 22.12.2012 01:43:05 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON Full-Text Index: ON The index info is available here: https://github.com/asascience-open/glos_catalog/blob/master/queries/glos_in… David Stuebe Scientist & Software Engineer ? RPS ASA 55 Village Square Drive South Kingstown, RI 02879-8248 Tel: +1 (401) 789-6224 Email: David.Stuebe(a)rpsgroup.com<mailto:David.Stuebe@rpsgroup.com> www: asascience.com | rpsgroup.com A member of the RPS Group plc _______________________________________________ BaseX-Talk mailing list BaseX-Talk(a)mailman.uni-konstanz.de<mailto:BaseX-Talk@mailman.uni-konstanz.de> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

2 2

Fwd: concat string in for loop
by Jarosław Kowalewski 02 Jan '13

02 Jan '13

Hi, I've a problem with concatation strings in for loop. e.g. xquery concat("text",'
',"additional text"), '
', '
', for $i in <root><a>element-a</a><b>element-b</b></root>/* return concat($i,'
') give me the result " text additional text element-a element-b " with additional space before "element-a" and "element-b" but the concatation in the first row works fine. I tried it in GUI mode version 7.3 and 7.5. Jarek

2 1

how to know creation options of a database
by Fabrice Etanchaud 02 Jan '13

02 Jan '13

Dear all at BaseX, How can I know the creation options of a given database ? When I open a database created with a few non default options (MAXCATS set to 10000) for example, GET MAXCATS seems to always return the last value set with SET MAXCATS. Regards, Fabrice Etanchaud Questel-Orbit

2 3

UPDINDEX
by pw＠themail.co.uk 02 Jan '13

02 Jan '13

Hello List I am working with 7.5 and am looking for guidance on setting UPDINDEX If I run the basex http server from the command line and GET UPDINDEX it is initially false. If I then open the client and GET UPDINDEX it is also false (as expected). Through the client I can then set it with the command "set updindex true". This time GET UPDINDEX returns true through the client but false through the httpserver. How do I set the updindex option so that it it operational for the REST service? Thanks Peter

2 1

Re: [basex-talk] http server ... outsider localhost
by Andy Bunce 02 Jan '13

02 Jan '13

Peter, Good to know it worked. Christian, I think this change should be made to the github source /Andy On Tue, Jan 1, 2013 at 2:00 AM, <pw(a)themail.co.uk> wrote: > Andy > changing the default to 0.0.0.0 worked. Many thanks > > Peter > > ---- Original Message ---- > From: bunce.andy(a)gmail.com > To: pw(a)themail.co.uk > Subject: Re: [basex-talk] http server ... outsider localhost > Date: Mon, 31 Dec 2012 11:34:48 +0000 > > >Hi Peter, > >I wonder if this problem is related to a change I suggested to the > >webapps/WEB_INF/jetty.xml file. > >Do you still get the problem if you remove the line below and > >restart? > > <Set name="host"><SystemProperty name="org.basex.serverhost" > >default=""/></Set> > > > >Or if you change default="" to default="0.0.0.0" as suggested here > > > >http://osgeo-org.1560.n6.nabble.com/Cannot-connect-to-server-host-IP- > >unless-it-s-localhost-td3861103.html > > > >Regards > > > >/Andy > > > >On Sun, Dec 30, 2012 at 5:30 PM, <pw(a)themail.co.uk> wrote: > > > >> Hi Christian > >> > >> I just downloaded the BaseX 7.5 zip archive and ran the > >> httpserver.bat file ... On the local machine I was able to access > >> using the localhost or machine name as URLs, but access from > >> elsewhere on the network got to the Jetty server (it logged "access > >> denied") but apparently no further. > >> > >> Peter > >> > >> > >> > >> > >> > >> Hi Peter, > >> > >> the combination of BaseX and Jetty is successfully applied in many > >> productive client/server environments. Can you provide us with some > >> more details on how to reproduce the issue? > >> > >> > >> Thanks, > >> Christian > >> ___________________________ > >> > >> > hello list --- Happy Christmas & New Year > >> > > >> > If I run the http server (Basex 7.5) then I can access through > >> Jetty. > >> > When I try to access the same across the network I get nothing > >> > through and "Access denied" in the Basex logs. What's the > >solution? > >> > > >> > Many thanks > >> > Peter > >> > > >> > _______________________________________________ > >> > BaseX-Talk mailing list > >> > BaseX-Talk(a)mailman.uni-konstanz.de > >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> _______________________________________________ > >> BaseX-Talk mailing list > >> BaseX-Talk(a)mailman.uni-konstanz.de > >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> > >> > >> _______________________________________________ > >> BaseX-Talk mailing list > >> BaseX-Talk(a)mailman.uni-konstanz.de > >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > >> > > >

2 1

Re: [basex-talk] how to pass raw bytes intact?
by jidanni＠jidanni.org 02 Jan '13

02 Jan '13

Our mission today is to use Basex to remove tags injected right between the bytes of multibyte UTF-8 characters. http://www.couchsurfing.org/group_read.html?gid=430&post=13986932 >>>>> "CG" == Christian Grün <christian.gruen(a)gmail.com> writes: CG> Have you tried method=raw, as mentioned in our documentation CG> (http://docs.basex.org/wiki/Serialization)? Sorry. Try it yourself: echo '<A>你好</A>'|perl -pwle 's![^[:ascii:]]!$&<wbr/>!'|basex -q ' declare option db:parser "html"; declare option output:method "raw"; doc("/dev/stdin")//*:wbr/..' There is no way to cleanly restore the shattered UTF-8. I would also like to try declare option output:encoding "RAW"; or "BYTES" or "NONE" but on http://docs.basex.org/wiki/Serialization it just says "all encodings supported by Java" So one is supposed to look at http://www.google.com/search?q=all+encodings+supported+by+Java etc. etc. Why doesn't basex have a command that would output the current "all encodings supported by Java" that it is using.

3 7

XQuery Update using IF Condition...
by John Best 02 Jan '13

02 Jan '13

Dear Team, I am getting error - If expression : no updating expression allowed - while trying to update the "Data" DB. I need to update the DB, if it is not already updated... for $c in doc('2012')/Docs/Doc/No/@n return if (string-length(doc('Data')/Docs/Doc[No/@n=$c]/Title/Name/text()) eq 0) then insert node $c into doc('Data')/Docs else <l>{''}</l> -- Have a nice day JBest

2 1