November 2012 - BaseX-Talk - mailman.uni-konstanz.de

BXS - indexes - specifying the index and database location
by Alex Muir 29 Nov '12

29 Nov '12

Hi, I've created this bxs script which creates a db, however some things are not as expected. <?xml version="1.0" encoding="UTF-8"?> <commands> <drop-db name="S-1997"/> <create-db name="S-1997"/> <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/">/mnt/basex_volume/i4Base-Basex7.3/sample-data/1997/</add> <create-index type="fulltext"/> <optimize-all/> <info-db/> <info-index type="fulltext"/> <close/> </commands> I've written a script to call the bxs and create the database which it does however in this case it is not creating the indexes for fulltext as specified in the bxs and rather it is creating the text and attribute index. Why is that? [ec2-user@soda scripts]$ ./load-data-basex-locally.sh ../configuration/load-data-basex-locally.cfg Database Properties Name: S-1997 Size: 1718 KB Nodes: 51846 Documents: 4 Binaries: 0 Timestamp: 28.11.2012 15:23:26 Resource Properties Timestamp: 28.11.2012 15:23:25 Encoding: UTF-8 Whitespace Chopping: ON Indexes Up-to-date: true Text Index: ON Attribute Index: ON * Full-Text Index: OFF* Full-Text Index - Not available I run the script from the dir /mnt/basex_volume/i4Base-Basex7.3/scripts and I end up getting a directory structure created in the scripts folder as follows starting with fulltext. /mnt/basex_volume/i4Base-Basex7.3/scripts/*fulltext* /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997 I would like to store the database and indexes in /mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/ however I'm not clear on how to do this. I thought the <add path="/mnt/basex_volume/i4Base-Basex7.3/stores/sample-data/1997/"> would specify this Thoughts? Thanks -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 3

Re: [basex-talk] java hosting provider with BaseX
by Colin McEnearney 29 Nov '12

29 Nov '12

Hi Marco, Alex, I have run basex on dreamhost vps http://dreamhost.com/servers/vps/ using nginx (starts at $15/month 300MB ram, unlimited storage + bandwidth) but these look really interesting - will consider these for the future. Thanks! Date: Wed, 28 Nov 2012 23:02:10 +0100 Subject: Re: [basex-talk] java hosting provider with BaseX Hi Marco, i could setup BaseX on ? http://www.jvmhost.com/ ? https://openshift.redhat.com/app/ ? http://jelastic.com/ All the best, Alex On 28.11.2012, at 10:31, marco fregonese wrote: > Hi there, > I was wondering if there is any java web hosting provider supporting BaseX. > I couldn't find any so far. > Thanks. > Bye.

1 0

java hosting provider with BaseX
by marco fregonese 28 Nov '12

28 Nov '12

Hi there, I was wondering if there is any java web hosting provider supporting BaseX. I couldn't find any so far. Thanks. Bye.

2 1

Namespace prefix not accepted
by Buddy Butterfly 28 Nov '12

28 Nov '12

Hi, I just discovered the impressive basex via ubuntu packages store. First tests went OK until I used an XML with mixed namespaces. Some of the outer and the root node use the default namespace. Some inner namespace have a UML prefix. XPath selection selects and shows the results OK till the path comes to the prefix. Query info then shows prefix unknown. Is there a solution to it or is it a bug? Best regards, Matt

2 1

EXPath File Module within xqueries in oxygen?
by Alex Muir 27 Nov '12

27 Nov '12

Hi, So having the oxygen integration setup now, the next question that comes up which I'm not finding an answer for is can one use the EXPath File Module within xqueries in oxygen? I'm googling around,, I gather only basex that has implemented it from the website. http://expath.org/modules/file/implems I see that though that oxygen has a method to import modules but not sure where to get the module if that's the case. http://www.oxygenxml.com/xml_editor/xquery_editor.html I suppose it's not that important for use in oxygen but thought I would ask.. Regards -- - Alex G. Muir Software Engineering Consultant Linkedin Profile : http://ca.linkedin.com/pub/alex-muir/36/ab7/125 Love African Kora Music? Take a moment to listen to Gambia's - Amadu Diabarte & Jali Bakary Konteh www.bafila.bandcamp.com Your support keeps Africa's griot tradition alive... Cheers!

2 2

Re: [basex-talk] Database corruption
by Antoni Mylka 26 Nov '12

26 Nov '12

Hi Christian, Let's return with this discussion to the mailing list as I think this might be interesting for everybody. Summary: I had stability problems. In my tests, once BaseX reached certain size It would start throwing exceptions with stacktraces reaching deep into the low-level classes that shuffle the bits and bytes on disk. I now started a test run of our system with PARALLEL=1 and UPDINDEX=false. The system has been running without any exceptions for 17 hours. Starting with an empty data there have been almost 200K queries and commands. This is a record. Now, what exactly are the consequences of UPDINDEX being false. Can I do queries? What kind of queries I can't do? What kind of queries will be slower? Will the database rebuild the index automatically? When? What is the command to trigger an index rebuild manually. Is the index rebuild kind of a "stop-the-world" operation, so that BaseX will become unresponsive or will it be done in parallel. What are the benefits of the indices, can I live without them? -- Antoni Myłka Software Engineer basis06 AG, Birkenweg 61, CH-3013 Bern - Fon +41 31 311 32 22 http://www.basis06.ch - source of smart business ----- Ursprüngliche Mail ----- Von: "Christian Grün" <christian.gruen(a)gmail.com> An: "Antoni Mylka" <amy(a)basis06.ch> Gesendet: Dienstag, 20. November 2012 16:46:30 Betreff: Re: [basex-talk] Database corruption Hi Antoni, > I'll also try to run an experiment without UPDINDEX. yes, this would be interesting. I did some more testing with the given queries, but couldn’t encounter something noteworthy so far.. Thanks, Christian

2 3

HTTP module - authorization
by Hans-Juergen Rennau 23 Nov '12

23 Nov '12

Hello, I have a question about the HTTP module and authorization. Is digest authorization supported, or is it only possible to provide basic access authorization? Thank you, Hans-Juergen

2 1

Re: [basex-talk] Unable to integrate with oxygen to run xquery
by Charles Foster 23 Nov '12

23 Nov '12

Hi Alex, Have you tried using BaseX XQJ 1.2.3 [1]? I suggest downloading the zip file on the xqj.net site and giving Oxygen all of the jars contained within the zip. The XQDataSource class you will need to use within Oxygen is "net.xqj.basex.BaseXXQDataSource", if you have further problems, please let me know. Regards, Charles [1] http://xqj.net/basex > Hi Michael, > > I'm seeing that I was doing things in a way that probably was not > recommended. > > I had: > > 1. installed jetty sudo yum install jetty > 2. downloaded the war file to /usr/share/jetty/webapps/BaseX73.war > 3. Create context xml here /usr/share/jetty/contexts/contexts/BaseX73.xml > 4. started the server cd /usr/share/jetty/ and java -jar start.jar > > This gave me access through at 8080 and I've been loading data using curl > calls without issue. I had been using the jar file standalone and so I > thought using the war file in a similar way would be fine. I suppose it > might but I could not connect using oxygen this way. > > I've since changed my approach to using the complete basex distribution > although I've run into a few other issues. I suppose the first was that > oxygen was asking for woodstox-core jars so I downloaded those and added > them to the lib directory. Secondly the complete distribution doesn't come > with the basex-xqj-0.9.2.jar so I've put that into the lib with the other > jars, it makes me wonder though if the instructions "Add the following JAR > files above with the *Add* Button: xqj-api-1.0.jar, xqj2-0.0.1.jar and > basex-xqj-0.9.2.jar (the version names of the JAR file may differ) " are > accurate give only the first 2 files are included in the zip. > > Finally now I'm getting an error "Description: Could not initialize class > net.xqj.basex.bin.m" I'm not sure how to resolve this one although I > assume I'm missing something. > > I've started the server using the gui, loaded files into a db and used the > gui server administration interface to start the server. > > Thoughts? > > Thanks Much > Alex

2 2

try catch with return?
by bryan rasmussen 23 Nov '12

23 Nov '12

Hi, I'm getting the following: Error: Stopped at line 1, column 73: [XPST0003] Expecting 'where', 'order' or 'return' expression. Query: for $doc in db:open('dk') let $dates := $doc//DATO for $date in $dates try{ return <gooddate>{xs:date($date)}</gooddate> } catch *{ return <baddate docid="{$doc/*/@ID}">{$date}</baddate>} I wanted to basically to return all DATO elements with document ids that were not valid xs dates, and figured a try catch with returns in it were the best option. Is that not allowed or have I made some basic error? If it's not allowed how would you handle it? Note it is not really realistic to do something like catch these errors in validation since they've already been past the validation process, first I'd have to do a lot of work to write a schema that handled the document structure since there are a lot of mixed content possibilities (or add new validation language etc.), second I'd have to have it in my validation pipeline and the several hundred thousand large documents would have to be run through the pipeline again just to find a few thousand malformed dates that anyway are currently not used for anything important (but of course if we make them valid date then they can start being used for stuff) at any rate handling it with XQuery seems the best solution. Thanks, Bryan Rasmussen

2 1

FLWOR window clause
by Hans-Juergen Rennau 23 Nov '12

23 Nov '12

Hello, are there already any plans for implementing the XQuery 3.0 feature "window clause in FLWOR expressions"? It seems to me so interesting as it allows the creation and evaluation of "self describing item streams", that is, streams of XDM items with interspersed control items which define and annotate sub units (windows) of the stream total, thus effectively translate the stream of items into a stream of larger units, in analogy to XML tags which translate a stream of characters into a stream of information items... Thank you, Hans-Juergen

2 1