April 2010 - BaseX-Talk - mailman.uni-konstanz.de

Release BaseX 6.1
by Christian Grün 18 Apr '10

18 Apr '10

Dear all, once more, we are delighted to announce a new release of BaseX. Version 6.1 comes with the following improvements: - a new REST API, based on the JAX-RX Interface, to communicate with BaseX via HTTP. - new bindings to use BaseX from other programming languages. - support for all XSLT/XQuery serialization parameters. - advanced query optimizations to apply index structures whenever appropriate. - enhanced conformance with XQuery Update/Full Text Recommendations. BaseX is open source. It is developed by the DBIS Group at University of Konstanz. Please find more information at http://basex.org/ All the best, Christian Grün BaseX Team ___________________________ Christian Gruen Universitaet Konstanz Department of Computer & Information Science D-78457 Konstanz, Germany Tel: +49 (0)7531/88-4449, Fax: +49 (0)7531/88-3577 http://www.inf.uni-konstanz.de/~gruen

1 0

Using XML catalogs in BASE-X, right flow of actions for working with !DOCTYPE or !ENTITY declarations
by Jiří Kadlec 15 Apr '10

15 Apr '10

Hi all, Is it possible to use XML catalogs for getting documents referenced in DTD's with BASE-X database? My second question is about right procedure for dealing with DOCTYPE declaration. I'm using BASE-X for modifications in lot of different files. Some of them has DOCTYPE declaration defined and I would like to preserve this definition when I finish changes on the file. Its possible to use export functions with specified properties doctype-system, doctype-public, but is there any way how to get original doctype for me to be able to pass it as export property at the end or this must be specified by user who is modifying the file? I'm having the same issue with declarations of !ENTITY when i finish changes all entities are gone. Any help appreciated Jiri

2 1

how can I get java bindings in basex working?
by Sandra Maria Silcot 15 Apr '10

15 Apr '10

Fellow basex users, First, I can report that the recent optimisation enhancements have solved the performance issue I had reported -- thanks to the basex team. Basex most definitely rocks. Second, I am trying to implement a java binding as described here: http://www.inf.uni-konstanz.de/dbis/basex/xquery Thanks to the recent extra instruction added by the kindly basex developers, I have been able to use maven (2.2.1) on a ubuntu 64bit server to successfully compile basex from source. Excellent. But I am now wanting to do this in a basex xquery: declare namespace sim = "java:smstest.b4asims"; let $sim := sim:b4asims(xs:string("smith"), xs:string("smyth")) where this is a little jar I built around the simmetrics similarity library, like this: jar -cvf smstest.jar smstest/b4asims.class This successfully runs from the command line, under the same user the basex server runs under, like so (with the jar in my $CLASSPATH): BaseX 6.0.8 [Server] Server was started. fas@devfas: ~ $ java smstest.b4asims smith smythe ..str1=smith first=m Soundex score 0.9222222:smith:smythe Levenshtein score 0.6666666:smith:smythe JaroWinkler score 0.8577778:smith:smythe - total [smythe]=2.4466667 == score=2.4466667 bestScore=2.4466667 bestMatch=[smythe] #### bestScore=2.4466667 bestMatch=[smythe] I have tried every possible variation of the namespace definition and invoking the function in basex but it always says; [XPST0017] Unknown function "sim:b4asims(...)" In the pom.xml for basex I have added this: <groupId>smstest.b4asims</groupId> <artifactId>b4asims</artifactId> <scope>system</scope> <version>1.0</version> <systemPath>/media/disk2/fasrepo/common-bin/java/smstest.jar</systemPath> </dependency> and it compiles successfully, and I can then do a mvn 'package', and deploy the jar to my basex home dir, and run it but I simply cannot get the java bindings to work. I also tried alot of variations here, but to no avail. Clearly there is something really basic I am missing? I have tried the examples given on the basex documentation (the Math and file writer egs) and get exactly the same results -- Unknown function. All of my other java stuff on this box seems to work fine. I'm guessing that there is something in maven or eclipse which supplies the magic which I'm missing. I'm just using maven on the server, not eclipse. Any suggestions for a non-java developer would be most gratefully received. Best wishes to all, Sandra.

2 1

Next BaseX release
by Christian Grün 13 Apr '10

13 Apr '10

Dear all, BaseX 6.1 will be released this weekend. We regard our current source code base to be stable and well-tested. If you think that there are some serious issues to be fixed, please don't hesitate to give us feedback just in time. Next, we would be _very_ thankful if you could give us a short & quick summary (min. one line, max. one paragraph) on your project, company, both industrial and adademic. If we get enough feedback, we will extend basex.org by a reference page, possibly linking to your homepage. Thanks to everyone for supporting the project! Christian ___________________________ Christian Gruen Universitaet Konstanz Department of Computer & Information Science D-78457 Konstanz, Germany Tel: +49 (0)7531/88-4449, Fax: +49 (0)7531/88-3577 http://www.inf.uni-konstanz.de/~gruen

1 0

Question for XQJ to update
by Qu Xia 08 Apr '10

08 Apr '10

I made a simple XML called order.xml like this: -------------order.xml-------------- <orders> <order> <name>cola</name> <price>3.0</price> <factory>Number 1</factory> </order> <order> <name>coffee</name> <price>5.0</price> <factory>Number 2</factory> </order> </orders> -------------------------------------------- Now I want to update the price of the coffee to 6.0 with XQJ, so I got the following code: String driverName = "org.basex.api.xqj.BXQDataSource"; Class<?> driverClass = Class.forName(driverName); XQDataSource dataSource = (XQDataSource)driverClass.newInstance(); XQConnection xqc = dataSource.getConnection(); String updateString = "declare variable $node := doc('etc/xml/orders.xml')//order[name='coffee']; "+ "replace value of node $node/price with '5.0', " + "return " + "put(doc('etc/xml/orders.xml'), 'orders.xml')"; XQExpression xqu = xqc.createExpression(); xqu.executeQuery(updateString); xqu.close(); unfortunately, it throws an exception. I tried many different ways and fails all the time. could any tell me the right "updateString"? thanks a lot. -- Xia Qu Technology Center of Software Engineering, Institute of Software, Chinese Academy of Sciences Beijing, 100190, China Email (work):quxia08@otcaix.iscas.ac.cn Email (personal): tsuxia(a)gmail.com Mobile:(86) 1300-1010-069

2 1

How can I connected to the server usering XQJ
by 屈夏 07 Apr '10

07 Apr '10

Hi, I am a freshman here using BaseX6. I want to use XQJ API to connect with the BaseX Server, I tried many kinds of properties, but it does not work, did anyone try it before? thanks a lot.. -- Xia Qu Technology Center of Software Engineering, Institute of Software, Chinese Academy of Sciences Beijing, 100190, China Email (work):quxia08@otcaix.iscas.ac.cn Email (personal): tsuxia(a)gmail.com Mobile:(86) 1300-1010-069

2 2

basex xquery optimization not using attribute index on "joins"?
by Sandra Maria Silcot 06 Apr '10

06 Apr '10

Hi all, First, thanks to the developers for a great piece of software. I am having difficulty getting an xquery on a large database to run using indexed attributes when a "join" idiom is used. I have a large basex database, with multiple documents. One of those contains <rs> elements as shown below, where the @corresp attribute contains values which are identical to the @key attribute on <person> elements, which live in multiple separate files: <personGrp type="match:policeNum+ship" size="3"><persName> <rs corresp="c23a2866">Corper, Jno (Pn:1000C)...</rs> <rs corresp="dlm18192024">Corper, John (Pn:1000C)...</rs> <rs corresp="c31a31061000" >Corper, Jno (Pn:1000CC)...</rs> </persName></personGrp> I know indexes have been built as xpaths like this are lightening quick: //person[@key="c23a2866"] or //rs[@corresp="dlm18192024"] But when I do this, it is glacial (nearly 1 minute): EG(A) for $rs in //rs[@corresp="c31a31061000"]/../..//rs let $keyval := data($rs/@corresp) return //person[@key=$keyval] I am using BaseX6.jar on XP. When I look at the query plan, the ONLY time the attribute index used is on the //rs[@corresp="c31a31061000"] part. I can get it to run fast and return the 3 matched <person> elements using the attribute index using basex:eval, like this: EG(B) for $rs in data(//rs[@corresp="c31a31061000"]/../..//rs/@corresp) let $s := concat("//person[@key='",$rs,"']") return basex:eval($s) So rather than execute this query asa "join" -- a manner which seem widespread in the xquery world -- I must manually build and execute each //person[@key='string'] request "manually" to get basex to use its attribute index. Whilst this works, it seems a rather strange idiom to have to employ, and locks my queries into basex. Is the behaviour of EG(A) by design, or is it a bug that the query optimizer is failing to recognise it can use the attribute index on the //person[@key=$keyval] part? Any guidance much appreciated. Best wishes to all, Sandra.

2 4

xqconnection issue
by Travis Webb 05 Apr '10

05 Apr '10

I am having a strange issue using the XQJ libary. Anytime I make a change to the database (inserting / updating a node), subsequent queries perform as if that change was never made. However, if I create a new XQConnection to the database, those changes are reflected. So every time I update the database, I'm having to establish a new connection in order to see my changes. Is this expected behavior? If not, any ideas why this is happening? Thanks -tjw

3 2

Bug: baseX can't create XMLDB with non utf-8 xml String
by l0979365428＠gmail.com 05 Apr '10

05 Apr '10

Dear baseX creater: If it is xml file ,it 's ok. If it is xml String, BaseX only receives utf-8 encoding of XML. The reasion is : //---------------------------------------------------// public static IO get(final String s) { if(s == null) return new IOFile(""); if(s.startsWith("<")) return newIOContent(Token.token(s)); if(s.startsWith("http://")) return new IOUrl(s); return new IOFile(s); //---------------------------------------------------------// public static byte[] token(final String s) { final int l = s.length(); if(l == 0) return EMPTY; final byte[] bytes = new byte[l]; for(int i = 0; i < l; i++) { final char c = s.charAt(i); if(c > 0x7F) return utf8(s); bytes[i] = (byte) c; } return bytes; //-----------------------------------------------// Doesn't parse with the head of XML file. But this programe create xml struts with Sax which pares the xml with the head info. For this reason，it'll make mistakes once the XML String is not UTF-8. I fix it : if(s.startsWith("<")) return new IOContent(Token.encoding(s)); //----------------------------------------------// public static byte[] encoding(final String s) { final int l = s.length(); if(l == 0) return EMPTY; int i=0; int j =0; StringBuilder ss=new StringBuilder(); char hope[]=new char[]{'c','=','"','"'}; while (true) { final char c = s.charAt(i); if(hope[j]==c) j++; if(j==4) break; if(j>2&&c!=hope[j-1]) { ss.append(c); } i++; } final byte[] bytes = new byte[l]; for(int k = 0; k < l; k++) { final char c = s.charAt(k); if(c > 0x7F) return others(s,ss.toString()); bytes[k] = (byte) c; } return bytes; } //-----------------------------------------------// I wonder if you could fix this bug in the next version. Also BaseX doesn't support the String of xml with namespace build DB. And I have no idea. PS: BaseX57,Jdk1.5 best wishes Ruby

3 2

.basex config file
by Travis Webb 04 Apr '10

04 Apr '10

I have another question regarding the .basex config file. How does basex determine the home directory of the current user? by looking at $HOME? I'd like to trick basex into thinking this file is somewhere else, because the hard restriction that this file must reside in the home directory of the current user will not work for our use. -tjw

2 2