- BaseX-Talk - mailman.uni-konstanz.de

seeking for a document in a collection with a million documents is very slow
by Fabrice Etanchaud 15 Mar '13

15 Mar '13

Dear all, Does the document index rely on text or attribute index ? One can experiment very slow response time when looking for a specific document name in an optimized collection of a million documents (in dynamic execution, without optimizations, for example within a loop with a name being the concatenation of string values). Is there a way to speed things up ? Best regards, Fabrice Etanchaud Questel-orbit

1 0

re-sort database
by Cerstin Elisabeth Mahlow 14 Mar '13

14 Mar '13

Hi, after a lot of data has been gathered, I realized that my update-function has a bug. It's not a big deal fixing it, however, I don't know how to resort the existing data. Essentially, I wanted to create this kind of data: <collection> <entry> <node>123</node> <query>xyz</query> <secondquery>abc_1</secondquery> <secondquery>abc_2</secondquery> </entry> <entry> <node>456</node> <query>xyz</query> <secondquery>abc_1</secondquery> <secondquery>abc_3</secondquery> <secondquery>abc_4</secondquery> </entry> </collection> However, the data looks like this: <collection> <entry> <node>123</node> <query>xyz</query> </entry> <secondquery>abc_1</secondquery> <secondquery>abc_2</secondquery> <entry> <node>456</node> <query>xyz</query> </entry> <secondquery>abc_1</secondquery> <secondquery>abc_3</secondquery> <secondquery>abc_4</secondquery> </collection> So, the secondqueries are stored just after the entry they belong to. How would I be able to move these data from "right after a particular node" to "just inside this particular node" using XQuery Update? Thanks in advance and best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Departement Sprach- und Literaturwissenschaften Fachbereich Deutsche Sprach- und Literaturwissenschaft Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net

4 8

Error in 7.6 !! but not in 7.5
by John Best 14 Mar '13

14 Mar '13

Hi there, for $x in (db:fulltext('work', 'string theory')/ancestor::*:Doc except db:fulltext('work', 'elastic')/ancestor::*:Doc) return substring(data($x/Publish/PubDate/@d), 7) I am storing Dates in YYYYMMDD Format as <PubDate d="20040608"> tag. The above query will return the Date of the Document published for the searched criteria. Using the BaseX 7.5, I was able to run the query correctly. But with 7.6, I am getting error *"Single item expected, ("20040608", "20040609") found"* -- Have a nice day JBest

2 1

Re: [basex-talk] Bugreport: org.basex.server.ClientQuery.cache(ClientQuery.java:81)
by Bodo Hüsemann 14 Mar '13

14 Mar '13

Hi all, I apologize for the german post on this english mailinglist...So here we go in english: I have recently migrated my BaseX application from version 7.2 to 7.6 (and 7.6.1 Beta). The BaseX lib throws exceptions while running concurrent XQuery queries and updates (based on a threadpool), see the exceptions attached below (the specific numeric error-code changes slightly but the error occurs every time on the same line of code). The error itself seems to happen unter heavy concurrency (sequential queries have no problem) and not every time query executes. The application code is as follows (class de.infabswissarmy.control.XMLDBManagerBaseX.query): public ArrayList<String> query(String inQuery, String[][] inArgs){ ClientSession mySession = null; ClientQuery myQuery = null; ArrayList<String> tmpString = new ArrayList<String>(); try { mySession = getClientSession(); myQuery = mySession.query(inQuery); // bind variable if (inArgs != null){ for (int i=0; i < inArgs.length; i++){ myQuery.bind("$" + inArgs[i][0], inArgs[i][1]); } } while (myQuery.more()){ // **exception is in this line ** tmpString.add(myQuery.next()); } } catch (IOException e) { // TODO Auto-generated catch block e.printStackTrace(); } finally { if (myQuery != null){ try { myQuery.close(); } catch (BaseXException e) { // ignore } catch (IOException e) { // TODO Auto-generated catch block e.printStackTrace(); } } } return tmpString; } To be complete this is the used helper function: private static ClientSession getClientSession() throws IOException { ClientSession mySession = new ClientSession("localhost", 1984, "admin", "admin"); return mySession; } Version 7.2 is running without problems. In version 7.6 I have seen some rare Java heap space errors at the same location, and once I even saw a massive growth of the DB > 1GB (normal size would be 1MB), but this may be another error and I cannot reproduce it. I will try to deliver a selfcontained min-example, but this could be quite an effort to do (it will take some time to produce it). So I hope that you might find the problem with the delivered information. Many thanks once again for this great XML-DB and thanks in advance for your help! Bodo -- attached error stack with version 7.6.1 (in 7.6 the error occurs in row 79 instead of 81) org.basex.core.BaseXException: -146032 at org.basex.server.ClientQuery.cache(ClientQuery.java:81) at org.basex.server.Query.more(Query.java:74) at de.infabswissarmy.control.XMLDBManagerBaseX.query(XMLDBManagerBaseX.java:86) at de.infabswissarmy.control.XMLDBManagerBaseX.queryDoc(XMLDBManagerBaseX.java: 121) at de.infabswissarmy.control.QueryTask.httpQuery(QueryTask.java:180) at de.infabswissarmy.control.QueryTask.run(QueryTask.java:271) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) org.basex.core.BaseXException: 0 at org.basex.server.ClientQuery.cache(ClientQuery.java:81) at org.basex.server.Query.more(Query.java:74) at de.infabswissarmy.control.XMLDBManagerBaseX.query(XMLDBManagerBaseX.java:86) at de.infabswissarmy.control.XMLDBManagerBaseX.queryDoc(XMLDBManagerBaseX.java: 121) at de.infabswissarmy.control.QueryTask.httpQuery(QueryTask.java:180) at de.infabswissarmy.control.QueryTask.run(QueryTask.java:271) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) org.basex.core.BaseXException: java.lang.ArrayIndexOutOfBoundsException at org.basex.server.ClientQuery.cache(ClientQuery.java:81) at org.basex.server.Query.more(Query.java:74) at de.infabswissarmy.control.XMLDBManagerBaseX.query(XMLDBManagerBaseX.java:86) at de.infabswissarmy.control.XMLDBManagerBaseX.queryDoc(XMLDBManagerBaseX.java: 121) at de.infabswissarmy.control.QueryTask.httpQuery(QueryTask.java:180) at de.infabswissarmy.control.QueryTask.run(QueryTask.java:271) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source)

2 4

index usage while processing large xml file(s)
by EV Narasimham 13 Mar '13

13 Mar '13

Hi, I'm currently processing a 3GB xml file. Below is the Query that is being executed and the corresponding output count(db:open("ASEPXML", "A_SEPXML")/descendant::*:PmtInf[15]/*:CdtTrfTxInf/*:CdtrAgt/*:FinInstnId/*:BIC/text()) Output: 100000 The total time taken to evaluate the query is 210 secs. Below is the query plan. Compiling: - pre-evaluating db:open("ASEPXML", "A_SEPXML") Optimized Query: fn:count(document-node { "A_SEPXML" }/descendant::*:PmtInf[15]/*:CdtTrfTxInf/*:CdtrAgt/*:FinInstnId/*:BIC/text()) Result: - Hit(s): 1 Item - Updated: 0 Items - Printed: 6 Bytes - Locking: local [ASEPXML] Timing: - Parsing: 0.0 ms - Compiling: 0.28 ms - Evaluating: 210818.96 ms - Printing: 0.08 ms - Total Time: 210819.34 ms Query plan: <QueryPlan> <FNAggr name="count(item)"> <CachedPath> <DBNode name="ASEPXML" pre="0"/> <IterPosStep axis="descendant" test="*:PmtInf"> <Pos min="15" max="15"/> </IterPosStep> <IterStep axis="child" test="*:CdtTrfTxInf"/> <IterStep axis="child" test="*:CdtrAgt"/> <IterStep axis="child" test="*:FinInstnId"/> <IterStep axis="child" test="*:BIC"/> <IterStep axis="child" test="text()"/> </CachedPath> </FNAggr> </QueryPlan> The database ASEPXML has text index created. The structure of the xml is as follows: <root> <PmtInf> <CdtTrfTxInf> <CdtrAgt> <FinInstnId> <BIC>XXXXXX1A</BIC> </FinInstnId> </CdtrAgt> </CdtTrfTxInf> <CdtTrfTxInf> <CdtrAgt> <FinInstnId> <BIC>XXXXXX2A</BIC> </FinInstnId> </CdtrAgt> </CdtTrfTxInf> <CdtTrfTxInf> <CdtrAgt> <FinInstnId> <BIC>XXXXXX3A</BIC> </FinInstnId> </CdtrAgt> </CdtTrfTxInf> <CdtTrfTxInf> ... repeating node (100000) </PmtInf> <PmtInf> </PmtInf> ... repeating node (40) </root> Are there possibilities of reducing the response times and how do I detect if an index is being used or not ? Regards Nesh

3 2

Make-Up Brushes
by sales32＠injoybeauty.NET 12 Mar '13

12 Mar '13

Dear Madam/Sir, My company MANUFACTURE different kinds of MAKEUP BRUSHES. Please see the products in the attached IMAGE. Simply REPLY if any questions or requests. B.R Mr. Woo

1 0

Java Client - Error BXDB0006 while accessing a single document
by Carlos MARCOS LAGUNAR 11 Mar '13

11 Mar '13

Hello. I've just installed last version of BaseX and have built a Java Client to access it. This is my code: String query = "insert node <patient>EOEO</patient> into fn:doc(\"MG_USERS/58745896522DFEF.xml\")/vmr" ClientSession cSes = new ClientSession(URL, PORT, USER, PASS); ClientQuery cQuery = cSes.query(query); String res = cQuery.execute(); cQuery.close(); And I'm getting this error: [BXDB0006] Database path 'MG_USERS/58745896522DFEF.xml' must point to a single document. I'm pretty sure that there is only ONE document there, since I always execute a DELETE MG_USERS/58745896522DFEF.xml prior of that code you see above. Furthermore, just before executing that code, I check it with a REST call via Internet Explorer and I get just one doc. So I don't really understand why I get the BXDB0006 error. If I try the same but with the REST interface instead of Java Client, by using: <rest:query xmlns:rest=\"http://basex.org/rest\"> <rest:text> insert node <patient>EOEO</patient> into fn:doc(\"MG_USERS/58745896522DFEF.xml\")/vmr </rest:text> I get the same error. Could anybody help me with this, please?. Thank you and best regards, C. Carlos Marcos Lagunar Health Technical Consultant Research & Innovation carlos.marcos(a)atosresearch.eu <mailto:carlos.marcos@atosresearch.eu> Valladolid - Spain www.atosresearch.eu <http://www.atosresearch.eu/> es.atos.net ------------------------------------------------------------------ This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Atos group liability cannot be triggered for the message content. Although the sender endeavours to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted. Este mensaje y los ficheros adjuntos pueden contener informacion confidencial destinada solamente a la(s) persona(s) mencionadas anteriormente pueden estar protegidos por secreto profesional. Si usted recibe este correo electronico por error, gracias por informar inmediatamente al remitente y destruir el mensaje. Al no estar asegurada la integridad de este mensaje sobre la red, Atos no se hace responsable por su contenido. Su contenido no constituye ningun compromiso para el grupo Atos, salvo ratificacion escrita por ambas partes. Aunque se esfuerza al maximo por mantener su red libre de virus, el emisor no puede garantizar nada al respecto y no sera responsable de cualesquiera danos que puedan resultar de una transmision de virus. ------------------------------------------------------------------

2 9

BaseX Server
by zanzinger＠alice-dsl.de 11 Mar '13

11 Mar '13

Dear Sirs, I am coming from the "content-side" of xml, therefore please excuse the maybe simple questions. (I did a lot xml, xslt, now xquery; a lot vba; a little objective C and C - but not much client-cerver-things). I am trying out BaseX-features. This is, what I´ve done so far: - Installation (Mac-Version) was easy. - Creating a Database via the GUI was easy. - Testing XQuery in the GUI was easy as well. - Now I tried the server: First I started the server with the Gui-Menu-Commands: it works. Fine: I can access the Server by the Command-Line of the Gui, e.g. get an answer to the command "list" or get the answer on a "xQuery …" . The Problem is now: I am searching an easy tutorial or explanation, how I can access the Server from a Browser (e.g. Safari), or for example from a loaded webpage in the browser, which has appropriate xml-/xquery/javascript-code to access the database (how do I write that cods?). I already tried to connect to the server via Mac-webDAV: does not work, whereas from the Gui, I can connect to the server. In the Browser, I tried "http://localhost:1984/rest" :no response. Is there any easy tutorial, how jetty interacts with baseX-server? Are there books on how to set up the client-server architecture of baseX? Where (which directory) has a static html-page to be placed, which I can call via localhost? (That seemed to me the first simple step to access the server.) The next logical step would be to route the http:// - request to the database-server?! As far as I understand, this is done by the various APIs, e.g. php or node.js? Hope, you understand my needs... I am very interested in baseX as the results so far seem very promising to me. Thanks in advance for an answer (English or German). Dieter Zanzinger München zanzinger(a)alice-dsl.de

2 1

Re: [basex-talk] Debugger for Xuery
by John Best 11 Mar '13

11 Mar '13

Hi, These link might help you - http://www.oxygenxml.com/xml_editor/xquery_debugger.html http://www.w3.org/TR/xpath-functions/#func-trace -- Have a nice day JBest

1 0

Debugger for Xuery
by bhupesh patel 10 Mar '13

10 Mar '13

Hello All, I am looking for any free/paid version of debugger for XQuery while using BaseX server. Can anyone point me to any resources you guys know of? Thanks, Bhupesh

4 5