- BaseX-Talk - mailman.uni-konstanz.de

Doubtful question on xquery:eval ...
by Marco Lettere 14 Jun '13

14 Jun '13

Hello all, I just would like to know if this wanted or not ... When I run the following query in the GUI with all databases closed for $rvs at $pos in collection('examples/valuesets/resolved') return $rvs it returns the correct dataset. The same query put into an xquery:eval xquery:eval("for $rvs at $pos in collection('examples/valuesets/resolved') return $rvs") gives a result if the database "examples" has been opened. With no open database I get an error message "Improper use or potential bug ...." and the console the GUI is running in return the following stacktrace: java.io.IOException: Stream Closed java.io.RandomAccessFile.seek(Native Method) org.basex.io.random.DataAccess.cursor(DataAccess.java:229) org.basex.io.random.DataAccess.readToken(DataAccess.java:168) org.basex.data.DiskData.txt(DiskData.java:267) org.basex.data.DiskData.text(DiskData.java:235) org.basex.io.serial.Serializer.node(Serializer.java:389) org.basex.io.serial.Serializer.serialize(Serializer.java:99) org.basex.io.serial.Serializer.serialize(Serializer.java:84) org.basex.query.iter.ValueBuilder.serialize(ValueBuilder.java:80) org.basex.query.iter.ValueBuilder.serialize(ValueBuilder.java:75) org.basex.core.cmd.AQuery.query(AQuery.java:80) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:342) org.basex.core.Command.exec(Command.java:321) org.basex.core.Command.execute(Command.java:78) org.basex.gui.GUI.exec(GUI.java:397) org.basex.gui.GUI$7.run(GUI.java:349)

2 6

XQuery to insert nodes in XML File
by John Best 14 Jun '13

14 Jun '13

Dear Team, I am trying to insert few nodes in a XML File. But in reality the nodes are not inserting in the XML File!! Below is my query for $x in doc('C:\sample.xml')//CInfos return insert node <Info><Name>James Stuart</Name><Key>7709422869</Key></Info> as last into $x I tried with another query - insert node <Info> <Name>James Stuart</Name> <Key>7709422869</Key> </Info> as last into doc('C:\sample.xml')//CInfos This too not working If I create a XML DB and then it works... What am I missing? -- Have a nice day JBest

3 2

Re: [basex-talk] Java DOM Interface and updating XQueries
by Ingo Dengler 13 Jun '13

13 Jun '13

Hi Christian, the problem also exists with DBNode, isn't it? DBNode internally stores the pre of the node at time of instantiation of the object. After an update of DB the internally stored pre points to a wrong node. Of course one could use the ID of DBNode and use db:open-id(id) to get a new DBNode with correct pre. But this approach doesn't work with DOM API. My question is, is there a possible solution that allows me to use DOM interface (We need DOM, because we want to use BaseX to replace an old DOM based parser class without reimplementing everything) and updating expressions? Best regards, Ingo > Hi Ingo, > > as you correctly observed, we are using 'pre' values to organize nodes > in our database, which will change after updates (see [1] for further > details on pre and id values and the id/pre mapping). It is generally > possible to use our DOM interface, but I’m inclined to recommend you > the database functions db:open-pre() and db:node-pre(). If you perform > updates, db:open-id() and db:node-id() and the UPDINDEX option will > help you [2]. You could also work with the DBNode instances, which are > returned by the query processor, as this will be much faster than > using the DOM wrapper, but it may take more time to get acquainted > with the internal node interface. > > Regards, > Christian > > [1] http://docs.basex.org/wiki/Node_Storage#PRE_Value > [2] http://docs.basex.org/wiki/Database_Module#db:open-pre[http://docs.basex.or…

2 1

BaseX Script memory leak . . ?
by Christopher.R.Ball 12 Jun '13

12 Jun '13

I have a BaseX script (.bxs) I am running that does queries in batches (sets of 5k documents), but as it progresses it bogs down in speed, does not release memory between sets even if I force it to close and reopen the db between queries, and eventually runs out of memory. But, if I break the same BaseX script into separate files still doing the same exact batches it is extremely fast and memory efficient. Very suggestive of a memory leak . . . I am running on BaseX 7.6.1 Beta. Any thoughts? Is there a way to force the script to do garbage collection?

5 7

Java DOM Interface and updating XQueries
by Ingo Dengler 12 Jun '13

12 Jun '13

2 1

Loading Large xml file in DB taking long time
by Pushpendra Singh Sengar 12 Jun '13

12 Jun '13

Hi, I am loading 5GB xml in DB it takes around 10-12 minutes. I need to load about 20-30 document of same size (5Gb) , So i created thread to loading these document in DB but its taking too much time ,I wait till 4 hrs after that I stop process to load document . Pls tell me the best solution to loading large document. my program is following : package org.basex.examples.query; import java.io.*; import javax.xml.namespace.*; import org.basex.build.*; import org.basex.core.*; import org.basex.core.cmd.*; import org.xml.sax.Parser; /** * This class demonstrates collection relevant queries. * It shows how to find and query specific documents. * * @author BaseX Team 2005-12, BSD License */ public final class QueryCollection implements Runnable{ Context context = new Context(); String dbName = null; public QueryCollection(String string) { dbName = string; } /** * Runs the example code. * @param args (ignored) command-line arguments * @throws BaseXException if a database command fails * @throws XQException */ public static void main(final String[] args) throws BaseXException { /** Database context. */ Context context = new Context(); System.out.println("=== QueryCollection ==="); // ------------------------------------------------------------------------ // Create a collection from all XML documents in the specified directory System.out.println("\n* Create a collection."); System.out.println(System.currentTimeMillis()/1000); Thread thread = new Thread(new QueryCollection("Collection1")); Thread thread1 = new Thread(new QueryCollection("Collection2")); Thread thread2 = new Thread(new QueryCollection("Collection3")); Thread thread3 = new Thread(new QueryCollection("Collection4")); Thread thread4 = new Thread(new QueryCollection("Collection5")); thread.start(); thread1.start(); thread2.start(); thread3.start(); thread4.start(); OutputStream outputStream =null; try { outputStream = new FileOutputStream(new File("result.xml")); } catch(FileNotFoundException e) { // TODO Auto-generated catch block e.printStackTrace(); } // ------------------------------------------------------------------------ // Evaluate a query on a single document System.out.println(System.currentTimeMillis()/1000); // new DropDB("Collection").execute(context); // ------------------------------------------------------------------------ // Close the database context context.close(); } public void createDB(String dbName){ // TODO Auto-generated constructor stub new CreateDB(dbName, "E:/downloads/temp/test.xml").run(context); } @Override public void run() { // TODO Auto-generated method stub System.out.println(dbName+" start time : "+System.currentTimeMillis()/1000); createDB(dbName); System.out.println(dbName+" end time : "+System.currentTimeMillis()/1000); } } -- Thanks & Regards , Pushpendra Singh

2 1

Binding variables in scripts (bxs)
by Wendell Piez 12 Jun '13

12 Jun '13

Hi, I'm sure you will forgive me if this is as dumb as I'm afraid it might be ... trying to cover all possibilities here. We recently upgraded (now on 7.7beta) and external scripts stopped working as expected -- variable bindings of the form SET BINDINGS $db=my-db,$start=20001,$count=10000 no longer had any effect. Instead, the logic fell back to use values declared for the variables in the XQuery, which had: declare variable $db := 'your-db'; declare variable $start := 1; declare variable $count := 1000; etc. When we removed the declarations from the XQuery, things started working again. (Note that my assumption of a causal relation here could be wrong.) Should I never have put those declarations in to begin with (even as defaults, a la XSLT parameter declarations)? Is this a BaseX question or an XQuery question? I would like to become enlightened. Thanks as ever, Wendell -- Wendell Piez | http://www.wendellpiez.com XML | XSLT | electronic publishing Eat Your Vegetables _____oo_________o_o___ooooo____ooooooo_^

3 2

Re: [basex-talk] Java DOM Interface and updating XQueries
by Ingo Dengler 12 Jun '13

12 Jun '13

Hi, Sorry for posting the first message in HTML format (damn web mailer...). Here is it again in Text only: I have a problem using BaseX Java DOM Node Interface and updating XQuerys in combination. The problem is that on updating the XML structure the node "pointer" moves to another location therefore the BXNode Object points to the wrong node. I have investigated a bit and the problem seems to be the 'pre' attribute in Class DBNode that points to the wrong/old location. There is already an uninque ID in ANode that could be used to identify the right node. But a ID->pre mapping table is missing. Any solution/workaround for this issue? Best regards, Ingo See following snippet that demonstrates the issue: import java.io.ByteArrayInputStream; import org.basex.api.dom.BXNode; import org.basex.core.Context; import org.basex.core.Prop; import org.basex.core.cmd.CreateDB; import org.basex.core.cmd.Set; import org.basex.query.QueryProcessor; import org.basex.query.value.item.Item; import org.basex.query.value.node.ANode; public class UpdateAndDOM { public static void main(String[] args) throws Exception { // create test DB in memory Context context = new Context(); new Set(Prop.MAINMEM, true).execute(context); ByteArrayInputStream bais = new ByteArrayInputStream("<root><node1/></root>".getBytes()); CreateDB cmd = new CreateDB("testDB"); cmd.setInput(bais); cmd.execute(context); //get DOM node "node1" QueryProcessor query = new QueryProcessor("//node1", context); query.execute(); Item item = query.iter().next(); Object elem = BXNode.get((ANode)item); BXNode node1 = (BXNode)elem; System.out.println("Expected node1 is: " + node1.getNodeName()); //updating query that inserts data before node1 String xpath = "insert node <newNode/> before /root/node1"; query = new QueryProcessor(xpath, context); query.execute(); System.out.println("Expected node1 is: " + node1.getNodeName()); } }

1 0

Bind Externals via RUN Command
by James Hughes 12 Jun '13

12 Jun '13

Hello, I'm wondering if it is at all possible to an external variable to a query when it is being executed via the RUN command? e.g. RUN /queries/country.xq Which has (condensed for brevity) declare variable $country_code external; //iati-activity/recipient-country[@code='{ $country_code }']/ Is this possible when calling from a client? James

2 1

CloudHub 101 Webinar [Register]
by Cameron Coles 11 Jun '13

11 Jun '13

Live Webinar <http://www.mulesoft.com> >From zero to integration in 15 minutes with CloudHub <http://www.mulesoft.com/webinars/cloudhub-integration-demo> The myth is that integration takes weeks to build and deploy, not minutes. Join this live demo and follow along as we show how to integrate SaaS and on-premise applications at cloud speed. Don’t forget to bring your stopwatch to test whether this is myth is confirmed or busted. This MuleSoft event will cover: - Creating a CloudHub account - Configuring a message queue to Salesforce integration flow - Deploying integration to CloudHub - Monitoring performance from CloudHub Insight The demo will be followed by an interactive Q&A session. Register Now » Thursday, June 13, 2013 8AM Pacific, 11AM Eastern, 16:00 BST Forward to a colleague » <http://resources.mulesoft.com/index.php/email/emailWebview?ftf=true&mkt_tok…> Presenter: Tom Motley, Sr. Solutions Consultant, MuleSoft Date: Thursday, June 13, 2013 Time: 8AM Pacific, 11AM Eastern, 16:00 BST Length: 45 Minutes <http://www.mulesoft.com/webinars/cloudhub-integration-demo> Presenter: Tom Motley Sr. Solutions Consultant, MuleSoft <http://www.mulesoft.com/webinars/cloudhub-integration-demo> <http://www.mulesoft.com> <mailto:info@mulesoft.com> <http://blogs.mulesoft.org/> <http://twitter.com/#!/mulesoft> <http://www.facebook.com/MuleSoft> ©2013 MuleSoft, Inc. All rights reserved. 77 Geary Street, Suite 400, San Francisco, CA 94108 If you no longer wish to receive these emails, go to the following link to unsubscribe: http://resources.mulesoft.com/UnsubscribePage.html?mkt_unsubscribe=1&mkt_to….

1 0