- BaseX-Talk - mailman.uni-konstanz.de

Add files to the database
by Raymond Meester 16 Oct '12

16 Oct '12

Charles, thanks for the examples. I first thought using the core API, like "new Add(doc).execute(context); ", but to get working you need conversions and ToString methods and loose the direct manipulation options. I needed a concurrent set up anyway. What I also didn't get from the core library; when using multiple instances I got a FileLockException in the stack trace (as expected), but then the general message "org.basex.core.BaseXException: Improper use? Potential bug?" was shown. Maybe an error message about the filelock and concurrency would be clearer as its not a bug. There are some databases like SQLite that support concurrency (to some extend) while directly using a OS file system, but that lead often to unexpected results (locking on network shares for example).

1 0

Upload a file to baseX server
by nestor vb 16 Oct '12

16 Oct '12

Hi everyone: I have a question, is there a way to upload a file to a baseX server? I have a c# application and I would like to upload a whole xml file to the server, is this possible? any pinpoints or recommendations? Thanks Regasts, Nestor

2 1

Replication
by David Sargeant 11 Oct '12

11 Oct '12

Does BaseX have any replication features? This would be really nice. David

2 1

Re: [basex-talk] Add files to the database
by Charles Foster 11 Oct '12

11 Oct '12

Hi Raymond, Here are some examples using the BaseX XQJ API if that helps. // ---------------------------------------------------- // Inserting a DOM Document item // ---------------------------------------------------- import javax.xml.xquery.*; import javax.xml.namespace.QName; import net.xqj.basex.BaseXXQDataSource; import javax.xml.parsers.*; import org.w3c.dom.*; import org.xml.sax.*; import java.io.*; import com.xqj2.*; public class Test { public static final Document getDocument() throws Exception { return DocumentBuilderFactory.newInstance().newDocumentBuilder(). parse(new InputSource(new StringReader("<e>Hello World</e>"))); }; public static void main(String[] args) throws Exception { XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); xqs.setProperty("databaseName", "TEST"); // DATABASE NAME: TEST XQConnection2 conn = (XQConnection2)xqs.getConnection("admin", "admin"); Document doc = getDocument(); conn.insertItem( "my-document-uri.xml", conn.createItemFromNode(doc, null), null ); XQPreparedExpression px = // have to state DATEBASE NAME, in URI: conn.prepareExpression("fn:doc('TEST/my-document-uri.xml')"); XQResultSequence rs = px.executeQuery(); System.out.println(rs.getSequenceAsString(null)); conn.close(); } } // ---------------------------------------------------- // ---------------------------------------------------- // Inserting an XML Document from a File object // ---------------------------------------------------- import javax.xml.xquery.*; import javax.xml.namespace.QName; import net.xqj.basex.BaseXXQDataSource; import java.io.*; import com.xqj2.*; public class Test { public static void main(String[] args) throws Exception { XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); xqs.setProperty("databaseName", "TEST"); // DATABASE NAME: TEST XQConnection2 conn = (XQConnection2)xqs.getConnection("admin", "admin"); conn.insertItem( "test.xml", conn.createItemFromDocument( new FileInputStream(new File("test.xml")), null, null ), null ); XQPreparedExpression px = // have to state DATEBASE NAME, in URI: conn.prepareExpression("fn:doc('TEST/test.xml')"); XQResultSequence rs = px.executeQuery(); System.out.println(rs.getSequenceAsString(null)); conn.close(); } } // ---------------------------------------------------- > Is it possible to add Document objects (org.w3c.dom) directly to the > database without using TransformerFactory to convert it first to > string? > > And what if you have a File object? >

1 0

update database with insert and db:open-id
by Tim Belschner 10 Oct '12

10 Oct '12

[BaseX 7.3 with the internal editor] Hello, as a part of a query, I need to update more than ten thousand database entries with an additional attribute. For this, I thought about getting the node IDs with db:node-id(), storing them in an element sequence as attributes and use them afterwards as an identifier for the "update insert". Unfortunately, it takes around 22 seconds to update all database entries. After some testing I got two bottlenecks: 1. the "insert node ." command and 2. the "db:open-id()" command Both of them cause a processing time of around 10 seconds each. Is there a way to increase the update performance significantly? Maybe by setting some options of BaseX or using a different approach? Best regards Tim Here is an example code (no practical sense just to demonstrate the current code for the updates): ----------------------------------CODE-------------------------------------- ------- (: create a list with the node IDs:) declare function local:GetDBIDs ($seq as element()+) as element()+ { for $element in $seq let $DBID := db:node-id($element) return ( element {'Doublet'} { attribute{'DBNodeID'}{$DBID} } ) }; (: ##### MAIN PART ##### :) declare variable $dbname := 'db_enum_test'; let $elements := DBSection let $doubletIDs := element{'Doublets'}{local:GetDBIDs($elements/DatabaseEntry)} for $element at $pos in $doubletIDs/child::* return ( insert node (attribute {'DB_ID'}{xs:string(xs:integer('100000') + $pos)} ) into db:open-id( $dbname, xs:integer(data($element/@DBNodeID)) ) ) ----------------------------------CODE-------------------------------------- ------- and a query to create an example database: ----------------------------------DB---------------------------------------- ----- let $entries := for $i in (1 to 10000) return ( element {'DatabaseEntry'}{attribute {'id'}{xs:string($i)}, attribute {'word'}{concat('Scheduler_',xs:string($i*$i))}, attribute{'type'}{'INT32'}} ) let $entries2 := element {'DBSection'}{$entries} return ( db:add("db_enum_test", document { $entries2 }, "DB") ) ----------------------------------DB---------------------------------------- -----

2 4

Add files to the database
by Raymond Meester 10 Oct '12

10 Oct '12

Is it possible to add Document objects (org.w3c.dom) directly to the database without using TransformerFactory to convert it first to string? And what if you have a File object?

1 0

db creation mini tool
by Hans-Juergen Rennau 08 Oct '12

08 Oct '12

Hello, a little question. I would like to write a mini "tool" which loads an XML file into a database, creating the db if it does not yet exist and overwriting the current content if it does already exist. This script achieves the goal: <commands> <drop-db name="mydb"/> <create-db name="mydb">myxmlfile.xml</create-db> <list/> </commands> But as the script interface does not (yet?) support input parameters, I have to edit the script for each use. Using an XQuery script, on the other hand, is not possible as there is no function for creating a database, if I have not overlooked it in the documentation. My question: is there an alternative which allows to specifiy db name and file name as command line parameters, or is that presently not possible? Many thanks for any information, Hans-Juergen Rennau PS: I would not mind the editing myself, but a tool with call parameters is helpful when spreading the word "BaseX" among the colleagues: providing some useful tools to them using BaseX, one has to instruct them first how to load their data into BaseX, and of course it would be nice to give them a simple call, rather than an instruction how to edit a sample and then call it.

2 1

XQJ: Exception using Saxon9 TransformerFactoryImpl
by David Oguns 06 Oct '12

06 Oct '12

I am trying to perform a basic document insert using the XQJ API communicating with a standalone BaseXServer. I have a lot of dependencies on my classpath (I'm sure this affects JAXP's behavior), including Saxon, Xerces, Xalan, and probably a few versions of some of them. When I set the transformer factor explicitly to Xalan, there is no exception, but otherwise it appears Saxon is being used and it down throw an exception. I have a very high opinion of Saxon so I have my doubts that it's doing anything illegal with respect to the standards, so I thought I should ask what is going on. This is the property I can set to get rid of the problem: System.setProperty("javax.xml.transform.TransformerFactory", "org.apache.xalan.processor.TransformerFactoryImpl"); Here is the exception and stack trace: javax.xml.xquery.XQException: XQJTO013 - Values of 'standalone' and 'omit-xml-declaration' conflict Root Cause: net.sf.saxon.trans.XPathException: Values of 'standalone' and 'omit-xml-declaration' conflict at MyClass.main(MyClass.java:82) at net.sf.saxon.serialize.XMLEmitter.writeDeclaration(XMLEmitter.java:226) at net.sf.saxon.serialize.XMLEmitter.openDocument(XMLEmitter.java:143) at net.sf.saxon.serialize.XMLEmitter.startElement(XMLEmitter.java:303) at net.sf.saxon.event.NamespaceReducer.startElement( NamespaceReducer.java:72) at net.sf.saxon.event.ReceivingContentHandler.startElement( ReceivingContentHandler.java:290) at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown Source) at org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown Source) at org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XML11Configuration.parse(Unknown Source) at org.apache.xerces.parsers.XMLParser.parse(Unknown Source) at org.apache.xerces.parsers.AbstractSAXParser.parse(Unknown Source) at org.apache.xerces.jaxp.SAXParserImpl$JAXPSAXParser.parse(Unknown Source) at net.sf.saxon.event.Sender.sendSAXSource(Sender.java:400) at net.sf.saxon.event.Sender.send(Sender.java:154) at net.sf.saxon.IdentityTransformer.transform(IdentityTransformer.java:35) at MyClass.main(MyClass.java:82) And here is the relevant code: XQDataSource xqs = new BaseXXQDataSource(); xqs.setProperty("serverName", "localhost"); xqs.setProperty("port", "1984"); XQConnection conn = xqs.getConnection("admin", "admin"); try { XQStaticContext context = conn.getStaticContext(); XMLStreamReader xmlReader = XMLInputFactory.newInstance().createXMLStreamReader(newFileReader(args[0])); XQPreparedExpression xqpe = conn.prepareExpression("declare namespace output = \"http://www.w3.org/2010/xslt-xquery-serialization\";declare option output:omit-xml-declaration \"no\";declare variable $doc external;\nfn:put($doc,\"jc003.xml\")", context); //xquery doc('oguns/jc001.xml') try{ xqpe.bindDocument(new QName("doc"), xmlReader, conn.createDocumentType()); XQResultSequence xqrs = xqpe.executeQuery(); } finally { xqpe.close(); } } finally { conn.close(); }

3 4

Jetty, locking files with webDAV and the possibility to use other web servers
by France Baril 05 Oct '12

05 Oct '12

Hi, Our context: - Multiple authors create/modify content stored on BaseX concurrently (content is split into multiple small topic files) - Authors access content using Data Source in Oxygen Issue - No locking mechanism to prevent multiple authors to make changes to the same file at once (leads to overwriting of the other author's changes). Research done seems to indicate that Jetty doesn't support webdav locking. - We couldn't get it working. - Talks with Oxygen validated this conclusion: http://www.oxygenxml.com/forum/post22862.html#p22862 Since the documentation says that Jetty is the default server (as opposed to it being the only server?), we are thinking we could maybe use another one. - Did anyone ever attempt that? - What would the steps to doing so be (Documentation only says how to work with Jetty)? - Anything possible/known issues? Compatibility or otherwise? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com (514) 572-0341

2 1

index:facets()
by Cerstin Elisabeth Mahlow 05 Oct '12

05 Oct '12

Hi, after Andreas recommended using index:facets(), my application speeds up. However, I don't think that this is the best solution. The database, I apply this function to is changing constantly. As the function is using the index, I would have to re-create the index first, is this correct? So that the functions would give wrong results most of the time. And I found another strange thing: I had to delete some nodes and re-created all indexes. However, index:facets() still gives the information from the status *before* the deletion, i.e., it counts nodes that aren't there anymore. Therefore I don't use it. count(//entry/selected[text () = "yes"]) gives the correct result, index:facets("collect", "flat")//element[@name = "selected"]/entry[text() = "yes"]/@count/data() still gives the wrong result, i.e., the result that was correct some days ago. Is this a bug or a feature? Best regards Cerstin -- Dr. phil. Cerstin Mahlow Universität Basel Departement Sprach- und Literaturwissenschaften Fachbereich Deutsche Sprach- und Literaturwissenschaft Nadelberg 4 4051 Basel Schweiz Tel: +41 61 267 07 65 Fax: +41 61 267 34 40 Mail: cerstin.mahlow(a)unibas.ch Web: http://www.oldphras.net

2 3