- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Importing XML (DITA) validated with Relax NG schemas?
by Radu Coravu 02 Oct '18

02 Oct '18

Hi Christian, Jason, Coming back to this older discussion thread. How does baseX parse XML document, does it do so using the regular "javax.xml.parsers.SAXParserFactory" factory? In this folder there is a JAR library called "dita-ng.jar": https://github.com/oxygenxml/dita-relaxng-defaults/tree/master/lib inside the JAR library's META-INF folder there is a "services" folder in which the JAR library registers a custom "org.apache.xerces.xni.parser.XMLParserConfiguration". If this parser configuration is used when parsing XML documents, and XML documents have references to Relax NG documents, the default attributes defined in the Relax NG schema would start being reported on SAX and DOM parsers parsing the XML documents. But the "xercesImpl.jar" registers the same "org.apache.xerces.xni.parser.XMLParserConfiguration" service. So in order to test if RNG-based XML parsing works with BaseX we would somehow need a way to add the "dita-ng.jar" to the baseX server's class path but it should also come in the classpath before the "xercesImpl.jar". But this would work only if the baseX code uses the "javax.xml.parsers.SAXParserFactory" when parsing XML documents instead of using directly implementations from the Xerces library. Regards, Radu Radu Coravu <oXygen/> XML Editor http://www.oxygenxml.com > Hi Christian, > > Thanks for your response. Understood with regard to Jing. The plugin I linked > also uses Jing. I'm just not clear which version. I believe the source for at > least the dita-ng.jar is linked from the repository [1]. > > > With regard to the questions asked in this post, after investigation, I > believe I have a better understanding of the problem I'm trying to solve. > Importing Relzx NG XML into the database was not the problem. The problem > exists between the database and the application layer that interfaces with it. > I opened a feature request that summarizes it [2]. > > Thanks, > Jason > > [1] https://github.com/georgebina/dita-ng > [2] https://github.com/BaseXdb/basex/issues/1624 > > On 9/25/18, 12:38 AM, "Christian Grün" <christian.gr...(a)gmail.com> wrote: > > Hi Jason, > > Please note that BaseX uses the Jing RELAX NG validator. It does not > embed the DITA Open Toolkit. > > I didn’t have time to look at the DITA OT plugin so far. It seems that > the repository of the oXygen plugin you referenced only contains the > JAR file. Do you possibly know where we can find the source files? > > Cheers > Christian > > PS: It seems that you and your colleague asked different questions in > your previous posts. Have these questions been solved? > > > > On Mon, Sep 17, 2018 at 9:55 PM Jason Davis <jason.da...(a)hortonworks.com> > wrote: > > > > My mistake. It appears I may have misstated my problem. The query I used > worked fine for importing resources. The problem appears to be related to how > BaseX parses the resources. It doesn’t appear to take into account default > attribute values. Given that the Relax NG spec clearly states default > attributes are not part of the design, this doesn’t come across as a surprise. > However, default attributes are meaningful with regard to DITA and there is a > Java framework you can install as a plugin to the DITA Open Toolkit that > supports parsing of Relax NG DITA content with default attributes [1]. > > > > Is it possible to setup databases created in BaseX with Relax NG parsing > of default attributes? Is it just a matter of including the dita-ng.jar from > the DITA OT plugin in my classpath? > > > > Thanks, > > Jason > > > > [1] https://github.com/oxygenxml/dita-relaxng-defaults > > >

2 2

REPLACE command issue in Basex version 8.6.6/9.0.2
by Stephan van Hugten 01 Oct '18

01 Oct '18

In our software we're using a Basex database and integrate with it via the Java library. We're currently using 8.0.3, but attempted to upgrade to the latest version (9.0.2) when we encountered a breaking issue. The REPLACE command class now interprets all XML with an attribute as a path. I can reproduce this in the basex command line client, but not the GUI. Reproducer case: BaseX 9.0.2 [Client] Try 'help' to get more information. > create db test Database 'test' created in 25.24 ms. > open db test Database 'db' was not found. > open test Database 'test' was opened in 1.57 ms. > REPLACE com.example.model.user.Account-2397 "<text version="draft"><title>Chapter</title></text>" Resource "C:/Java/basex902/bin/"<text version=draft><title>Chapter</title></text>"" not found. > REPLACE com.example.model.user.Account-2397 <text version="draft"><title>Chapter</title></text> Resource "C:/Java/basex902/bin/"<text version=draft><title>Chapter</title></text>"" not found. > REPLACE com.example.model.user.Account-2397 <text version='draft'><title>Chapter</title></text> Resource "C:/Java/basex902/bin/"<text version='draft'><title>Chapter</title></text>"" not found. > REPLACE "com.example.model.user.Account-2397" <text version='draft'><title>Chapter</title></text> Resource "C:/Java/basex902/bin/"<text version='draft'><title>Chapter</title></text>"" not found. > REPLACE "com.example.model.user.Account-2397" "<text version='draft'><title>Chapter</title></text>" Resource "C:/Java/basex902/bin/"<text version='draft'><title>Chapter</title></text>"" not found. > REPLACE top.xml "<text version='draft'><title>Chapter</title></text>" Resource "C:/Java/basex902/bin/"<text version='draft'><title>Chapter</title></text>"" not found. > REPLACE top.xml <xml/> 0 resource(s) replaced in 29.71 ms. > REPLACE top.xml <xml version='draft'/> Resource "C:/Java/basex902/bin/"<xml version='draft'/>"" not found. > Storing the XML in a file and replacing that works: > REPLACE com.example.model.user.Account-95 test.xml 1 resource(s) replaced in 5.03 ms. > xquery //account <account uuid="83ff82e4-01b1-4624-969e-2ba7e7deeb29" id="10095"><x/></account> Can you assist in solving this mystery? '************************************************************************************************** This E-mail and any files transmitted with it are private and confidential and are solely for the use of the addressee. It may contain material which is legally privileged. If you are not the addressee, be advised that you have received this E-mail in error and that any use of it is strictly prohibited. If you have received this E-mail in error, please notify APS on +44 (0)161 495 4500, or E-mail administrator(a)theapsgroup.com. Any opinions expressed in the E-mail are those of the individual writer of it and not necessarily the Company unless specifically stated otherwise. There is no intention to create any legally binding contract or other commitment through use of this E-mail We cannot accept any liability for any loss or damage sustained as a result of software viruses. It is your responsibility to carry out such virus checking as is necessary before downloading this E-mail and any attachments onto your computer system. Allied Publicity Services (Manchester) Ltd Registered Office: Allied Publicity Services (Manchester) Ltd, Chetham House, Bird Hall Lane, Cheadle Heath, Cheshire, SK3 0ZP Company Registration No: 681528 England APS Group Secure Solutions Limited. Registered Office: Chetham House, Bird Hall Lane, Stockport, Cheshire, SK3 0ZP Company Registration No: 07007434 England APS Group (Scotland) Ltd. Registered Office: APS Group (Scotland) Ltd, 21. Tennant Street, Edinburgh, EH6 5NA Company Registration No: SC369510 Scotland ______________________________________________________________________ This email has been scanned by the Symantec Email Security.cloud service. For more information please visit https://www.symantec.com ______________________________________________________________________

2 3

JAVA xquery: accessing documents
by Jan Stapel 01 Oct '18

01 Oct '18

Hello, Normally (few basex-versions ago) I did: session.execute("open main"); session.execute("xquery doc("users.xml")//users"); But now, this results in basex interpreting the doc()-path as relative to it's home-directory thus cannot find the resource.. "xquery doc("main/users.xml")//users" gives the correct results. Do we no longer open a database but writing the full path of the document instead? Whats the performance of this if accessing multiple documents of the same database during runtime? -regards, jan

2 1

XML catalog with fetch:xml
by Andy Bunce 25 Sep '18

25 Sep '18

Hi, Using a recent 9.1 Beta on windows. I create an XML catalog at c:\tmp\mycatalog.xml <catalog prefer="system" xmlns="urn:oasis:names:tc: entity:xmlns:xml:catalog"> <uri name="http://nowhere.com/doc" uri="file:///c:/tmp/doc.xml" /> </catalog> Then in the GUI fetch:xml("http://nowhere.com/doc", map{"catfile": "C:\tmp\mycatalog.xml"} ) It goes to nowhere, I was hoping to get back c:/tmp/doc.xml Should this work? /Andy

2 3

Importing XML (DITA) validated with Relax NG schemas?
by Robert Crews 25 Sep '18

25 Sep '18

I'm trying to set up BaseX to manage a repository of DITA content. The DITA content has been specialized to validate against Relax NG schemas instead of DTDs. While importing content that validate against DTDs is straight forward, I have not yet figured out the best way to import Relax NG based content. So, I have a few questions: * I see there is the Validation module [1] and that's good because I think XQuery is my best option for managing the imports. However, I need to pass a specific schema to the functions. DITA content utilizes multiple schemas. Is there some way I can pass a directory to these functions instead of just a single file reference? * I currently have the CATFILE option set [2]. Does this help or hinder importing when choosing to validate against Relax NG? Is there some way I can set the global options to make validating against Relax NG easier? * I've seen multiple examples of people actually storing the schema(s) in the database. Is that necessary or help for using the validation module? Thanks for your help! [1] http://docs.basex.org/wiki/Validation_Module#RelaxNG_Validation [2] http://docs.basex.org/wiki/Catalog_Resolver http://docs.basex.org/wiki/Options#CATFILE For reference, here is how Oxygen handles catalog resolution<https://www.oxygenxml.com/doc/versions/20.1/ug-editor/topics/using-XML-Cata…>. See the bottom of Table 1. Catalog Mappings for a summary of how Relax NG is resolved.

3 4

BaseX GUI repo install shortcut
by Marco Lettere 25 Sep '18

25 Sep '18

Hi Christian et al, I'm not aware of any shortcut (keyboard, flag or any) for speeding up the reinstallation of a REPO module once the XQ file is being updated when working in the GUI. At the moment I always reinstall from the preference menu but when developing in continuous it's a bit tedious and often I forget it and have to switch back from my test environment to reinstall. Is there any way or could you think of any good shortcut to (at least partially) automate the reinstall procedure after updating the .xqm module in a GUI tab? Thanks, Marco.

2 5

Tomcat and UserPrincipal
by Marco Lettere 25 Sep '18

25 Sep '18

Hi all, when deploying a BaseX RestXQ module as a Tomcat webapp in a container that uses embedded realm based authentication is there any way to retrieve the login name after being redirected to the protected page? I remember back in J2EE times there was a dedicated method getUserPrincipal. Is there any equivalent using "request:"? Thanks as usual for any kind support! Marco.

2 1

Should serialize function take "newline" : "\r\n" option in the map parameter into account?
by Martin Honnen 25 Sep '18

25 Sep '18

When I run contains(serialize("Line 1.
Line 2.
Line 3.", map { "method" : "text", "newline" : "\r\n" }), '') in BaseX 9.0.2 (from the command line basex.bat or in the GUI) I get the result "false" while I expected "true". Have I not provided the newline option correctly?

2 1

Minor PR/fix suggestion
by Bridger Dyson-Smith 24 Sep '18

24 Sep '18

Hi Christian, et al, I'm guessing that you're all busy with working towards a 9.1 release (yay!), but if you have time would you consider an incredibly minor PR? I recently noticed that the BaseX GUI supports completion and it's great. I found a small typo in the completions: `sliding=for tumbling window` should be `sliding=for sliding window` It's super-duper simple, but I have a branch with the typo fixed[1]. In any event, thanks! Looking forward to the next release. Best, Bridger [1] https://github.com/CanOfBees/basex/tree/fix-completions-typo

2 2

Optimize broke my database(s)
by Florian Wagner 24 Sep '18

24 Sep '18

Hey everone, we're close to going live with a project built upon BaseX with largish Databases (the biggest one being about 6 GB unoptimized). We have a regular nightly full-optimize job. One run this weekend seems to have broken two of our databases. There's single error message per broken database in our logs: java.io.FileNotFoundException: /var/db/basex/[...]_1151592207/inf.basex (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.basex.io.IOFile.outputStream(IOFile.java:158) at org.basex.io.out.DataOutput.<init>(DataOutput.java:47) at org.basex.io.out.DataOutput.<init>(DataOutput.java:36) at org.basex.data.DiskData.write(DiskData.java:137) at org.basex.data.DiskData.close(DiskData.java:160) at org.basex.core.cmd.OptimizeAll.optimizeAll(OptimizeAll.java:145) at org.basex.query.up.primitives.db.DBOptimize.apply(DBOptimize.java:124) at org.basex.query.up.DataUpdates.apply(DataUpdates.java:175) at org.basex.query.up.ContextModifier.apply(ContextModifier.java:120) at org.basex.query.up.Updates.apply(Updates.java:157) at org.basex.query.QueryContext.iter(QueryContext.java:346) at org.basex.query.QueryProcessor.iter(QueryProcessor.java:90) at org.basex.core.jobs.QueryJob.run(QueryJob.java:165) at java.lang.Thread.run(Thread.java:748) The DBAs "Databases" page still lists the broken dbs including the size and a last-modified date of the Job time. But clicking them gets you a detail page with no details, documents, no Add... / Delete / Copy.. buttons and the backup buttons being disable. Ideas how to go from here are greatly appreciated? Any chance getting our database contents back? Grüße Florian Wagner --- Universitaetsbibliothek Tuebingen Wilhelmstr. 32, 72074 Tuebingen IT-Abteilung, Raum B102 +49(0)7071/29-77860 http://www.ub.uni-tuebingen.de

2 1