- BaseX-Talk - mailman.uni-konstanz.de

Add command: name of the input will be set as path?
by thufir 03 Feb '20

03 Feb '20

What does it mean that "if null, the name of input will be set as the path"? Javadoc: Add public Add(java.lang.String path, java.lang.String input) Constructor, specifying a target path and an input. Parameters: path - target path, optionally terminated by a new file name. If null, the name of the input will be set as path. input - input file or XML string I'm looking to add an xml file, so am using "null" for the path: https://stackoverflow.com/q/60035605/262852 but what are the implications? the "name of the input" will be "set as path"? Where is the "name of the input"? What is "path" in relation to a String which exists only in memory? Just pass a string like: new Add(null, stringXml).execute(context); and that should add to the currently open database? thanks, Thufir

2 4

convert JSON to XML to add to database
by thufir 03 Feb '20

03 Feb '20

Hi all, How is JSON converted to XML in order to ADD to a database? JSONObject jsonTweet = tweets.getJSONObject(Long.toString(id)); xmlStringTweet = XML.toString(jsonTweet); alternately, could the JSON simply get directly added to the database? see also: https://stackoverflow.com/q/60034291/262852 thanks, Thufir

2 2

BaseX and validating the entire database
by ERRINGTON Luke 03 Feb '20

03 Feb '20

Hello, We are evaluating moving from an RDBMS (Oracle), to BaseX as much of our source data originate in XML files and converting to tables in a relational schema is painful. In general BaseX looks great! However, one thing that we lose is referential integrity, and the ability to validate data in one XML file that is referring to data in another. Are there any possibilities within BaseX or an additional module that can do this? For example: * Can we validate using a schema that applies across a collection of documents, rather than just one? * Can we use Schematron (which looks cool) to apply its inteRnal XPaths to the entire collection of documents? * Or both? * Something else? We could try using XLinks, but that would involve changing our XML data/structure, and my understanding is that BaseX doesn't support (let alone validate) them, anyway. A situation I have in mind is something like (very, very simplified): A.xml <object id="1" name="One"> </object> B.xml <object id="2" name="Two"> </object> X.xml <mapping object_from_id="1" object_to_id="2" /> Is there any way to ensure that when X.xml is added to the database that the object IDs that it is referring to actually exist in the database too? I would also like to be able to ensure that all of the <object>s in the database have unique id attributes. A schema can do this within a file, but how can I ensure that when a new object xml file is added that it is not using an ID that already exists? Thanks for any answers, Luke

8 18

JSON to XML conversion
by thufir 03 Feb '20

03 Feb '20

Hi, How do I do something like: public void transform(String fileName) throws IOException { String content = new String(Files.readAllBytes(Paths.get(fileName)), StandardCharsets.UTF_8); org.json.JSONObject json = new org.json.JSONObject(content); log.info(org.json.XML.toString(json)); } but using BaseX as below? private void baseXparseJsonFile(String fileName) throws IOException { org.basex.build.json.JsonParser jsonParser = new org.basex.build.json.JsonParser(new IOFile(fileName), new MainOptions()); //where is the xml? } Unclear on how to use the different parsers (really, just need this one parser). See also: https://stackoverflow.com/q/60022419/262852 thanks, Thufir

2 1

db:optimize
by Ветошкин Владимир 30 Jan '20

30 Jan '20

3 14

Load LibreOffice- and Word-documents?
by Ben Engbers 28 Jan '20

28 Jan '20

Hi, While we were discussing possible usecases for basex, a colleague asked me if it is also possible to load libreoffice and Word documents into Basex and then perform full-text analysis on them. In essence, these are both XML files, so it should be possible. Does anybody have experience with this? Ben

3 2

NullPointerException parsing trivial query using XQJ (CLI works)
by Andreas Sewe 28 Jan '20

28 Jan '20

Hi, I get a weird NPE/parse error when interfacing with BaseX 9.3.1 via XQJ and even occurs for the following minimal query: <html>{.}</html> In other words, I just want to interpolate the context item. The gist of the XQJ calls is the following: > XQPreparedExpression expression = connection.prepareExpression("<html>{.}</html>"); > expression.bindDocument(XQConstants.CONTEXT_ITEM, "<context/>", null, null); > XQResultSequence results = expression.executeQuery(); > results.writeSequence(System.out, null); This results in the following message > XQJQS001 - Invalid XQuery syntax, syntax does not pass static validation. and a long and unfortunately obfuscated stack trace: > java.lang.NullPointerException > at net.xqj.basex.bin.bz.a(Unknown Source) > at net.xqj.basex.bin.bv.c(Unknown Source) > at net.xqj.basex.bin.bC.bE(Unknown Source) > at net.xqj.basex.bin.bC.by(Unknown Source) > at net.xqj.basex.bin.bC.bu(Unknown Source) > at net.xqj.basex.bin.bC.bj(Unknown Source) > at net.xqj.basex.bin.bC.bi(Unknown Source) > at net.xqj.basex.bin.bC.bh(Unknown Source) > at net.xqj.basex.bin.bC.aY(Unknown Source) > at net.xqj.basex.bin.bC.aX(Unknown Source) > at net.xqj.basex.bin.bC.aW(Unknown Source) > at net.xqj.basex.bin.bC.aV(Unknown Source) > at net.xqj.basex.bin.bC.aU(Unknown Source) > at net.xqj.basex.bin.bC.aT(Unknown Source) > at net.xqj.basex.bin.bC.aS(Unknown Source) > at net.xqj.basex.bin.bC.aR(Unknown Source) > at net.xqj.basex.bin.bC.aQ(Unknown Source) > at net.xqj.basex.bin.bC.aP(Unknown Source) > at net.xqj.basex.bin.bC.aO(Unknown Source) > at net.xqj.basex.bin.bC.aN(Unknown Source) > at net.xqj.basex.bin.bC.aM(Unknown Source) > at net.xqj.basex.bin.bC.aL(Unknown Source) > at net.xqj.basex.bin.bC.aK(Unknown Source) > at net.xqj.basex.bin.bC.R(Unknown Source) > at net.xqj.basex.bin.bC.Q(Unknown Source) > at net.xqj.basex.bin.bC.N(Unknown Source) > at net.xqj.basex.bin.bC.bS(Unknown Source) > at net.xqj.basex.bin.bC.bR(Unknown Source) > at net.xqj.basex.bin.bC.bM(Unknown Source) > at net.xqj.basex.bin.bC.bL(Unknown Source) > at net.xqj.basex.bin.bC.bK(Unknown Source) > at net.xqj.basex.bin.bC.by(Unknown Source) > at net.xqj.basex.bin.bC.bu(Unknown Source) > at net.xqj.basex.bin.bC.bj(Unknown Source) > at net.xqj.basex.bin.bC.bi(Unknown Source) > at net.xqj.basex.bin.bC.bh(Unknown Source) > at net.xqj.basex.bin.bC.aY(Unknown Source) > at net.xqj.basex.bin.bC.aX(Unknown Source) > at net.xqj.basex.bin.bC.aW(Unknown Source) > at net.xqj.basex.bin.bC.aV(Unknown Source) > at net.xqj.basex.bin.bC.aU(Unknown Source) > at net.xqj.basex.bin.bC.aT(Unknown Source) > at net.xqj.basex.bin.bC.aS(Unknown Source) > at net.xqj.basex.bin.bC.aR(Unknown Source) > at net.xqj.basex.bin.bC.aQ(Unknown Source) > at net.xqj.basex.bin.bC.aP(Unknown Source) > at net.xqj.basex.bin.bC.aO(Unknown Source) > at net.xqj.basex.bin.bC.aN(Unknown Source) > at net.xqj.basex.bin.bC.aM(Unknown Source) > at net.xqj.basex.bin.bC.aL(Unknown Source) > at net.xqj.basex.bin.bC.aK(Unknown Source) > at net.xqj.basex.bin.bC.R(Unknown Source) > at net.xqj.basex.bin.bC.Q(Unknown Source) > at net.xqj.basex.bin.bC.P(Unknown Source) > at net.xqj.basex.bin.bC.d(Unknown Source) > at net.xqj.basex.bin.bC.b(Unknown Source) > at net.xqj.basex.bin.bC.a(Unknown Source) > at net.xqj.basex.bin.bC.a(Unknown Source) > at net.xqj.basex.bin.bJ.<init>(Unknown Source) > at net.xqj.basex.bin.bd.a(Unknown Source) > at net.xqj.basex.bin.H.<init>(Unknown Source) > at net.xqj.basex.bin.H.a(Unknown Source) > at net.xqj.basex.bin.u.a(Unknown Source) > at net.xqj.basex.bin.u.a(Unknown Source) > at net.xqj.basex.bin.w.prepareExpression(Unknown Source) > at net.xqj.basex.bin.w.prepareExpression(Unknown Source) Executing the same query using "bin/basex -i context.xml query.xq" outputs the expected result: > <html> > <context/> > </html> I have a minimal (Maven-based) test project, in case you want to reproduce the bug. I can also file the issue on GitHub, if that's the preferred method, but if I read <https://github.com/BaseXdb/basex/issues/new> correctly, then I should post here first. Best wishes, Andreas

2 3

Test for changes in the data structure
by benjamin.tobler＠sbb.ch 28 Jan '20

28 Jan '20

Dear all I am extracting some nodes from a xml document. The structure of the xml document can change over time. Therefore, I would like to install a mechanism, which is testing for changes of the data structure of the relevant nodes. The schema is described in multiple xsd documents but one xsd document is referring to all others (screenshot). [cid:image003.jpg@01D5D502.4E0C7DB0] I was testing the complete xml against the this xsd, which is referring to all other xsds, but I received the error message: "Validation could not be started: Java heap space" by using the function "validate:xsd". However, actually I only want to test the data structure of specific nodes and not the complete xml for changes. Is it possible to do this with BaseX? Thank you for your help! Best Regards Benjamin

2 1

saxon.jar on docker image
by France Baril 27 Jan '20

27 Jan '20

Hi I'm using the public 9.3.1 image. I've been able to set up most of my app, but I get an error when trying to apply an xsl. Cannot compile and the error mention that Xalan is used. I just added the saxon9.jar in /srv/basex/lib/custom the way I would have on my normal local installation. FROM basex/basexhttp:9.3.1 ... COPY ./image-setup-files/bx/saxon9.jar /srv/basex/lib/custom/saxon9.jar 17:04:57.447 172.17.0.1:39752 admin 400 Stopped at /srv/basex/webapp/Accounting_Bilans.xqm, 301/25: [xslt:error] ERROR: 'Could not compile stylesheet' FATAL ERROR: 'Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'.' :Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'. javax.xml.transform.TransformerConfigurationException: Error checking type of the expression 'funcall(lower-case, [parameter-ref(legal-entity/reference)])'. at com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl.newTemplates(TransformerFactoryImpl.java:988) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:122) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:62) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:40) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:50) at org.basex.query.expr.gflwor.GFLWOR.value(GFLWOR.java:80) at org.basex.query.func.StaticFunc.invValue(StaticFu... 5305.15 ms -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

1 1

Shoud 'addraw' work as parameter with db:create?
by France Baril 25 Jan '20

25 Jan '20

Hi, I have this function that loads all the indexable content, but leaves the .png behind. Am I missing something? declare %rest:path("/demo/create-db") %rest:GET %rest:query-param('db', '{$db}', 'new-name') %rest:query-param('dir-src', '{$dir-src}', '') %output:method("html") %output:html-version("5.0") updating function democlean:create-db($db as xs:string, $dir-src as xs:string){ let $params := map {'updindex': true(), 'language': 'fr', 'addraw': true(), 'chop': false(), 'intparse': true(), 'createfilter': '*.xml, *.ditamap, *.dita'} return ( if (db:exists($db)) then db:drop($db) else (), if ($dir-src = '') then db:create($db, (), (), $params) else db:create($db, $dir-src, '/', $params), db:output(<div>DB ready</div>) ) } I also tried 'serializer: ''indent=no' as a parameter, which was unrecognized. I assume that since addraw is not unrecognized, it should work. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2