February 2020 - BaseX-Talk - mailman.uni-konstanz.de

basexclient "Failed to construct terminal"
by Ben Engbers 11 Feb '20

11 Feb '20

Hi, It probably has been asked before but I found nothing on this topic. Whenever I try to start basex or basexclient on my Fedora 31 linux distribution, I get this output: BaseX 9.3.1 [Client] Probeer 'help' om informatie te krijgen. [ERROR] Failed to construct terminal; falling back to unsupported java.lang.NumberFormatException: For input string: "0x100" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:580) at java.lang.Integer.valueOf(Integer.java:766) at jline.internal.InfoCmp.parseInfoCmp(InfoCmp.java:59) at jline.UnixTerminal.parseInfoCmp(UnixTerminal.java:233) at jline.UnixTerminal.<init>(UnixTerminal.java:64) at jline.UnixTerminal.<init>(UnixTerminal.java:49) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at java.lang.Class.newInstance(Class.java:442) at jline.TerminalFactory.getFlavor(TerminalFactory.java:209) at jline.TerminalFactory.create(TerminalFactory.java:100) at jline.TerminalFactory.get(TerminalFactory.java:184) at jline.TerminalFactory.get(TerminalFactory.java:190) at jline.console.ConsoleReader.<init>(ConsoleReader.java:240) at jline.console.ConsoleReader.<init>(ConsoleReader.java:232) at jline.console.ConsoleReader.<init>(ConsoleReader.java:220) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.basex.util.ConsoleReader$JLineConsoleReader.<init>(ConsoleReader.java:146) at org.basex.util.ConsoleReader.get(ConsoleReader.java:55) at org.basex.BaseX.console(BaseX.java:166) at org.basex.BaseX.<init>(BaseX.java:152) at org.basex.BaseXClient.<init>(BaseXClient.java:35) at org.basex.BaseXClient.main(BaseXClient.java:22) 'basex help' gives this output: Gestopt bij /home/bengbers/, 1/5: [XPDY0002] element(help): Context is undeclared. Am I missing something? Cheers, Ben

3 9

ft search with wildcards does not work with higher Unicode characters
by Omar Siam 11 Feb '20

11 Feb '20

Hi, I just came across this strange behavior collection('dc_tunico')//*[text() contains text 'rwḥ' using wildcards] yields nothing vs collection('dc_tunico')//*[text() contains text 'rwḥ'] yields the correct result <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-tunis-vicav">rwḥ</gram> Any ideas why this is the case? Best regards Omar

2 14

Reg : XQUERY Performence
by chandra Sekhar 07 Feb '20

07 Feb '20

Dear Basex Team, we have one collection with 3,00,000(3 lakhs) xmls and the collection size is 4 gb,on this collection we are running xquery ,this query taking more than 20 minutes.Here we need to run xquery all 3 lakhs xmls(for report purpose we need to get data from all xmls) . Note : Same query running very quick on huge size of collction(size more than 30gb) but in this case number of xmls in that collection is less(nearly 350). Please suggest any clue to tune the query. Regards, Sekhar

1 0

how to count and remove "entities"
by thufir 05 Feb '20

05 Feb '20

Not sure of the correct lingo, but I'm building a database of tweets. As I run it, duplicate tweets are added to the database. I can see the duplicates with: for $tweets in db:open("twitter") return <tweet>{$tweets/json/id__str}</tweet> Firstly, how would I select the json node for a duplicate entity. But, before even selecting that node, recursively look to see if there's more than one result for that id__str value. How would I even generate a count of each occurrence for the data of a specific id__str? thanks, Thufir

2 5

No difference for output from 'FULL' or 'RESULTS'
by Ben Engbers 04 Feb '20

04 Feb '20

Hi, As far as I can remember when using early versions from my client-software, the main difference in output after sending \04 or \1F to the database, was that in the latter case the output was preceded with XDM Meta data. # Full query_txt <- "for $i in 1 to 2 return <xml>Text { $i }</xml>" query_obj <- Query(Session, query_txt) result <- Full(query_obj) resulted in: "0b" "<xml>Text 1</xml>" "0b" "<xml>Text 2</xml>" # Iterate over query query2 <- "for $i in 3 to 4 return <xml>Iter { $i }</xml>" query_iterate <- Query(Session, query2) # <== Alternative call to query-object while (More(query_iterate)) { cat(Next(query_iterate), "\n") } resulted in: <xml>Iter 3</xml> <xml>Iter 4</xml> Now, iterating over the same query gives: 0b <xml>Iter 3</xml> 0b <xml>Iter 4</xml> Did something change in the client/server protocol or did I introduce an error somewhere? Ben

2 2

Finalizing Query-Objects
by Ben Engbers 04 Feb '20

04 Feb '20

Hi, The people from CRAN strongly suggested to add tests (comparable to Unit-tests) to my package (RBaseX). Their request led me to take another critical look at my code. So far the tests do not give an error message. But after completing the last test, 'testthat' reports 1 failure without further explanation. After changing the order in which the tests are executed, the failure is always caused by the last test. Therefore I think that it are not the tests that cause an error, but the finalize-process. At this moment, my code is based upon 3 classes: 'RBaseXClient' creates a new client-session. This session use 'SocketClass' to communicate with basexserver. When used in query-mode, the session uses 'QueryClass' to create new query-objects. Due to this architecture, it is easy to explicitly close a regular query-object, but (at least in R) it is difficult to close query-objects when finalizing the session-object. How does the basexserver respond to closing the session without first explicitly closing all open querys? Does this result in an error? Ben

2 2

Add command: name of the input will be set as path?
by thufir 03 Feb '20

03 Feb '20

What does it mean that "if null, the name of input will be set as the path"? Javadoc: Add public Add(java.lang.String path, java.lang.String input) Constructor, specifying a target path and an input. Parameters: path - target path, optionally terminated by a new file name. If null, the name of the input will be set as path. input - input file or XML string I'm looking to add an xml file, so am using "null" for the path: https://stackoverflow.com/q/60035605/262852 but what are the implications? the "name of the input" will be "set as path"? Where is the "name of the input"? What is "path" in relation to a String which exists only in memory? Just pass a string like: new Add(null, stringXml).execute(context); and that should add to the currently open database? thanks, Thufir

2 4

convert JSON to XML to add to database
by thufir 03 Feb '20

03 Feb '20

Hi all, How is JSON converted to XML in order to ADD to a database? JSONObject jsonTweet = tweets.getJSONObject(Long.toString(id)); xmlStringTweet = XML.toString(jsonTweet); alternately, could the JSON simply get directly added to the database? see also: https://stackoverflow.com/q/60034291/262852 thanks, Thufir

2 2

BaseX and validating the entire database
by ERRINGTON Luke 03 Feb '20

03 Feb '20

Hello, We are evaluating moving from an RDBMS (Oracle), to BaseX as much of our source data originate in XML files and converting to tables in a relational schema is painful. In general BaseX looks great! However, one thing that we lose is referential integrity, and the ability to validate data in one XML file that is referring to data in another. Are there any possibilities within BaseX or an additional module that can do this? For example: * Can we validate using a schema that applies across a collection of documents, rather than just one? * Can we use Schematron (which looks cool) to apply its inteRnal XPaths to the entire collection of documents? * Or both? * Something else? We could try using XLinks, but that would involve changing our XML data/structure, and my understanding is that BaseX doesn't support (let alone validate) them, anyway. A situation I have in mind is something like (very, very simplified): A.xml <object id="1" name="One"> </object> B.xml <object id="2" name="Two"> </object> X.xml <mapping object_from_id="1" object_to_id="2" /> Is there any way to ensure that when X.xml is added to the database that the object IDs that it is referring to actually exist in the database too? I would also like to be able to ensure that all of the <object>s in the database have unique id attributes. A schema can do this within a file, but how can I ensure that when a new object xml file is added that it is not using an ID that already exists? Thanks for any answers, Luke

8 18

JSON to XML conversion
by thufir 03 Feb '20

03 Feb '20

Hi, How do I do something like: public void transform(String fileName) throws IOException { String content = new String(Files.readAllBytes(Paths.get(fileName)), StandardCharsets.UTF_8); org.json.JSONObject json = new org.json.JSONObject(content); log.info(org.json.XML.toString(json)); } but using BaseX as below? private void baseXparseJsonFile(String fileName) throws IOException { org.basex.build.json.JsonParser jsonParser = new org.basex.build.json.JsonParser(new IOFile(fileName), new MainOptions()); //where is the xml? } Unclear on how to use the different parsers (really, just need this one parser). See also: https://stackoverflow.com/q/60022419/262852 thanks, Thufir

2 1