BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5256 discussions

Full text and stopwords
by Ben Engbers 13 Feb '20

13 Feb '20

Hi Christian, According to the docs, a stopword list can be used to decrease the size of the full text index. I had no problems when using this list while creating a database. Is it also possible to use this list for other purposes? 1 According to XQueryX 3.1.pdf it is possible to use a sequence of stopwords in a query: /books/book[@number="1"]//p contains text "propagating of errors" using stop words ("a", "the", "of"). How can I use this list in BaseX while building querys? 2 Is it possible to add words to the list, after that is has been loaded? Suppose that it shows that my text contains a lot of names that I want to exclude. How can I add those names to the stopwords list? 3 If I want to create a Wordcloud, I want to use all the words that remain after tokenization and removing all the words from the stopwords list. (I found this item 'https://en.wikibooks.org/wiki/XQuery/Tag_Cloud'. It might be a good starting point for creating a wordcloud) Cheers, Ben

2 2

XDM metadata
by Ben Engbers 13 Feb '20

13 Feb '20

Hi Christian, According to the server protocol, when first sending \04 to the server, the resulting items from the query are returned as strings, prefixed by a single byte. With my RBaseX-package, the result from "for $i in 1 to 2 return <xml>Text { $i }</xml>" is "0b" "<xml>Text 1</xml>" "0b" "<xml>Text 2</xml>" When sending \1F the strings should be prefixed by the XDM metadata. In my case however, the output is the samen as with \04. Is it possible to get the same output for querys in the basexgui so that I can see which output should be expected? This is the last remaining problem in my package. If I can resolve it, I can upload a new version. Cheers, Ben

2 2

file:move() fails when moving to another file system
by Zimmel, Daniel 12 Feb '20

12 Feb '20

Hi, I am able to file:copy() or file:write() a file from a Linux system to a Windows mount (via cifs). I am not able to file:move() to the same target. The error says "file:io-error: Die Operation ist nicht erlaubt" BaseX version is 9.2.1 Is this a bug or a known restriction with moving things around in Java? Thanks, Daniel

3 6

basexclient "Failed to construct terminal"
by Ben Engbers 11 Feb '20

11 Feb '20

Hi, It probably has been asked before but I found nothing on this topic. Whenever I try to start basex or basexclient on my Fedora 31 linux distribution, I get this output: BaseX 9.3.1 [Client] Probeer 'help' om informatie te krijgen. [ERROR] Failed to construct terminal; falling back to unsupported java.lang.NumberFormatException: For input string: "0x100" at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65) at java.lang.Integer.parseInt(Integer.java:580) at java.lang.Integer.valueOf(Integer.java:766) at jline.internal.InfoCmp.parseInfoCmp(InfoCmp.java:59) at jline.UnixTerminal.parseInfoCmp(UnixTerminal.java:233) at jline.UnixTerminal.<init>(UnixTerminal.java:64) at jline.UnixTerminal.<init>(UnixTerminal.java:49) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at java.lang.Class.newInstance(Class.java:442) at jline.TerminalFactory.getFlavor(TerminalFactory.java:209) at jline.TerminalFactory.create(TerminalFactory.java:100) at jline.TerminalFactory.get(TerminalFactory.java:184) at jline.TerminalFactory.get(TerminalFactory.java:190) at jline.console.ConsoleReader.<init>(ConsoleReader.java:240) at jline.console.ConsoleReader.<init>(ConsoleReader.java:232) at jline.console.ConsoleReader.<init>(ConsoleReader.java:220) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.basex.util.ConsoleReader$JLineConsoleReader.<init>(ConsoleReader.java:146) at org.basex.util.ConsoleReader.get(ConsoleReader.java:55) at org.basex.BaseX.console(BaseX.java:166) at org.basex.BaseX.<init>(BaseX.java:152) at org.basex.BaseXClient.<init>(BaseXClient.java:35) at org.basex.BaseXClient.main(BaseXClient.java:22) 'basex help' gives this output: Gestopt bij /home/bengbers/, 1/5: [XPDY0002] element(help): Context is undeclared. Am I missing something? Cheers, Ben

3 9

ft search with wildcards does not work with higher Unicode characters
by Omar Siam 11 Feb '20

11 Feb '20

Hi, I just came across this strange behavior collection('dc_tunico')//*[text() contains text 'rwḥ' using wildcards] yields nothing vs collection('dc_tunico')//*[text() contains text 'rwḥ'] yields the correct result <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-vicav">rwḥ</gram> <gram xmlns="http://www.tei-c.org/ns/1.0" type="root" xml:lang="ar-aeb-x-tunis-vicav">rwḥ</gram> Any ideas why this is the case? Best regards Omar

2 14

Reg : XQUERY Performence
by chandra Sekhar 07 Feb '20

07 Feb '20

Dear Basex Team, we have one collection with 3,00,000(3 lakhs) xmls and the collection size is 4 gb,on this collection we are running xquery ,this query taking more than 20 minutes.Here we need to run xquery all 3 lakhs xmls(for report purpose we need to get data from all xmls) . Note : Same query running very quick on huge size of collction(size more than 30gb) but in this case number of xmls in that collection is less(nearly 350). Please suggest any clue to tune the query. Regards, Sekhar

1 0

how to count and remove "entities"
by thufir 04 Feb '20

04 Feb '20

Not sure of the correct lingo, but I'm building a database of tweets. As I run it, duplicate tweets are added to the database. I can see the duplicates with: for $tweets in db:open("twitter") return <tweet>{$tweets/json/id__str}</tweet> Firstly, how would I select the json node for a duplicate entity. But, before even selecting that node, recursively look to see if there's more than one result for that id__str value. How would I even generate a count of each occurrence for the data of a specific id__str? thanks, Thufir

2 5

No difference for output from 'FULL' or 'RESULTS'
by Ben Engbers 04 Feb '20

04 Feb '20

Hi, As far as I can remember when using early versions from my client-software, the main difference in output after sending \04 or \1F to the database, was that in the latter case the output was preceded with XDM Meta data. # Full query_txt <- "for $i in 1 to 2 return <xml>Text { $i }</xml>" query_obj <- Query(Session, query_txt) result <- Full(query_obj) resulted in: "0b" "<xml>Text 1</xml>" "0b" "<xml>Text 2</xml>" # Iterate over query query2 <- "for $i in 3 to 4 return <xml>Iter { $i }</xml>" query_iterate <- Query(Session, query2) # <== Alternative call to query-object while (More(query_iterate)) { cat(Next(query_iterate), "\n") } resulted in: <xml>Iter 3</xml> <xml>Iter 4</xml> Now, iterating over the same query gives: 0b <xml>Iter 3</xml> 0b <xml>Iter 4</xml> Did something change in the client/server protocol or did I introduce an error somewhere? Ben

2 2

Finalizing Query-Objects
by Ben Engbers 04 Feb '20

04 Feb '20

Hi, The people from CRAN strongly suggested to add tests (comparable to Unit-tests) to my package (RBaseX). Their request led me to take another critical look at my code. So far the tests do not give an error message. But after completing the last test, 'testthat' reports 1 failure without further explanation. After changing the order in which the tests are executed, the failure is always caused by the last test. Therefore I think that it are not the tests that cause an error, but the finalize-process. At this moment, my code is based upon 3 classes: 'RBaseXClient' creates a new client-session. This session use 'SocketClass' to communicate with basexserver. When used in query-mode, the session uses 'QueryClass' to create new query-objects. Due to this architecture, it is easy to explicitly close a regular query-object, but (at least in R) it is difficult to close query-objects when finalizing the session-object. How does the basexserver respond to closing the session without first explicitly closing all open querys? Does this result in an error? Ben

2 2

Add command: name of the input will be set as path?
by thufir 03 Feb '20

03 Feb '20

What does it mean that "if null, the name of input will be set as the path"? Javadoc: Add public Add(java.lang.String path, java.lang.String input) Constructor, specifying a target path and an input. Parameters: path - target path, optionally terminated by a new file name. If null, the name of the input will be set as path. input - input file or XML string I'm looking to add an xml file, so am using "null" for the path: https://stackoverflow.com/q/60035605/262852 but what are the implications? the "name of the input" will be "set as path"? Where is the "name of the input"? What is "path" in relation to a String which exists only in memory? Just pass a string like: new Add(null, stringXml).execute(context); and that should add to the currently open database? thanks, Thufir

2 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk