- BaseX-Talk - mailman.uni-konstanz.de

Editor: save file before running tests
by Andreas Mixich 01 Aug '18

01 Aug '18

Hi, it seems, the editor runs unit tests from the file as it is on disk. Could the user be notified of unsaved changes before running tests? I just spent some quality time trying to understand, why my assertions failed when I realized, that... ;-) -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 2

Wasn't there a function, that would walk a website?
by Andreas Mixich 01 Aug '18

01 Aug '18

Hi, somehow it deems to me, that I once saw a function in BaseX extensive module library, that would recursively read a web-page from remote, following all the links in it. But now I can't find it. Am I dreaming? -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

3 6

about xml:base when using multiple nested xi:include
by Marco Randazzo 30 Jul '18

30 Jul '18

Dear all, My example (in attachment) employs xi:include elements to include other xml files. The example is constituted by a main.xml file which includes another file (include1.xml) stored in a subfolder, called include1. include1.xml, in turn, includes another xml file (include2.xml) stored in a subfolder of include1 which is called include2. Overall, the example consists of four folder levels and only the last file, include4.xml, contains data. When I import main.xml in baseX, I obtain the following result: <main xmlns:xi="http://www.w3.org/2001/XInclude"> <level1 xml:base="./include1/include1.xml"> <level2 xml:base="./include1/include2/include2.xml"> <level3 xml:base="./include2/include3/include3.xml"> <level4 xml:base="./include3/include4/include4.xml"> <data>0</data> <data>1</data> </level4> </level3> </level2> </level1> </main> The xml tree is correct, but I have doubts about the value of the attribute xml:base. In particular: - level1: I think that the value of xml:base ( i.e. ./include1/include1.xml) is correct. - level2: xml:base value is correct if its meaning is a path relative to the root file. Otherwise, if xml:base is supposed to store a path relative to the current file, then it should be ./include2/include2.xml. - level3: This seems to be not correct, neither as an absolute path, nor as a relative path. I think it should be ./include1/include2/include3/include3.xml as a path relative to the root file or ./include3/include3.xml as a path relative to the current file. - level4: Same as level3. What do you think? Am I missing something? What are the specifications for the value of xml:base? Thank you, Marco Randazzo

2 3

how to prevent org.basex.core.jobs.JobException error
by radim-havlicek＠post.cz 30 Jul '18

30 Jul '18

Hello, can I extend some value in BaseX to prevent org.basex.core.jobs.JobException error? Best regards, Radim Havlicek

2 1

Messy result with TagSoup
by Andreas Mixich 29 Jul '18

29 Jul '18

Hi, If I use `fetch:xml($url, map{'parser':'html'})` all is fine! The next one gives a correct result (although, in contrary to the browser, without namespaces and doctype): let $url := "https://bartoszmilewski.com/2014/10/28/category-theory-for-programmers-the-…" let $response := http:send-request(<http:request method='get'/>, $url) return $response[2] This creates a mess: let $url := "https://bartoszmilewski.com/2014/10/28/category-theory-for-programmers-the-…" let $response := http:send-request(<http:request method='get'/>, $url) return html:parse($response[2]) gives (partial): <html> <body>Category Theory for Programmers: The Preface | Bartosz Milewski's Programming Cafe/* */ if ( 'function' === typeof WPRemoteLogin ) { document.cookie = "wordpress_test_cookie=test; path=/"; if ( document.cookie.match( /(;|^)\s*wordpress_test_cookie\=/ ) ) { WPRemoteLogin(); } etc. I also tried: let $url := "https://bartoszmilewski.com/2014/10/28/category-theory-for-programmers-the-…" let $response := http:send-request(<http:request method='get'/>, $url) return html:parse($response[2], map{ 'html': false(), 'lexical': true(), 'nocdata': true(), 'nodefaults': true(), 'nons': false() }) This adds only the xhtml namespace, but the rest is the same. html:parser() -> "TagSoup" I don't know enough about Java, to test which TagSoup version is in use via the GUI. I am getting this result, when using the GUI on Windows 10 with BaseX 9.0.1 As I have seen, there was a thread on this list in 2016 about eventual replacement of TagSoup: https://www.mail-archive.com/basex-talk@mailman.uni-konstanz.de/msg08928.ht… What about https://about.validator.nu/htmlparser/ ? Thank you. -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 3

Is it possible to set the root for resolving include and import in xslt:transform
by Omar Siam 28 Jul '18

28 Jul '18

Hi list! I have an XSL snippet that includes and imports some XSL files. I pass this to xslt:transform and the includes and imports are resolved using the working directory where basex was started from. On my server that was / and on my Windows development machine C:\Users\user\basex\bin. This was not what I expected. Quick way to see the effect: declare namespace xsl="http://www.w3.org/1999/XSL/Transform"; xslt:transform(<root><test/></root>, <xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" version="2.0"> <xsl:template match="test"><root><xsl:value-of select="static-base-uri()"/></root></xsl:template> </xsl:stylesheet>) Perhaps in a future version it may be possible to set that to the directory the XQuery runs from or to be able to just specify what it should be. Best regards Omar Siam

3 2

More authentication options?
by Peter Villadsen 27 Jul '18

27 Jul '18

I was previously using simple basic authentication, which will not pass muster within our organization. I therefore was happy to go to Digest authentication, which seems to have solved my problems for now. However, I was wondering if there will be an option for more advanced authentication scenarios, like certificates or possibly OAuth? Microsoft's SQL server SQL server has the concept of "windows authentication" where the windows security model is used (users who are already signed into windows do not have to present further creds). I don't know how that DB works when it runs on Linux though. Best Regards Peter Villadsen Principal Architect Microsoft Business Applications Group

1 0

Curious query optimization
by Sebastian Zimmer 27 Jul '18

27 Jul '18

Hi, I have a query which is optimized in a curious way in BaseX 9.0.2 (yesterday's snapshot). This is the original query: xquery version "3.1"; declare namespace tei ="http://www.tei-c.org/ns/1.0"; let $string := "string" let $fuzzy := false() return ( collection('ZK')/tei:TEI[ if (false()) then (.[descendant::text() contains text {$string} using fuzzy]) else (.[descendant::text() contains text {$string}]) ], collection('ZK')/tei:TEI[ if ($fuzzy) then (.[descendant::text() contains text {$string} using fuzzy]) else (.[descendant::text() contains text {$string}]) ] ) And this is the optimized one (newlines inserted by me for better readability): ( ft:search("ZK", "string" using language 'English')/ancestor::tei:TEI[parent::document-node()], ft:search("ZK", "string" using fuzzy using language 'English')/ancestor::tei:TEI[parent::document-node()] ) I'm curious why the second search is using fuzzy, even though the variable $fuzzy is false. I presume that query optimization is independent of the data, so you won't need the data to reproduce. But if you do, I can provide it. A database with enabled full-text index is required obviously. Best regards, Sebastian Zimmer -- Sebastian Zimmer sebastian.zimmer(a)uni-koeln.de <mailto:sebastian.zimmer@uni-koeln.de> Cologne Center for eHumanities <http://cceh.uni-koeln.de> DH Center at the University of Cologne @CCeHum <https://twitter.com/CCeHum>

2 10

xquery question: replacing multiple values
by Marco Randazzo 25 Jul '18

25 Jul '18

Dear all, I just started learning XQuery. I have the following XML: <Keywords> <Record Keywords="Bus"> 10 20 30 40</Record> <Record Keywords="Bus"> 11 21 31 41</Record> </Keywords> I'm using the following script to multiply by 2 values 30 and 31. for $v in /Keywords/Record let $v1 := xs:float($v/tokenize(.,"[|]| ")[3]) return replace value of node $v with replace ($v, $v/tokenize(.,"[|]| ")[3], xs:string($v1 * 2)) The output is correct (please tell me if my script is ok or if there are better ways to accomplish the same task). <Keywords> <Record Keywords="Bus">10 20 60 40</Record> <Record Keywords="Bus">11 21 62 41</Record> </Keywords> Now I would like to perform a similar operation but: case 1) applying the same operation on multiple elements (i.e. element 3 and 4) case 2) applying the same operation on all element (i.e. 1,2,3,4) For case 2) I tried the following (just removing the index [3]) for $v in /Keywords/Record let $v1 := xs:float($v/tokenize(.,"[|]| ")) return replace value of node $v with replace ($v, $v/tokenize(.,"[|]| "), xs:string($v1 * 2)) But I get the error: Item expected, sequence found: ("10", "20", "...") I also tried to write a script with two nested for loops, but unsuccessfully. Can you help me?

2 1

Parallelization
by Giuseppe Celano 24 Jul '18

24 Jul '18

I am having fun with xquery:fork-join() and I see that it really reduces evaluation time (!): I apply the same script to a collection of files, and if I use xquery:fork-join() it takes about half of the time. My computer has two cores. I was wondering what would happen if a computer had more cores/CPUs (or if the script were run on a computer cluster): could the function take advantage of all of CPUs/cores? In the future, will there be the possibility to maybe control this via parameters to pass to the function? Ciao, Giuseppe

2 6