September 2020 - BaseX-Talk - mailman.uni-konstanz.de

Fwd: error in the latest developpers snapshot (BaseX944-20200919.114509)
by r.stapper＠lijbrandt.nl 26 Sep '20

26 Sep '20

Hi Christian, considder the snapshot down below and as bijlage. This genereate different results with the latest snapshot. No problem with 943 and the previous snapshot( BaseX944-20200911.135109) ============================================ declare %private function local:value1 ( $atomicItem as element( ) ) as item()* { $atomicItem/data() } ; declare %private function local:value2 ( $atomicItem as element( ) ) as item()* { trace( $atomicItem/data(), "test: ") } ; let $e := <E>test</E> return ( $e/data() , $e => local:value1() , $e => local:value2() ) ===========================================

2 2

issue: Add custom lib folder #1456
by Nicholas Saunders 25 Sep '20

25 Sep '20

For the Ubuntu install of BaseX, where's the "lib" directory for BaseX? Or, does the Ubuntu build just operate differently? see also: https://askubuntu.com/q/1276967/847449 thanks, Nick

2 2

Accessing Flexmark (Java) from Query
by Andreas Mixich 21 Sep '20

21 Sep '20

Hi, how can I translate this Java[1] to XQuery according to [2]? package com.vladsch.flexmark.samples; import com.vladsch.flexmark.util.ast.Node; import com.vladsch.flexmark.html.HtmlRenderer; import com.vladsch.flexmark.parser.Parser; import com.vladsch.flexmark.util.data.MutableDataSet; public class BasicSample { public static void main(String[] args) { MutableDataSet options = new MutableDataSet(); // uncomment to set optional extensions //options.set(Parser.EXTENSIONS, Arrays.asList(TablesExtension.create(), StrikethroughExtension.create())); // uncomment to convert soft-breaks to hard breaks //options.set(HtmlRenderer.SOFT_BREAK, " \n"); Parser parser = Parser.builder(options).build(); HtmlRenderer renderer = HtmlRenderer.builder(options).build(); // You can re-use parser and renderer instances Node document = parser.parse("This is *Sparta*"); String html = renderer.render(document); // "This is Sparta\n" System.out.println(html); } } I only get so far as to: declare namespace Node = "com.vladsch.flexmark.util.ast.Node"; declare namespace HtmlRenderer =" com.vladsch.flexmark.html.HtmlRenderer"; declare namespace Parser = "com.vladsch.flexmark.parser.Parser"; declare namespace MutableDataSet = "com.vladsch.flexmark.util.data.MutableDataSet"; declare option db:checkstrings 'false'; let $mds := MutableDataSet:new() let $builder := Parser:builder($mds) return $builder which results in DataSet{dataSet={}} I found no documentation, on how to translate something as Parser.builder(options).build() to XQuery. How do I express the method build() of the instance Parser.builder(options) I just created? Also, when I try the other way, by importing, for the following code import module namespace Node = "java:com.vladsch.flexmark.util.ast.Node"; import module namespace HtmlRenderer = "java:com.vladsch.flexmark.html.HtmlRenderer"; import module namespace Parser = "java:com.vladsch.flexmark.parser.Parser"; import module namespace MutableDataSet = "java:com.vladsch.flexmark.util.data.MutableDataSet"; let $mds := MutableDataSet:new() I get: [XQST0059] Could not instantiate com.vladsch.flexmark.util.ast.Node: java.lang.InstantiationException. Could it be, that it is only possible to call static properties via [1]? Am I right, that I need to write wrapper code in Java and then prepare results in a way, that I can retreive them from my own Java class? Thank you. [1]: https://github.com/vsch/flexmark-java/blob/master/flexmark-java-samples/src… [2]: https://docs.basex.org/wiki/Java_Bindings [3]: https://github.com/vsch/flexmark-java -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

4 8

Re: [basex-talk] Full-Text-Search Options
by Günter Dunz-Wolff 19 Sep '20

19 Sep '20

Sorry, it was my fault. Problem solved. Sorry again. Kindly regards Guenter

1 0

Full-Text-Search Options
by Günter Dunz-Wolff 19 Sep '20

19 Sep '20

Dear all, I’m using ft:mark with Options. In older versions of basex it worked fine, but with 9.3 I don’t get any results with the „distance" option and the „not in“ option. Maybe my syntax is deprecated? Example distance: ft:mark($ele[.//text() contains text {$query_string} all using wildcards using diacritics sensitive distance at most $distance words]) Example "not in": ft:mark($ele[.//text() contains text {$query_tokens} using wildcards using diacritics sensitive not in {$dont_find} using wildcards using diacritics sensitive]) Any help is appreciated. Thanks Guenter

1 0

Fulltext Distancing
by Adam Law 16 Sep '20

16 Sep '20

(: Hello - I saw some discussions about full text indexing. Dumbo here cannot work out how distance matching works. Also is it somehow possible to traverse up and down a full-index word list from a hit position rather than having to spend time say reversing strings. Is this is not possible due to how the word indexing works? If so can I preprocess https://github.com/pierrec/lz4/blob/master/fuzz/corpus/Mark.Twain-Tom.Sawye… to break it into words. I was considering making something like DTSearch (but more flexible) before I realised how difficult this is. Many thanks Dumbo :) import module namespace functx = 'http://www.functx.com'; (:fulltext <x><content><![CDATA[ https://github.com/pierrec/lz4/blob/master/fuzz/corpus/Mark.Twain-Tom.Sawye… ]]></content></x>:) (:$f - return all nodes containing queer and enterprises:) let $f := <x>{ft:search('xvue_textIndex',("enterprises", "queer"), map { 'mode': 'all' })/parent::* }</x> let $options1 := map { 'mode': 'all'} let $options2 := map { 'mode': 'all', "distance": map { "max": "5","unit": "words" }} let $options3 := map { 'mode': 'all words', "distance": map { "max": "5","unit": "words" }} let $options4 := map { 'mode': 'all words', "distance": map { "max": 5, "unit": "words" }} let $options := $options1 (:Why wont others work:) (:$g - mark words queers and enterprises. Can't get options:2,3,4 to work:) let $g := <y>{ft:mark( $f//*[ft:contains(text(), ('queer','enterprises'), $options)], 'mark')}</y> (:Hopeful - with distancing will this result in queer enterprises. Otherwise I have to postprocess more:) (:Unsure about how to return words before and words after using fulltext. Have to limit to characters:) (:Ideally, I would like to be able to specify words after and before:) let $charbefore := 30 let $charafter := 30 (:This takes a while because I am string joining large preceding-sibling:nodes() (sometimes text() and sometimes marked/text()) to return words in context:)(:Three seconds:) (:Is there a fulltext way of doing this that is faster eg traverse a word list by match position:) let $h := for $w in $g//mark return <a><preceedingWords>{ functx:reverse-string (substring( functx:reverse-string(string-join($w/preceding-sibling::node())),0,$charbefore))}</preceedingWords><match>{$w/text()}</match><followingWords>{substring(string-join($w/following-sibling::node() ),0,$charafter)}</followingWords></a> return $h (: $h := <a> <preceedingWords>thought and talked, and what </preceedingWords> <match>queer</match> <followingWords> enterprises they sometimes e</followingWords> </a> <a> <preceedingWords>t and talked, and what queer </preceedingWords> <match>enterprises</match> <followingWords> they sometimes engaged in. </followingWords> </a> Sorry about the length of this. :)

2 3

Re: [basex-talk] Best way to re-create existing root element with all attributes
by Yitzhak Khabinsky 15 Sep '20

15 Sep '20

Hi Martin, Thanks for the answer. That's exactly what I was looking for. Regards, Yitzhak Khabinsky

1 0

html:parse() fails on webpage
by Andreas Mixich 15 Sep '20

15 Sep '20

Hi, when doing: html:parse(fetch:binary("https://ant.apache.org/manual/Tasks/chmod.html"), map{"method":"xml"}) and also html:parse(fetch:binary("https://ant.apache.org/manual/Tasks/chmod.html"), map{"method":"html"}) or html:doc("https://ant.apache.org/manual/Tasks/chmod.html") I get [html:parse] Line 23: </head> found, </link> expected. I use the BaseX version from 14 minutes ago ;-) (BaseX944-20200914.223814). -- Goody Bye, Minden jót, Mit freundlichen Grüßen, Andreas Mixich

2 5

Repeating "bin/basexhttp -S" and "bin/basexhttpstop"
by AirQuick 15 Sep '20

15 Sep '20

Repeating "bin/basexhttp -S" and "bin/basexhttpstop" is no longer supported? On BaseX 9.4.1 and 9.4.2, you can repeat: $ java -version java version "1.8.0_261" Java(TM) SE Runtime Environment (build 1.8.0_261-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.261-b12, mixed mode) $ BaseX941/basex/bin/basexhttp -S /tmp/BaseX941/basex/.basex: writing new configuration file. BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @676ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @227ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX941/basex/bin/basexhttp -S BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @231ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @237ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). On 9.4.3, you can't: $ BaseX943/basex/bin/basexhttp -S /tmp/BaseX943/basex/.basex: writing new configuration file. BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @309ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX943/basex/bin/basexhttpstop BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @250ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX943/basex/bin/basexhttp -S BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @254ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.util.log - Logging initialized @225ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 1.8.0_261-b12 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 600000ms [main] WARN org.eclipse.jetty.server.handler.ContextHandler.ROOT - unavailable org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) [main] WARN org.eclipse.jetty.webapp.WebAppContext - Failed startup of context o.e.j.w.WebAppContext@44f75083{BaseX: The XML Database and XQuery Processor,/,file:///tmp/BaseX943/basex/webapp/,UNAVAILABLE}{/tmp/BaseX943/basex/webapp} javax.servlet.ServletException: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.http.BaseXServlet.init(BaseXServlet.java:39) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) Caused by: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) ... 26 more Failed to bind to /0.0.0.0:8984 -- AirQuick

2 4

missing web.xml from docker image
by Nicholas Saunders 15 Sep '20

15 Sep '20

I've just opened an issue: https://github.com/BaseXdb/basex/issues/1936 based on an inability to run the docker image: https://devops.stackexchange.com/q/12338/23443 but thought I'd ask here if there might be something obvious. I'm creating the container from the hub image with: docker run -d \ --name basexhttp \ --publish 1984:1984 \ --publish 8984:8984 \ --volume "$HOME/basex/data":/srv/basex/data \ --volume "$HOME/basex/repo":/srv/basex/repo \ --volume "$HOME/basex/webapp":/srv/basex/webapp \ basex/basexhttp:latest and another person reported the missing file. Is the file missing? I'm not sure.

6 11