January 2016 - BaseX-Talk - mailman.uni-konstanz.de

Fwd: Re: Status of BaseX Docker Container?
by Christian Grün 29 Jan '16

29 Jan '16

---------- Weitergeleitete Nachricht ---------- Von: "Eliot Kimber" <ekimber(a)contrext.com> Datum: 27.01.2016 6:25 nachm. Betreff: Re: [basex-talk] Status of BaseX Docker Container? An: "Christian Grün" <christian.gruen(a)gmail.com> Cc: > I have successfully created a new image based on the base image that > provides my custom DFST Link Manager web app. Just a matter of copying the > files into the BaseX directory structure (in my case, fetched from github). > > Because I'm doing DITA processing I have to enable DTD entity reference > resolution. I'm doing that by using the entity resolution catalog provided > by the DITA Open Toolkit. In this container context I am setting up a > separate DITA OT container (rather than bundling the OT into the BaseX > container, which would be easier but would make system configuration and > maintenance harder). So I need to work out how to expose file systems from > containers so they can share volumes. I know this is possible just haven't > done it yet. > > Cheers, > > E. > ---- > Eliot Kimber, Owner > Contrext, LLC > http://contrext.com > > > > > On 1/27/16, 4:06 AM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: > > >…thanks for the hints on the Windows solution! I’ll try it in a while. > > > > > >On Tue, Jan 26, 2016 at 11:13 PM, Eliot Kimber <ekimber(a)contrext.com> > >wrote: > >> Forgot to add the Windows part: > >> > >> Under windows have to explicitly publish the ports when running the > >> container: > >> > >> docker run --name=basex -p 8984:8984 -p 1984:1984 dfst/basex > >> > >> then you can use the IP address of the docker-engine VM to connect to > >>the > >> server: > >> > >> http://192.168.99.100:8984/ > >> > >> you can get the ip address using the "docker-machine ip" command: > >> c:\Program Files\Docker Toolbox>docker-machine ls > >> NAME ACTIVE URL STATE URL > >> SWARM DOCKER ERRORS > >> default - virtualbox Running tcp://192.168.99.100:2376 > >> v1.9.1 > >> c:\Program Files\Docker Toolbox>docker-machine ip default > >> 192.168.99.100 > >> > >> the docker-machine command replaces the older boot2docker command > >> > >> So now I have BaseX server running and accessible as Docker containers > >> under Windows and CentOS. > >> > >> OSX is still a problem: there's some issue with the docker daemon and > >> getting the docker client to connect to it. Haven't been able to find a > >> good solution in my searching. Very annoying. > >> > >> Cheers, > >> > >> E. > >> > >> > >> ---- > >> Eliot Kimber, Owner > >> Contrext, LLC > >> http://contrext.com > >> > >> > >> > >> > >> On 1/26/16, 3:50 PM, "Eliot Kimber" > >> <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >> ekimber(a)contrext.com> wrote: > >> > >>>For what it's worth, I've pushed a generic BaseX HTTP container to > >>>Docker > >>>Hub as "dfst/basex". It exposes the default ports for the base and HTTP > >>>servers (1984 and 8984). > >>> > >> >From a Linux system you connect by using the IP address of the Docker > >>>network, e.g.: > >>> > >>>http://172.17.0.2:8984/ > >>> > >>>Under Windows: > >>> > >>>The DockerFile is in GitHub here: > >>> > >>>https://github.com/dita-for-small-teams/dfst-docker > >>> > >>>My next task will be to create a container based on this one that > >>>includes > >>>specific configuration and the DFST Web application modules. Should be > >>>easy once I get to it. > >>> > >>>Cheers, > >>> > >>>E. > >>> > >>>---- > >>>Eliot Kimber, Owner > >>>Contrext, LLC > >>>http://contrext.com > >>> > >>> > >>> > >>> > >>>On 1/26/16, 9:48 AM, "Eliot Kimber" > >>><basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of > >>>ekimber(a)contrext.com> wrote: > >>> > >>>>OK, I'm going to proceed with making a generic basex Docker container > >>>>in > >>>>the DFST Docker project on GitHub. I'm using Andreas' as a starting > >>>>point > >>>>but it's pretty trivial. > >>>> > >>>>I'm working/testing on OS X, Windows, and CentOS so I should be able to > >>>>get something going. > >>>> > >>>>Cheers, > >>>> > >>>>E. > >>>>---- > >>>>Eliot Kimber, Owner > >>>>Contrext, LLC > >>>>http://contrext.com > >>>> > >>>> > >>>> > >>>> > >>>>On 1/26/16, 2:02 AM, "Christian Grün" <christian.gruen(a)gmail.com> > >>>>wrote: > >>>> > >>>>>Hi Eliot, > >>>>> > >>>>>Personally, I had a hard time making Docker work on Windows machines, > >>>>>but we have various Docker aficionados in our team and around, so I > >>>>>hope they¹ll give you some feedback soon. > >>>>> > >>>>>Cheers, > >>>>>Christian > >>>>> > >>>>> > >>>>>On Sun, Jan 24, 2016 at 8:22 PM, Eliot Kimber <ekimber(a)contrext.com> > >>>>>wrote: > >>>>>> I'm working toward using BaseX in a Docker container as part of the > >>>>>>DITA > >>>>>> for Small Teams project (we're trying to set up a system of Docker > >>>>>> containers with all the DFST parts integrated out of the box). > >>>>>> > >>>>>> I notice that Andreas Jung has create a simple container here: > >>>>>> > >>>>>> https://github.com/zopyx/docker-basex > >>>>>> > >>>>>> And pushed it to the Docker Hub in the basex namespace. > >>>>>> > >>>>>> I'm wondering what the relationship of this is, if any, to any > >>>>>>official > >>>>>> BaseX Docker support? > >>>>>> > >>>>>> Thanks, > >>>>>> > >>>>>> Eliot > >>>>>> ---- > >>>>>> Eliot Kimber, Owner > >>>>>> Contrext, LLC > >>>>>> http://contrext.com > >>>>>> > >>>>>> > >>>>>> > >>>>>> > >>>>> > >>>> > >>>> > >>>> > >>> > >>> > >>> > >> > >> > > > >

1 0

Re: [basex-talk] Unrecognized Options Running Basex in Docker Container
by Eliot Kimber 29 Jan '16

29 Jan '16

Another bit of info. If I interact with the server from within the container, e.g., connect to the basex server using the basexclient, I can set and get options but they are not reflected in the DBA app: > open test-02 Database 'test-02' was not found. [I then create test-02 using the DBA Web app to prove I'm talking to the same server] > open test-02 Database 'test-02' was opened in 0.68 ms. > set chop false CHOP: false > get chop CHOP: false But if I refresh the page for test-02 in the DBA app, it still shows a check for chop. So something seems to be up with local options. I verified that I can add data to the database itself. Thanks, E. ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com On 1/28/16, 6:10 PM, "Eliot Kimber" <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: >I'm seeing a difference in how the .basex file is processed between >running a server under OS X directly and running it in a Docker container. >In particular, my local settings are being rejected as unrecognized. > >Here's the startup messages from within the basex container: > >basex@611404b26b04:~$ basexhttp >/home/basex/.basex: Unknown option 'CATFILE'. >/home/basex/.basex: Unknown option 'DTD'. >/home/basex/.basex: Unknown option 'SKIPCORRUPT'. >/home/basex/.basex: Unknown option 'CHOP'. >/home/basex/.basex: writing new configuration file. >[main] INFO org.eclipse.jetty.server.Server - jetty-8.1.17.v20150415 >[main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP >Support for /, did not find org.apache.jasper.servlet.JspServlet >BaseX 8.3 [Server] >Server was started (port: 1984). >[main] INFO org.eclipse.jetty.server.AbstractConnector - Started >SelectChannelConnector@0.0.0.0:8984 >HTTP Server was started (port: 8984). > >I verified that with the same .basex file running 8.3 under OS X the >options are recognized and set as expected. > > >What would cause this difference in behavior? > >Here is the .basex file in the /home/basex directory when the server >starts: > >USER = admin >PASSWORD = admin >DEBUG = false >DBPATH = /home/basex/basex/data >REPOPATH = /home/basex/basex/repo >LANG = English >LANGKEYS = false >GLOBALLOCK = false > > ># Client/Server Architecture >HOST = localhost >PORT = 1984 >SERVERPORT = 1984 >SERVERHOST = >PROXYHOST = >PROXYPORT = 0 >NONPROXYHOSTS = >IGNORECERT = false >TIMEOUT = 30 >KEEPALIVE = 600 >PARALLEL = 8 >LOG = true >LOGMSGMAXLEN = 1000 > > ># HTTP Services >WEBPATH = /home/basex/basex/webapp >RESTPATH = >RESTXQPATH = >CACHERESTXQ = false >HTTPLOCAL = false >STOPPORT = 8985 >AUTHMETHOD = Basic > > ># Local options >CATFILE = /opt/dita-ot/DITA-OT/catalog-dita.xml >DTD = true >SKIPCORRUPT = true >CHOP = false >-- (this is the end of the file) -- > > >After the server starts the offending options are omitted from the >rewritten .basex file. > >The only difference I can think of is the Java version. The container uses >the OpenJDK while I have Oracle Java running in OS X: > >basex@611404b26b04:~$ java -version >openjdk version "1.8.0_66-internal" >OpenJDK Runtime Environment (build 1.8.0_66-internal-b17) >OpenJDK 64-Bit Server VM (build 25.66-b17, mixed mode) >basex@611404b26b04:~$ > >But otherwise it's exactly the same code running in both environments and >the same config file. > >Thanks, > >Eliot > >---- >Eliot Kimber, Owner >Contrext, LLC >http://contrext.com > > > >

1 0

bitmaps/binaries of variables
by Rob Stapper 27 Jan '16

27 Jan '16

Hi, Is it somehow possible to get the bitmap/binary of a $variable or a bitmap/binary-overlay of a $variable in BaseX? Since there is no bitmap-datatype I guess it is probably not possible or straight forward but BaseX continues to surprise me (in a positive manner). So maybe? TIA for any reply, Rob Stapper

2 3

get and extract .gz files from web
by Marc van Grootel 27 Jan '16

27 Jan '16

Hi, I hoped that I could use archive module to also extract gzipped files. I need to fetch/sync large XML from a web service that has the option of getting files with gzip encoding (to be nice to the web server). First attempt was to explicitly get the gz file via the URL and then treat it like an archive binary (extracting it with the recipe from the archive module page). The entries XML I get is empty so I suppose that I cannot read .gz Second attempt was to specify Accept-Encoding = gzip which indeed delivers the XML as a binary. But I probably run into the same issue when trying to extract. Is there a way to do the extraction of .gz encoded files without having to shell out to some kind of unzipper? Cheers, --Marc

4 5

Status of BaseX Docker Container?
by Eliot Kimber 26 Jan '16

26 Jan '16

I'm working toward using BaseX in a Docker container as part of the DITA for Small Teams project (we're trying to set up a system of Docker containers with all the DFST parts integrated out of the box). I notice that Andreas Jung has create a simple container here: https://github.com/zopyx/docker-basex And pushed it to the Docker Hub in the basex namespace. I'm wondering what the relationship of this is, if any, to any official BaseX Docker support? Thanks, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

2 4

Re: [basex-talk] Connecting database in C#
by Bhander, Gurbakhash S. 26 Jan '16

26 Jan '16

Hi, I'm Raj working for the U.S. EPA. I'm building an interface on the basex database. I would like to connect the database with one of my grid and charts. How can I connect this database with Grid Components using C#. Do you have any example? Thank you - Raj ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Dr. Gurbakhash S. Bhander, Env. Eng. Air Pollution Technology Branch, E305-01, National Risk Management Research Laboratory, U.S. Environmental Protection Agency, 109 T.W. Alexander Drive, Research Triangle Park, NC 27711 Phone: 919-541-7542 Cell: 919-710-1947 Fax: 919-541-0554 bhander.gurbakhash(a)epa.gov<mailto:bhander.gurbakhash@epa.gov> :) "Start every day off with a smile and get it over with" :) W. C. Fields

2 1

500 Error when using org.basex.modules.fop.FOP
by Chris Speare 26 Jan '16

26 Jan '16

I've been working with Apache FOP for converting XML (held on a BaseX instance) to PDF. Currently this involves saving nodes from the BaseX database to pass into a local FopFactory - not ideal. Have tried to pull one of the documents out and get a 500 error, then tried referencing direct files - which also errors: import module namespace fop = 'org.basex.modules.fop.FOP'; let $xml := db:open('billing_run_435')/CommercialDocument[@id="203545"] - if returned does show xml let $xsl := xslt:transform('/home/chris/Downloads/xml/billing_invoice_241040.xml', '/etc/xmlmapper/pdf_invoice.fo') - hard coded for debugging return $xml >From the log: Version: BaseX 8.3.1 Java: Oracle Corporation, 1.7.0_25 OS: Linux, amd64 Stack Trace: java.lang.NullPointerException at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:110) at org.basex.query.func.xslt.XsltTransform.transform(XsltTransform.java:59) at org.basex.query.func.xslt.XsltTransform.item(XsltTransform.java:37) at org.basex.query.expr.ParseExpr.value(ParseExpr.java:64) at org.basex.query.QueryContext.value(QueryContext.java:423) at org.basex.query.expr.gflwor.Let$LetEval.next(Let.java:187) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:95) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.func.StandardFunc.cache(StandardFunc.java:404) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:129) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:59) at org.basex.query.func.xquery.XQueryEval.iter(XQueryEval.java:44) at org.basex.query.func.fn.FnSerialize.item(FnSerialize.java:22) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:43) at org.basex.query.QueryContext.iter(QueryContext.java:412) at org.basex.query.expr.IterMap$1.next(IterMap.java:42) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.func.StandardFunc.cache(StandardFunc.java:404) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:129) at org.basex.query.func.xquery.XQueryEval.eval(XQueryEval.java:59) at org.basex.query.func.xquery.XQueryEval.iter(XQueryEval.java:44) at org.basex.query.expr.TypeCheck.iter(TypeCheck.java:87) at org.basex.query.QueryContext.iter(QueryContext.java:412) at org.basex.query.expr.If.iter(If.java:128) at org.basex.query.MainModule.iter(MainModule.java:110) at org.basex.query.QueryContext.iter(QueryContext.java:351) at org.basex.http.restxq.RestXqResponse.create(RestXqResponse.java:55) at org.basex.http.restxq.RestXqModule.process(RestXqModule.java:101) at org.basex.http.restxq.RestXqFunction.process(RestXqFunction.java:109) at org.basex.http.restxq.RestXqServlet.run(RestXqServlet.java:44) at org.basex.http.BaseXServlet.service(BaseXServlet.java:64) at javax.servlet.http.HttpServlet.service(HttpServlet.java:848) Both '/home/chris/Downloads/xml/billing_invoice_241040.xml' and '/etc/xmlmapper/pdf_invoice.fo' exist as I use them in a local java fopfactory which processes them fine. The information contained in the email and any files transmitted with it is confidential and intended for the addressee only. If you have received this email in error please accept our apologies and notify the originator. Any disclosure, copying, distribution or any other use of this communication is strictly prohibited and may be unlawful. We reserve the right to monitor and intercept communications for lawful business purposes. Wireless Innovation Ltd , Unit D2, Churcham Business Park, Churcham, Gloucestershire, GL2 8AX, Great Britain. Company Registration Number 5240202, Place of Registration Companies House Cardiff.

2 2

Command script to create a coollection and perform multiple queries on it
by michele.greco2＠email.it 26 Jan '16

26 Jan '16

Hi, let me now if i can create a collection of basex, add more XML files in it and then make the collection more queries already created earlier. I thank you in advance for your answer. Michele -- ZE-Light e ZE-Pro: servizi zimbra per caselle con dominio email.it, per tutti i dettagli Clicca qui http://posta.email.it/caselle-di-posta-z-email-it/?utm_campaign=email_Zimbr… Sponsor: Registra i domini che desideri ed inizia a creare il tuo sito web Clicca qui: http://adv.email.it/cgi-bin/foclick.cgi?mid=13323&d=25-1

2 1

[FOUT1170] Static Base URI is undefined.
by Andy Bunce 26 Jan '16

26 Jan '16

Hi, Using the latest 8.4 beta: the following code runs ok in the GUI *unparsed-text("http://www.xqueryfunctions.com/xq/functx-1.0-doc-2007-01.xq <http://www.xqueryfunctions.com/xq/functx-1.0-doc-2007-01.xq>")* But when run from the web /dba/queries gives the FOUT1170 error*.* $href looks like an absolute URI to me [1] /Andy [1] https://www.w3.org/TR/xpath-functions-31/#func-unparsed-text

2 3

Slow XQueries on a quite small database but great number of docs
by ansel.jm＠free.fr 25 Jan '16

25 Jan '16

Hello, I have a speed problem with a quite simple query (2 flwor nested) on the database below. (almost 20.000 ms !!!) The great number of docs (1200) seems to slow down the database. But the resulting database is quite small (689kB) so I'm really disappointed... If someone has an idea, it would be nice... P.S. : I tried OPTIMIZE, CREATE INDEX... Nothing will work... Thank you in advance. JMA > info db Database Properties Name: ect Size: 894 KB Nodes: 20656 Documents: 1210 Binaries: 0 Timestamp: 2016-01-25T13:34:28.000Z Resource Properties Timestamp: 2016-01-21T16:45:12.938Z Encoding: UTF-8 CHOP: true Indexes Up-to-date: true TEXTINDEX: true ATTRINDEX: true TOKENINDEX: true FTINDEX: true TEXTINCLUDE: ATTRINCLUDE: TOKENINCLUDE: FTINCLUDE: LANGUAGE: English STEMMING: false CASESENS: false DIACRITICS: false STOPWORDS: UPDINDEX: false AUTOOPTIMIZE: false MAXCATS: 100 MAXLEN: 96 INDEXSPLITSIZE: 0 FTINDEXSPLITSIZE: 0 > exit for $intervenant in ("AB","JMA","MM","SP") return element {"planning"} { attribute inter {$intervenant}, for $s in db:open("ect")/calendrier/s let $lundiS12015 :=db:open("ect")/calendrier/mois[@annee = $s/@annee and @numero='01']/debut let $nbjours :="P" || string(( $s - 1 ) * 7) || "D" let $lundi := xs:date($lundiS12015) + xs:dayTimeDuration($nbjours) let $dimanche := xs:date($lundi) + xs:dayTimeDuration("P6D") return element {'semaine'} { attribute no {$s}, attribute lundi {$lundi}, attribute dimanche {$dimanche}, for $tache in db:open("ect")/planning/tache[intervenant=$intervenant and (debut/text()) and (fin/text()) and (xs:date($lundi) lt xs:date(fin) ) and (xs:date(debut) lt xs:date($dimanche))] let $res := tokenize(base-uri($tache),'/') let $nodossier := substring($res[2],1,3) let $typedossier := substring($res[2],4,2) return element {'inter'} {$res[2] , db:open("ect")/dossier[numero=$nodossier and type=$typedossier] , $tache/libelle, $tache/debut, $tache/fin} } }

2 1