BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5256 discussions

Repeating "bin/basexhttp -S" and "bin/basexhttpstop"
by AirQuick 15 Sep '20

15 Sep '20

Repeating "bin/basexhttp -S" and "bin/basexhttpstop" is no longer supported? On BaseX 9.4.1 and 9.4.2, you can repeat: $ java -version java version "1.8.0_261" Java(TM) SE Runtime Environment (build 1.8.0_261-b12) Java HotSpot(TM) 64-Bit Server VM (build 25.261-b12, mixed mode) $ BaseX941/basex/bin/basexhttp -S /tmp/BaseX941/basex/.basex: writing new configuration file. BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @676ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @227ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX941/basex/bin/basexhttp -S BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @231ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX941/basex/bin/basexhttpstop BaseX 9.4.1 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @237ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). On 9.4.3, you can't: $ BaseX943/basex/bin/basexhttp -S /tmp/BaseX943/basex/.basex: writing new configuration file. BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @309ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was started (port: 8984). Server was started (port: 1984). $ BaseX943/basex/bin/basexhttpstop BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @250ms to org.eclipse.jetty.util.log.Slf4jLog HTTP Server was stopped (port: 8984). Server was stopped (port: 1984). $ BaseX943/basex/bin/basexhttp -S BaseX 9.4.3 [HTTP Server] [main] INFO org.eclipse.jetty.util.log - Logging initialized @254ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.util.log - Logging initialized @225ms to org.eclipse.jetty.util.log.Slf4jLog [main] INFO org.eclipse.jetty.server.Server - jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 1.8.0_261-b12 [main] INFO org.eclipse.jetty.webapp.StandardDescriptorProcessor - NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet [main] INFO org.eclipse.jetty.server.session - DefaultSessionIdManager workerName=node0 [main] INFO org.eclipse.jetty.server.session - No SessionScavenger set, using defaults [main] INFO org.eclipse.jetty.server.session - node0 Scavenging every 600000ms [main] WARN org.eclipse.jetty.server.handler.ContextHandler.ROOT - unavailable org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) [main] WARN org.eclipse.jetty.webapp.WebAppContext - Failed startup of context o.e.j.w.WebAppContext@44f75083{BaseX: The XML Database and XQuery Processor,/,file:///tmp/BaseX943/basex/webapp/,UNAVAILABLE}{/tmp/BaseX943/basex/webapp} javax.servlet.ServletException: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.http.BaseXServlet.init(BaseXServlet.java:39) at org.eclipse.jetty.servlet.ServletHolder$WrapperServlet.init(ServletHolder.java:1289) at org.eclipse.jetty.servlet.ServletHolder.initServlet(ServletHolder.java:602) at org.eclipse.jetty.servlet.ServletHolder.initialize(ServletHolder.java:413) at org.eclipse.jetty.servlet.ServletHandler.lambda$initialize$0(ServletHandler.java:767) at java.util.stream.SortedOps$SizedRefSortingSink.end(SortedOps.java:352) at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:483) at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) at java.util.stream.StreamSpliterators$WrappingSpliterator.forEachRemaining(StreamSpliterators.java:312) at java.util.stream.Streams$ConcatSpliterator.forEachRemaining(Streams.java:743) at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:580) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:791) at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:360) at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1445) at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1409) at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:855) at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:275) at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169) at org.eclipse.jetty.server.Server.start(Server.java:408) at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110) at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97) at org.eclipse.jetty.server.Server.doStart(Server.java:372) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:72) at org.basex.BaseXHTTP.<init>(BaseXHTTP.java:128) at org.basex.BaseXHTTP.main(BaseXHTTP.java:52) Caused by: org.basex.core.BaseXException: Server is running or permission was denied (port: 1984). at org.basex.BaseXServer.<init>(BaseXServer.java:108) at org.basex.http.HTTPContext.init(HTTPContext.java:102) at org.basex.http.BaseXServlet.init(BaseXServlet.java:37) ... 26 more Failed to bind to /0.0.0.0:8984 -- AirQuick

2 4

missing web.xml from docker image
by Nicholas Saunders 15 Sep '20

15 Sep '20

I've just opened an issue: https://github.com/BaseXdb/basex/issues/1936 based on an inability to run the docker image: https://devops.stackexchange.com/q/12338/23443 but thought I'd ask here if there might be something obvious. I'm creating the container from the hub image with: docker run -d \ --name basexhttp \ --publish 1984:1984 \ --publish 8984:8984 \ --volume "$HOME/basex/data":/srv/basex/data \ --volume "$HOME/basex/repo":/srv/basex/repo \ --volume "$HOME/basex/webapp":/srv/basex/webapp \ basex/basexhttp:latest and another person reported the missing file. Is the file missing? I'm not sure.

6 11

Best way to re-create existing root element with all attributes
by Yitzhak Khabinsky 13 Sep '20

13 Sep '20

Hello, This is input XML: <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> <employee emp="12" dept="26"> <name>John</name> <job>Animator</job> <employee emp="123" dept="27"> <name>James</name> <job>Assistant</job> </employee> </employee> </employee> Desired output XML: <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> </employee> Overall, it is a so called 'modified identity transformation' in XSLT parlance. Output XML shall be the same, except the child <employee> element and its children. Question: What is the best way to re-create existing root element with all its attributes? My implementation: xquery version "3.1"; declare context item := document { <employee emp="1" dept="55"> <name>Peter</name> <job>Director</job> <employee emp="12" dept="26"> <name>John</name> <job>Animator</job> <employee emp="123" dept="27"> <name>James</name> <job>Assistant</job> </employee> </employee> </employee> }; (: working version :) element {fn:node-name(/*)} { let $y := ./*/@* return $y, (: copy all attributes :) for $x in ./*/(* except employee) return $x } (: NOT working version, trying to make it more concise :) element {fn:node-name(/*)} {/*/@*} { return for $x in ./*/(* except employee) return $x } Regards, Yitzhak Khabinsky

3 2

tail recursion issue in 9.4.3
by Mark McSweeny 13 Sep '20

13 Sep '20

Hello, I have encountered a difference in behaviour between versions 9.3.3 and 9.4.3 for a certain query involving tail recursion. In 9.3.3 the compiled query plan correctly applied tail call optimization. But in 9.4.3 tail call optimization is not applied, resulting in a stack overflow during execution. Here is a minimal query that demonstrates the issue: declare function local:f($n, $xs) { if ($n = 0) then $xs else let $x := copy $node := <a/> modify ( rename node $node as 'x') return $node return local:f($n - 1, ($xs, $x)) }; local:f(2000, ()) Mark

2 2

big data performance
by Matthias Schütze 10 Sep '20

10 Sep '20

Hello BaseX list, I'm completely new to BaseX and a bit overwhelmed of the resources found so far in the wiki. So, please forgive my ask for advices to novices. My question: Is BaseX capable of handling TEI-XML files under following circumstances. # of TEI-files: ~10^7 # of directories where these are files stored in: ~10^5 # of words in TEI/body to be indexed: ~5*10^9 yearly increment: 10^9 words in about 10^6 files The main concern is full-text search within TEI/body which must be performant: users interact with the database searching full text. Indexing the aforementioned amount of data should be achievable in reasonable time, say: - initial indexing may last some days, if necessary - incremental(?) indexing of new data should be an overnight job Can I give BaseX a try? Or should I look elsewhere? Cheers, Matthias

2 6

creating epub and odf with bases
by Jos van den Oever 08 Sep '20

08 Sep '20

Hello all, As you might know, epub files and ODF files are zip files with specific contents. BaseX supports the expath zip module and could in theory be used for creating these files if it were not for a missing simple feature. There is one rule for epub and ODF files that cannot be followed by BaseX at the moment: the first file in the zip container should be named 'mimetype' and is a plain test file that contains the mimetype string. This is meant to allow applications to read the mimetype at a fixed offset in the file and without doing decompression. In unzip -vl it looks like this: Length Method Size Cmpr Date Time CRC-32 Name -------- ------ ------- ---- ---------- ----- -------- ---- 20 Stored 20 0% 10-14-2018 05:57 2cab616f mimetype Here is an XQuery to create a file with just that entry: ````xquery declare namespace zip = "http://expath.org/ns/zip"; let $zip := <zip:file href="new.epub"> <zip:entry name="mimetype" compressed="no" method="text"> {"application/epub+zip"} </zip:entry> </zip:file> return zip:zip-file($zip) ``` BaseX does not support the 'compressed' option. Without that option the file 'mimetype' is stored in compressed form and cannot be used by applications to quickly determine the mimetype of the file. Modifying the xml in an exisiting epub or ODF with zip:update-entries is also not possible because the mimetype file is still compressed. An additional issue: when reading a zip file, the entries in <zip:file> are not in the same order as they are in the zip file. So when modifying an existing file, the mimetype entry has to moved to the front of the list explicitly. In short: to make BaseX support the creation of epub en ODF files it should: - support the 'compressed' attribute - retain the order of files in the zip file in the <zip:file> element. Best regards, Jos

3 18

Re: [basex-talk] [EXTERNAL] - Re: Re. Encoding support for the BaseX server
by Christian Grün 07 Sep '20

07 Sep '20

Hi Srikumar, > 3. Without "<?xml version="1.0" encoding="ISO-8859-1"?>" encoding line in XML file, we are failing store XML file(i.e., ISO-8859-1 encoded file) with below error: > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. Have you revised the way how you export files from BaseX? Are you still using String.getBytes() ? If you want your exported docs to be ISO-8859-1-encoded, and if you want to output the XML declaration, you can declare serialization options in the prolog of your query [1]. Best, Christian [1] https://docs.basex.org/wiki/Serialization On Mon, Sep 7, 2020 at 9:47 AM Srikumar Choudhury <schoudhu(a)opentext.com> wrote: > > Hi Christian, > > 1. Currently by default, we are able to store UTF-8 encoding XML files. > 2. Storing of different encoding files are succeeding if we specify the below line: > <?xml version="1.0" encoding="ISO-8859-1"?> > 3. Without "<?xml version="1.0" encoding="ISO-8859-1"?>" encoding line in XML file, we are failing store XML file(i.e., ISO-8859-1 encoded file) with below error: > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. > How do we make basex server to store certain format of encoded file(In above example, it is ISO-8859-1 encoded file)? > Thanks, > Srikumar > > ________________________________ > From: Christian Grün <christian.gruen(a)gmail.com> > Sent: Sunday, September 6, 2020 2:05 PM > To: Sharath Babu Pulumati <spulumat(a)opentext.com> > Cc: James Ball <basex-talk(a)jamesball.co.uk>; BaseX <basex-talk(a)mailman.uni-konstanz.de>; Rajiv Pandya <rpandya(a)opentext.com>; Srikumar Choudhury <schoudhu(a)opentext.com> > Subject: Re: [EXTERNAL] - Re: Re. Encoding support for the BaseX server > > Please note that your code has various flaws that might lead to the > erroneous result. For example, you should avoid calling > String.getBytes, as it will use the default character encoding of your > platform, not necessarily UTF-8 (see [1]). > > I have attached the output that I get for your updated example (it > doesn’t trigger any errors). Did you check the encoding of your > document that’s output by your Java code > (outputxml_06000001800029e2p.xml)? > > [1] https://urldefense.com/v3/__https://docs.oracle.com/javase/7/docs/api/java/… > > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > createDatabase: started creating database=DEMO_ENCODING > [10:29:20.124] INFO: XQConnection-1 created, the databaseName > property was never specified at the XQDataSource level. > xqs.getConnection completed > [10:29:20.124] TRACE: XQConnection.getStaticContext() invoked. > [10:29:20.125] TRACE: XQConnection-1.createExpression() invoked. > [10:29:20.183] TRACE: XQConnection.getStaticContext() invoked. > [10:29:20.270] DEBUG: XQExpression-1.close() invoked. > [10:29:20.270] DEBUG: XQExpression-1.close() invoked. > createDatabase: completed creating database=DEMO_ENCODING > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > xqs.getConnection completed > [10:29:20.278] TRACE: XQConnection.getStaticContext() invoked. > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > StoreDocument: BaseX test store ANSI encoded xml doc > [10:29:20.279] TRACE: XQConnection-2.createExpression() invoked. > [10:29:20.279] TRACE: XQConnection.getStaticContext() invoked. > [10:29:20.308] TRACE: XQExpression-2.executeQuery(), raw XQuery > resolved to: db:replace('DEMO_ENCODING', > '6300000180000114/06000001800029e2p.xml','c:\Users\user\Desktop\p.xml') > xqpe.executeQuery completed > [10:29:20.844] DEBUG: XQExpression-2.close() invoked. > StoreDocument: BaseX content push for ANSI encoding is completed > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > RetrieveDocument: BaseX test retrieve xml doc > [10:29:20.844] TRACE: XQConnection-2.createExpression() invoked. > [10:29:20.844] TRACE: XQConnection.getStaticContext() invoked. > [10:29:20.844] TRACE: XQExpression-3.executeQuery(), raw XQuery > resolved to: db:open('DEMO_ENCODING', > '6300000180000114/06000001800029e2p.xml') > xqpe.executeQuery completed > RetrieveDocument: BaseX test retrieve xml doc completed > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ReStoreDocument: BaseX test store ANSI encoded xml doc > [10:29:20.851] TRACE: XQConnection-2.createExpression() invoked. > [10:29:20.851] TRACE: XQConnection.getStaticContext() invoked. > [10:29:20.851] TRACE: XQExpression-4.executeQuery(), raw XQuery > resolved to: db:replace('DEMO_ENCODING', > '6300000180000114/06000001800029e2p_re_store.xml','c:\Users\user\Desktop\outputxml_06000001800029e2p.xml') > xqpe.executeQuery completed > [10:29:20.858] DEBUG: XQExpression-4.close() invoked. > ReStoreDocument: BaseX content push for ANSI encoding is completed > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > > > On Sun, Sep 6, 2020 at 10:19 AM Sharath Babu Pulumati > <spulumat(a)opentext.com> wrote: > > > > Hi Christian, > > > > Below is the error stack trace's stating the error during the file uploading using the both BaseX GUI & Sample program: > > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > By Using the BaseX GUI: > > Error: > > Stopped at ., 1/11: > > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. > > Optimized Query: > > db:replace("DEMO_ENCODING", "6300000180000114/06000001800029e2p_re_store.xml", "C:\Sharath\outputxml_06000001800029e2p.xml") > > Query: > > db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p_re_store.xml','C:\Sharath\outputxml_06000001800029e2p.xml') > > Query Plan: > > <QueryPlan compiled="true" updating="false"> > > <DbReplace name="db:replace" type="empty-sequence()" size="0"> > > <Str type="xs:string" size="1">DEMO_ENCODING</Str> > > <Str type="xs:string" size="1">6300000180000114/06000001800029e2p_re_store.xml</Str> > > <Str type="xs:string" size="1">C:\Sharath\outputxml_06000001800029e2p.xml</Str> > > </DbReplace> > > </QueryPlan> > > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > By Using the Sample Program: > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > createDatabase: started creating database=DEMO_ENCODING > > [13:30:33.103] INFO: XQConnection-1 created, the databaseName property was never specified at the XQDataSource level. > > xqs.getConnection completed > > [13:30:33.103] TRACE: XQConnection.getStaticContext() invoked. > > [13:30:33.103] TRACE: XQConnection-1.createExpression() invoked. > > [13:30:33.135] TRACE: XQConnection.getStaticContext() invoked. > > [13:30:33.432] DEBUG: XQExpression-1.close() invoked. > > [13:30:33.432] DEBUG: XQExpression-1.close() invoked. > > createDatabase: completed creating database=DEMO_ENCODING > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > xqs.getConnection completed > > [13:30:33.432] TRACE: XQConnection.getStaticContext() invoked. > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > StoreDocument: BaseX test store ANSI encoded xml doc > > [13:30:33.447] TRACE: XQConnection-2.createExpression() invoked. > > [13:30:33.447] TRACE: XQConnection.getStaticContext() invoked. > > [13:30:33.510] TRACE: XQExpression-2.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml','C:\Sharath\p.xml') > > xqpe.executeQuery completed > > [13:30:34.369] DEBUG: XQExpression-2.close() invoked. > > StoreDocument: BaseX content push for ANSI encoding is completed > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > RetrieveDocument: BaseX test retrieve xml doc > > [13:30:34.385] TRACE: XQConnection-2.createExpression() invoked. > > [13:30:34.385] TRACE: XQConnection.getStaticContext() invoked. > > [13:30:34.400] TRACE: XQExpression-3.executeQuery(), raw XQuery resolved to: db:open('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml') > > xqpe.executeQuery completed > > RetrieveDocument: BaseX test retrieve xml doc completed > > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > ReStoreDocument: BaseX test store ANSI encoded xml doc > > [13:30:34.416] TRACE: XQConnection-2.createExpression() invoked. > > [13:30:34.416] TRACE: XQConnection.getStaticContext() invoked. > > [13:30:34.416] TRACE: XQExpression-4.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p_re_store.xml','C:\Sharath\outputxml_06000001800029e2p.xml') > > javax.xml.xquery.XQException: > > BXCE001 - Stopped at ., 1/11: > > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. > > at com.test.BasexTest.ReStoreDocument(BasexTest.java:159) > > at com.test.BasexTest.main(BasexTest.java:32) > > ReStoreDocument: BaseX content push for ANSI encoding is completed > > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > FYI, I have attached the new sample program along with the snippet collected from BaseX GUI while reproducing the issue. > > My query is regarding, why i'm unable to import the document which is exported from basex? > > > > Thanks, > > Sharath. > > > > ________________________________ > > From: Christian Grün <christian.gruen(a)gmail.com> > > Sent: Saturday, September 5, 2020 10:44 PM > > To: Sharath Babu Pulumati <spulumat(a)opentext.com> > > Cc: James Ball <basex-talk(a)jamesball.co.uk>; BaseX <basex-talk(a)mailman.uni-konstanz.de>; Rajiv Pandya <rpandya(a)opentext.com>; Srikumar Choudhury <schoudhu(a)opentext.com> > > Subject: Re: [EXTERNAL] - Re: Re. Encoding support for the BaseX server > > > > > > Please find the attached zip, which contains the sample program for replicating the encoding issue with the provided datafiles. > > Could you please review the provided sample and help me in resolving this issue. > > > > > > After having created "testenvSSL1" database, and after having fixed your local paths, I ran your example, and it didn’t trigger any errors. > > > > Please give me more information on what you believe goes wrong. > > > >

1 0

Re: [basex-talk] http:send-request / http:request with Azure API key
by James Ball 06 Sep '20

06 Sep '20

Hello Jozef, I see that you’ve made some progress with your issue but in case it helps I think I had a very similar problem at one point - my computer would happily connect to an SSL server but BaseX could not. I cannot remember the details with certainty but IIRC it was caused by me running the BaseX server using a particular version of the Java Runtime which had a very old certificate store. I think I was able to change to a different version of Java (or update the certificate store to a more recent one) and the problem went away. I don’t know if I was missing a a root certificate or something had expired. Regards, James > On 5 Sep 2020, at 11:00, basex-talk-request(a)mailman.uni-konstanz.de wrote: > > > From: Jozef Aerts <basex(a)xml4pharma.com> > Subject: [basex-talk] http:send-request / http:request with Azure API key > Date: 5 September 2020 at 07:49:31 BST > To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> > > > Dear colleagues, > We are using XQuery with BaseX for the development of hundreds of validation rules for CDISC Standards ("Open Rules for CDISC Standards"). > For some of these rules we need a lookup using a RESTful web server located at CDISC. Until now, that server used basic authentication until now, but they are moving to using an Azure API key. > For the new mechanism, the curl request is: > > curl -X GET https://ngp-apim-dev.azure-api.net/api/mdr/products \ > -H "Accept: application/json" \ > -H "Ocp-Apim-Subscription-Key: abcdef0123456789abcdef0123456789" > > So, based on the documentation at https://docs.basex.org/wiki/HTTP_Client_Module, <https://docs.basex.org/wiki/HTTP_Client_Module>for XQuery I used: > let $response := http:send-request( > <http:request method='get' href='https://ngp-apim-dev.azure-api.net/api/mdr/products'> > <http:header name="Ocp-Apim-Subscription-Key" value="{$apikey}"/> > </http:request>) > > and: > let $response := http:send-request( > <http:request method='get'> > <http:header name="Ocp-Apim-Subscription-Key" value="{$apikey}"/> > </http:request>,'https://ngp-apim-dev.azure-api.net/api/mdr/products') > > where $apikey is my personal key, which works when working with curl or in a Java program. > > but I get a "Connection failed". > > From a few experiments, it looks as the server is reached, but then refuses to do something with the request. I cannot see however what the details of the failure is. > > Any idea what I am doing wrong? > > Many thanks in advance, > Jozef Aerts > XML4Pharma > >

1 0

Re: [basex-talk] [EXTERNAL] - Re: Re. Encoding support for the BaseX server
by Christian Grün 06 Sep '20

06 Sep '20

Please note that your code has various flaws that might lead to the erroneous result. For example, you should avoid calling String.getBytes, as it will use the default character encoding of your platform, not necessarily UTF-8 (see [1]). I have attached the output that I get for your updated example (it doesn’t trigger any errors). Did you check the encoding of your document that’s output by your Java code (outputxml_06000001800029e2p.xml)? [1] https://docs.oracle.com/javase/7/docs/api/java/lang/String.html#getBytes() +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ createDatabase: started creating database=DEMO_ENCODING [10:29:20.124] INFO: XQConnection-1 created, the databaseName property was never specified at the XQDataSource level. xqs.getConnection completed [10:29:20.124] TRACE: XQConnection.getStaticContext() invoked. [10:29:20.125] TRACE: XQConnection-1.createExpression() invoked. [10:29:20.183] TRACE: XQConnection.getStaticContext() invoked. [10:29:20.270] DEBUG: XQExpression-1.close() invoked. [10:29:20.270] DEBUG: XQExpression-1.close() invoked. createDatabase: completed creating database=DEMO_ENCODING +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ xqs.getConnection completed [10:29:20.278] TRACE: XQConnection.getStaticContext() invoked. +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ StoreDocument: BaseX test store ANSI encoded xml doc [10:29:20.279] TRACE: XQConnection-2.createExpression() invoked. [10:29:20.279] TRACE: XQConnection.getStaticContext() invoked. [10:29:20.308] TRACE: XQExpression-2.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml','c:\Users\user\Desktop\p.xml') xqpe.executeQuery completed [10:29:20.844] DEBUG: XQExpression-2.close() invoked. StoreDocument: BaseX content push for ANSI encoding is completed +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ RetrieveDocument: BaseX test retrieve xml doc [10:29:20.844] TRACE: XQConnection-2.createExpression() invoked. [10:29:20.844] TRACE: XQConnection.getStaticContext() invoked. [10:29:20.844] TRACE: XQExpression-3.executeQuery(), raw XQuery resolved to: db:open('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml') xqpe.executeQuery completed RetrieveDocument: BaseX test retrieve xml doc completed +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ ReStoreDocument: BaseX test store ANSI encoded xml doc [10:29:20.851] TRACE: XQConnection-2.createExpression() invoked. [10:29:20.851] TRACE: XQConnection.getStaticContext() invoked. [10:29:20.851] TRACE: XQExpression-4.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p_re_store.xml','c:\Users\user\Desktop\outputxml_06000001800029e2p.xml') xqpe.executeQuery completed [10:29:20.858] DEBUG: XQExpression-4.close() invoked. ReStoreDocument: BaseX content push for ANSI encoding is completed +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ On Sun, Sep 6, 2020 at 10:19 AM Sharath Babu Pulumati <spulumat(a)opentext.com> wrote: > > Hi Christian, > > Below is the error stack trace's stating the error during the file uploading using the both BaseX GUI & Sample program: > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > By Using the BaseX GUI: > Error: > Stopped at ., 1/11: > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. > Optimized Query: > db:replace("DEMO_ENCODING", "6300000180000114/06000001800029e2p_re_store.xml", "C:\Sharath\outputxml_06000001800029e2p.xml") > Query: > db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p_re_store.xml','C:\Sharath\outputxml_06000001800029e2p.xml') > Query Plan: > <QueryPlan compiled="true" updating="false"> > <DbReplace name="db:replace" type="empty-sequence()" size="0"> > <Str type="xs:string" size="1">DEMO_ENCODING</Str> > <Str type="xs:string" size="1">6300000180000114/06000001800029e2p_re_store.xml</Str> > <Str type="xs:string" size="1">C:\Sharath\outputxml_06000001800029e2p.xml</Str> > </DbReplace> > </QueryPlan> > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > By Using the Sample Program: > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > createDatabase: started creating database=DEMO_ENCODING > [13:30:33.103] INFO: XQConnection-1 created, the databaseName property was never specified at the XQDataSource level. > xqs.getConnection completed > [13:30:33.103] TRACE: XQConnection.getStaticContext() invoked. > [13:30:33.103] TRACE: XQConnection-1.createExpression() invoked. > [13:30:33.135] TRACE: XQConnection.getStaticContext() invoked. > [13:30:33.432] DEBUG: XQExpression-1.close() invoked. > [13:30:33.432] DEBUG: XQExpression-1.close() invoked. > createDatabase: completed creating database=DEMO_ENCODING > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > xqs.getConnection completed > [13:30:33.432] TRACE: XQConnection.getStaticContext() invoked. > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > StoreDocument: BaseX test store ANSI encoded xml doc > [13:30:33.447] TRACE: XQConnection-2.createExpression() invoked. > [13:30:33.447] TRACE: XQConnection.getStaticContext() invoked. > [13:30:33.510] TRACE: XQExpression-2.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml','C:\Sharath\p.xml') > xqpe.executeQuery completed > [13:30:34.369] DEBUG: XQExpression-2.close() invoked. > StoreDocument: BaseX content push for ANSI encoding is completed > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > RetrieveDocument: BaseX test retrieve xml doc > [13:30:34.385] TRACE: XQConnection-2.createExpression() invoked. > [13:30:34.385] TRACE: XQConnection.getStaticContext() invoked. > [13:30:34.400] TRACE: XQExpression-3.executeQuery(), raw XQuery resolved to: db:open('DEMO_ENCODING', '6300000180000114/06000001800029e2p.xml') > xqpe.executeQuery completed > RetrieveDocument: BaseX test retrieve xml doc completed > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > ReStoreDocument: BaseX test store ANSI encoded xml doc > [13:30:34.416] TRACE: XQConnection-2.createExpression() invoked. > [13:30:34.416] TRACE: XQConnection.getStaticContext() invoked. > [13:30:34.416] TRACE: XQExpression-4.executeQuery(), raw XQuery resolved to: db:replace('DEMO_ENCODING', '6300000180000114/06000001800029e2p_re_store.xml','C:\Sharath\outputxml_06000001800029e2p.xml') > javax.xml.xquery.XQException: > BXCE001 - Stopped at ., 1/11: > [FOUP0002] "C:/Sharath/outputxml_06000001800029e2p.xml" (Line 1): Invalid byte 1 of 1-byte UTF-8 sequence. > at com.test.BasexTest.ReStoreDocument(BasexTest.java:159) > at com.test.BasexTest.main(BasexTest.java:32) > ReStoreDocument: BaseX content push for ANSI encoding is completed > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > FYI, I have attached the new sample program along with the snippet collected from BaseX GUI while reproducing the issue. > My query is regarding, why i'm unable to import the document which is exported from basex? > > Thanks, > Sharath. > > ________________________________ > From: Christian Grün <christian.gruen(a)gmail.com> > Sent: Saturday, September 5, 2020 10:44 PM > To: Sharath Babu Pulumati <spulumat(a)opentext.com> > Cc: James Ball <basex-talk(a)jamesball.co.uk>; BaseX <basex-talk(a)mailman.uni-konstanz.de>; Rajiv Pandya <rpandya(a)opentext.com>; Srikumar Choudhury <schoudhu(a)opentext.com> > Subject: Re: [EXTERNAL] - Re: Re. Encoding support for the BaseX server > > > Please find the attached zip, which contains the sample program for replicating the encoding issue with the provided datafiles. > Could you please review the provided sample and help me in resolving this issue. > > > After having created "testenvSSL1" database, and after having fixed your local paths, I ran your example, and it didn’t trigger any errors. > > Please give me more information on what you believe goes wrong. > >

1 0

http:send-request / http:request with Azure API key
by Jozef Aerts 06 Sep '20

06 Sep '20

2 3

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk