- BaseX-Talk - mailman.uni-konstanz.de

stream binary responses from http:module
by Johan Mörén 10 Nov '14

10 Nov '14

Hi I have built a small client in XQuery that fetches zip files from another remote service using the http-module and stores them on disk with the help of the file-module. Some of the returned zip files are really large and BaseX seems to need to materialize the files in memory before writing them to disk resulting in out of memory errors for some files. Is there some way read the response in a more streamable fashion when using the http-module? I tried using the fetch:binary function successfully but i really need the more extended functionality of the http-module. #results in out of memory if the zip file is too large file:write-binary("file.zip", http:sendrequest(...)[2]) #works all the time. file:write-binary("file.zip", fetch:binary(...)) Regards, Johan

3 7

Cross-platform deployment of BaseX
by David Leigh 10 Nov '14

10 Nov '14

I used BaseX in a Windows-only project a couple of years ago (ver 6.5 or some such thing). I found it to be excellent for rapid text queries. I'm planning on re-writing the application but would like it to be cross-platform and ideally in native binaries. I've had some "anti-Java" feedback that makes me want to see if there is a way to package/compile BaseX so that the Java is all "self-contained" in an executable(s) with no other dependencies. I think of how I understand sqlite to work and wonder if BaseX can be packaged in the same way. I see in the documentation that Maven is mentioned but I'm not really sure if that is what I'm looking for since I'm not familiar with Maven. I'm at the edges of my understanding of how a Java-based program can be packaged so please be gentle with my inexperience and ignorance. I guess the bottom line is that I'd like someone to be able to install my application on Windows, Linux or Mac without having to think about if they have Java installed on their machine or what version it is or anything. I also don't want to force someone to install Java on their machine if they specifically don't want to. Is that possible with BaseX? Thank you so much! --- This email is free from viruses and malware because avast! Antivirus protection is active. http://www.avast.com

3 4

Tomcat - Multiple BaseX Services - Startup Problems
by Bridger Dyson-Smith 10 Nov '14

10 Nov '14

Hi all, I know that there aren't many Tomcat users on this list, and that I'm echoing previous emails to the list but I wanted to see if anyone here had encountered this issue. Some pieces of this may be steps forward to solving problems that others on the list have mentioned; I've cc'd you in the hopes that the information is helpful. Tomcat can be configured to multiple services, on varying ports, in the $TOMCAT_HOME/conf/server.xml file; e.g. [1]. I have two nearly-identical WARs in the following directory structure: $TOMCAT_HOME/ \__conf/ \__ [1] example server.xml: <Server port="8005" shutdown="SHUTDOWN"> <Listener className="org.apache.catalina.core.AprLifecycleListener" SSLEngine="on"/> <Listener className="org.apache.catalina.core.JasperListener"/> <Listener className="org.apache.catalina.core.JreMemoryLeakPreventionListener"/> <Listener className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener"/> <Listener className="org.apache.catalina.core.ThreadLocalLeakPreventionListener"/> <GlobalNamingResources> <Resource name="UserDatabase" auth="Container" type="org.apache.catalina.UserDatabase" description="User database that can be updated and saved" factory="org.apache.catalina.users.MemoryUserDatabaseFactory" pathname="conf/tomcat-users.xml"/> </GlobalNamingResources> <Service name="Catalina"> <Connector port="8080" protocol="HTTP/1.1" connectionTimeout="20000" redirectPort="8443" maxThreads="125" minSpareThreads="25" maxSpareThreads="75" enableLookups="false" acceptCount="100"/> <Connector port="8009" protocol="AJP/1.3" redirectPort="8443"/> <Engine name="Catalina" defaultHost="localhost"> <Realm className="org.apache.catalina.realm.LockOutRealm"> <Realm className="org.apache.catalina.realm.UserDatabaseRealm" resourceName="UserDatabase"/> </Realm> <Host name="localhost" appBase="webapps" unpackWARs="true" autoDeploy="true"> <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs" prefix="localhost_access_log." suffix=".txt" pattern="%h %l %u %t "%r" %s %b"/> </Host> </Engine> </Service> <Service name="Catalina2"> <Connector port="18080" protocol="HTTP/1.1" connectionTimeout="20000" redirectPort="18443"/> <Connector port="18009" protocol="AJP/1.3" redirectPort="18443"/> <Engine name="Catalina2" defaultHost="localhost"> <Realm className="org.apache.catalina.realm.LockOutRealm"> <Realm className="org.apache.catalina.realm.UserDatabaseRealm" resourceName="UserDatabase"/> </Realm> <Host name="localhost" appBase="webapps2" unpackWARS="true" autoDeploy="true"> <Valve className="org.apache.catalina.valves.AccessLogValve" directory="logs2" prefix="localhost_Cat2_access_log." suffix=".txt" pattern="%h %l %u %t &quot;%r&quot; %s %b"/> </Host> </Engine> </Service> </Server>

2 5

Executing commands on Nov 6 snapshot
by Carl Leitner 10 Nov '14

10 Nov '14

Hi, Is anyone experiencing difficulties in the Nov 6 snapshot with running commands like: basex -Vc “create database junk" where I get output like: Stopped at , 1/7: Syntax: CREATE [BACKUP|DATABASE|EVENT|INDEX|USER] [...] Create database, index, user, backup or event. Creates a new database, index, user, backup or event: - BACKUP [name]: creates a backup of the database [name] - DATABASE [name] ([input]): creates the database [name] with an optional [input] - EVENT [name]: creates the event - INDEX [TEXT|ATTRIBUTE|FULLTEXT]: creates the specified index - USER [name] ([password]): creates the specified user This has been tried on a couple of machine (Ubuntu, Mac OS X, CentOS) including clean installs. It does not happen with the Oct 28 snapshot. Cheers. -carl

3 2

Dynamic Evaluation of XQUERY
by Mansi Sheth 10 Nov '14

10 Nov '14

Hello, I want to devise a generic xquery script, which accepts actual XPATH to be run across all documents in all databases, from command line. Something like: curl -i " http://localhost:8984/rest?run=get_query_result.xq&n=/root/*//calls/@name/s… " Basically, parameter "n" would hold the query. I am trying this using xquery module eval method. But, am not succeeding in it. I have my script something as under: declare variable $n as xs:string external; declare option output:item-separator "
"; let $aList := for $db in db:list() let $vars := map {'db_name':$db , 'query' : $n} let $query_to_execute := "db:open($db_name)$query" return xquery:eval($query_to_execute,$vars) return distinct-values($aList) My questions are: 1. Can we assign dynamic values as a value to a map's key ? 2. Can I map have more than one key, in query:eval ? Please point me in right direction, or explain what am I doing wrong in above code .. - Mansi

3 9

unexpected behaviour
by Rob Stapper 08 Nov '14

08 Nov '14

Hi, Running the attached program produces the next evaluation. Evaluating: - elementSeq: <A ref="var1"><B><X1/></B></A> - content0: <X1/> - content2: <X1/> - elementSeq: <A ref="var1"><B><X2/></B></A> - content0: <X2/> - content2: <X1/> I can't explain the value of the last "- content2: "-trace. I expect it to be the same value as the last "- content0: "-trace. What's happening here? - Rob Stapper --- Dit e-mailbericht bevat geen virussen en malware omdat avast! Antivirus-bescherming actief is. http://www.avast.com

2 7

Embedded Mode performance too poor
by dicker24 07 Nov '14

07 Nov '14

Hi, I am new here, I tried to integrate baseX in my Java program, but the performance is very poor in comparison with GUI. I also tried to declare to use the internal parser, but it makes no difference. Would anyone tell me what I did wrong here? Many thanks. Dicker Von Samsung Mobile gesendet

3 2

Feature Request: serializable functions
by Marco Lettere 07 Nov '14

07 Nov '14

Hello all, just out of curiosity, would it be too hard to have a serialization tool for functions that does more or less the inverse of inspect:functions i. e. given a function item returns the full function code? The use case is that I want to send out a client:execute request that is a XQuery script where functions can be attached at runtime selecting them out of a "toolbox" xqm module. And of course I don't want to manually parse the xqm to cut out the required function which could be done but is not very elegant. Example: declare function local:f($i as xs:integer) as xs:integer{ $i + 1 }; inspect:serialize(local:f#1) would yield the string "declare function local:f($i as xs:integer) as xs:integer{ $i + 1 };" I've seen that even if it is not possible to serialize or cast to string a function item, if the function is assigned to a map, calling map:serialize yields something similar to the full function code. So I thought maybe the serialization mechanism is already in place and would just need a bit of generalization. Regards, Marco.

3 6

Re: [basex-talk] Feature Request: serializable functions
by Christian Grün 06 Nov '14

06 Nov '14

Hi Carl, In the BaseX query parser, tokenization and parsing is a joint operation. in the past, we thought about splitting these steps, as the tokens could also be used in the GUI to provide better highlighting. However, we'd probably need some more coders interested in making that happen.. However, thanks for the suggestion, Christian On Thu, Nov 6, 2014 at 3:12 PM, Carl Leitner <litlfred(a)gmail.com> wrote: > On a somewhat related note, I assume that when compiling xquery you are > creating some kind of token stream. Would it be possible to add a function > like > xquery:tokenize ($query as xs:string) as item()* > which takes as input an xquery string and output the token string. > > Presumably this could be another route used to meet the use case discussed > below to select functions from a toolbox module. > > Here is an example of similar functionality in PHP: > http://php.net/manual/en/function.token-get-all.php > > Cheers, > -carl > > > On Nov 6, 2014, at 8:26 AM, Christian Grün <christian.gruen(a)gmail.com> > wrote: > > Hi Marco, > > You may be surprised (or not) that I thought about a similar > functionality. Indeed I wondered if we could allow function items as > input for client:query and xquery:evaluate. > > I like your idea of providing an explicit serialization function. For > several reasons, we cannot guarantee that the serialized > representation of an XQuery expression will always be executable. In > some case, it's even not possible because the optimizer creates new > expressions that have no counterpart in the original XQuery language. > If we provide an explicit function for serializing function code, > however, we'd be able to point this out. > > I have added a new GitHub issue [1]. > > Christian > > [1] https://github.com/BaseXdb/basex/issues/1021 > > > On Wed, Nov 5, 2014 at 3:23 PM, Marco Lettere <marco.lettere(a)dedalus.eu> > wrote: > > Hello all, > just out of curiosity, would it be too hard to have a serialization tool for > functions that does more or less the inverse of inspect:functions i. e. > given a function item returns the full function code? > The use case is that I want to send out a client:execute request that is a > XQuery script where functions can be attached at runtime selecting them out > of a "toolbox" xqm module. And of course I don't want to manually parse the > xqm to cut out the required function which could be done but is not very > elegant. > > Example: > > declare function local:f($i as xs:integer) as xs:integer{ $i + 1 }; > > inspect:serialize(local:f#1) > > would yield the string "declare function local:f($i as xs:integer) as > xs:integer{ $i + 1 };" > > I've seen that even if it is not possible to serialize or cast to string a > function item, if the function is assigned to a map, calling map:serialize > yields something similar to the full function code. So I thought maybe the > serialization mechanism is already in place and would just need a bit of > generalization. > Regards, > Marco. > >

1 0

Fwd: Preventing unescaping of entities
by Christian Grün 06 Nov '14

06 Nov '14

Hi James, Beforehand: Please send your mails to basex-talk(a)mailman.uni-konstanz.de; otherwise, they won't be directed to everyone. Currently, there is no way to prevent the unescaping the entities (the XML and XQuery specifications do not foresee this). One way to enforce the escaping of certain Unicode characters could be to provide character maps when serializing data [2]. Christian [1] http://www.w3.org/TR/xquery-31/#id-serialization [2] http://www.w3.org/TR/xslt-xquery-serialization-30/#XML_USE-CHARACTER-MAPS ____________________________________ On Wed, Nov 5, 2014 at 5:47 PM, James Sears <james.hn.sears(a)gmail.com> wrote: > How can I prevent unescaping of entities? Such that when I import an element > whose value is expressed in hexadecimal - i.e. ® - I do not want an > BaseXClient.Query result containing the non hexadecimal representation - > i.e. ®. > > What I'd like out is what I imported in :-)

1 0