November 2014 - BaseX-Talk - mailman.uni-konstanz.de

More Diacritic Questions
by Chris Yocum 01 Dec '14

01 Dec '14

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 Hi Everyone, I am rather confused again about diacritic handling in basex. For instance, with Full Text turned on a word like athgabáil will match both athgabail and athgabáil with "diacritics insensitive" which is what I would expect. However, if I try to match a word like cúachṡnaidm (with s with a dot above), it will not match without "diacritics sensitive" turned on in the query itself. I am rather confused why it would match in the case of athgabáil but not in the case of cúachṡnaidm. Does anyone know why this is happening and how to make it match like the other match? All the best, Chris -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iF4EAREIAAYFAlRyFScACgkQDjE+CSbP7HogoQD/eyQT0ioILJv3KHL1cKyNi+Ht a8s0g3Az5o6Uvnniw50A/Reyycsn8YiIY3naEOPuwKydBOUwrYKSe5fjOTqtZyXl =jycQ -----END PGP SIGNATURE-----

4 15

How to use ft:search() for querying 2 or more phrases?
by John Best 28 Nov '14

28 Nov '14

Hi BaseX Team, The subject itself is explanatory. I have following query - ft:search("Articles", ("electromagnetic waves"), map { 'mode':='Phrase' })/ancestor::Doc return $x This query searches for "electromagnetic waves" as a phrase. I want to search another phrase "electromagnetic particles" with the previous phrase. List only those Articles having both these phrases. -- Have a nice day JBest

3 8

CSV : escape character feature
by Fabrice Etanchaud 28 Nov '14

28 Nov '14

Dear all, I did not find a way to specify how to escape quotes when importing a csv file with quotes=yes. Here is an example : "12345"|"TOTO LE HERO"|"Toto le héro 3 \"A'' LP"|"67"|"8051"|"4000"|"XX"|""|"LU"|""|""|"ITE"|""||"GB"|""|"20.10" where quotes are escaped with a leading \ (the '' after the A are two single quotes). But it seems BaseX detects quote quote ("") as escaped quote. Could it be possible to have in the future an option to override the default behavior ? Best regards, Fabrice Etanchaud Questel/Orbit

2 4

unexpected behaviour
by Rob Stapper 27 Nov '14

27 Nov '14

Hi, I'm playing with the new XQuery 3.1 functions amongst which the JSON-serilization. I would expect all three snippets below to result in the same output but all three give a different result. Snippet 1: ======= declare option output:method 'json'; serialize( <a>test</a> ) Snippet 2: ======= serialize( <a>test</a> , map{ 'method' : 'json'} ) Snippet 3: ======= declare option output:method 'json'; serialize( <a>test</a> , map{ 'method' : 'json'} ) If I do the same with XML-serilization than all three results are the same. Are my expectations correct in this? - Rob --- Dit e-mailbericht is gecontroleerd op virussen met Avast antivirussoftware. http://www.avast.com

2 3

Windows startup script problems
by Marc van Grootel 27 Nov '14

27 Nov '14

Hi, I just downloaded the latest snapshot and on Windows I got a problem with the startup scripts. I saw that compared to earlier the way to set JVM options has changed. In my case this was causing problems. When I started the default basexhttp.bat I got: Invalid maximum heap size: -Xmx512m I looked at the batch script and had to change the BASEX_JVM line from set BASEX_JVM=-Xmx512m %BASEX_JVM% to set BASEX_JVM=-Xmx512m Could it be that the extra space after 512m is causing the problem. Probably same issue in other startup scripts. (nice language windows batch file, isn't it ...) --Marc

2 1

BaseX outputting php segments as comment nodes.
by France Baril 25 Nov '14

25 Nov '14

Hi, I am trying to output some html that have php instructions, and the instructions keep showing as comments. For example: <body> <?php include 'footer/index.html'; ?> </body> Show up as: <body></body> Example: *declare* %rest:path('/cms/ehtml2html5') %rest:GET %output:method("html") %output:html-version("5.0")... *function* *xhtmlsrc:view-html5*(){ <body> <?php include 'footer/index.html'; ?> </body>}; What am I missing? -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 5

Http-module error response-bodies always returned as string
by Johan Mörén 25 Nov '14

25 Nov '14

Hi I have a REST service that communicates details about any errors that occurs during execution via a an XML-payload in the response body. I have noticed that the http-module ignores the content-type header of the response if the status-code is > 399. Then it is flagged as being in error and in HttpPayload this line forces the content type of the body to text/plain HttpPayload.java // error: use text/plain as content type final String ct = error ? TEXT_PLAIN : utype != null ? utype : contentType(ctype); Overriding the content type via the override-media-type attribute of http:request doesn't help either in this case. Is there any special reason that error response-bodies are handled in this way? To my knowledge it is very common that REST services provides error information by sending it in the response body. I guess that changing the default behaviour might break existing implementations. But perhaps an additional attribute in the http-request could flag that the media-type of the content-type should be used even with error-responses. Or perhaps via an additional option in the http:send-request() function. Exampel of request and response where this error occurs. Request: http:send-request(<http:request override-media-type="application/xml" href="{'http://localhost:9595/sequencegenerator/objectInstanceId/' || '0'}" method="get"/>) Response: <http:response xmlns:http="http://expath.org/ns/http-client" status="400" message="Bad Request"> <http:header name="nbrOfIds" value="0"/> <http:header name="typeOfId" value="objectInstanceId"/> <http:header name="Transfer-Encoding" value="chunked"/> <http:header name="breadcrumbId" value="ID-2013M-2-local-61198-1416819131884-37-54"/> <http:header name="User-Agent" value="Java/1.7.0_45"/> <http:header name="Accept" value="text/html, image/gif, image/jpeg, *; q=.2, */*; q=.2"/> <http:header name="Content-Type" value="application/xml"/> <http:header name="Server" value="Jetty(8.1.15.v20140411)"/> <http:body media-type="text/plain"/> </http:response><faultResponse><errorMessage>number of ids must be a positive integer larger than 0</errorMessage></faultResponse> Regards, Johan Mörén

2 4

Re: [basex-talk] best way to process a collection
by Christian Grün 25 Nov '14

25 Nov '14

Hi Peter, > In this case there are about 23k documents. My approach is given in the attached file. I have a basex client and server running and also an apache tika server. it's all on a 32 bit machine so heap size is restricted. I initially get a JSON file with the URLs to a set of Excel or PDF docs, PUT those to Tika and then PUT those to basex. > > I have had to find a way of chunking (using subsequence) otherwise I get Out of Memory errors. > However, doing a small subsequence seems to take ages. I have had this programme running over 3 days and it didn't complete. Hm, 23k documents does not sound that much. I know too less about Tika. What part of the code is responsible for the error? Could you provide me with the stack trace of the OOM error (you may need to use -d to get it on screen)? Christian

1 0

best way to process a collection
by pw＠themail.co.uk 25 Nov '14

25 Nov '14

Hello list I have a large collection of documents that I want to process and was wanting to get peoples' views on the best design patterns for this. I guess I'm looking at how to map-reduce or similar for a FLOWR process, which AFAIK is a single thread operation. Are there any suitable approaches within a single programme? Could I pre-process the programme to define collection subsequences and then run multiple clients against a basex server? TIA Peter

2 1

REST queries: "Read permissions needed"
by Jérôme Chauveau 25 Nov '14

25 Nov '14

Hi, i am using BaseX79 as a webapp - embedded in a tomcat7 server. I am working on a php application which runs REST xqueries to my BaseX server. I created a "mydb" database and a user "myuser". Then i granted READ permissions for "myuser". > *GRANT read TO myuser* > *GRAND read TO myuser ON mydb* > *show users* Username Read Write Create Admin ------------------------------------ admin X X X X myuser X > *show users on mydb* Username Read Write --------------------- myuser X All my REST xqueries returns a "READ permission needed." message with the user "myuser" when its works properly with the admin user account. Moreover, REST xqueries via a web browser (logged as 'myuser') works properly too. Did i miss something? Thank's for help. Jérôme. -- Jérôme Chauveau - SAIC-CERTIC - Campus 4 Université de Caen Basse-Normandie

2 8