December 2013 - BaseX-Talk - mailman.uni-konstanz.de

JSON or JSONML output formatting
by Zachary Pride 16 Jul '14

16 Jul '14

Hello, I've been playing with BaseX lately and all-in-all am very impressed. Something I'm wrestling with however is the JSON output options. I've got various web applications that would really be simplified by receiving JSON straight away for the obvious scripting benefits. The JSON method has been giving me a lot of grief, stipulating rules I'm not sure how to follow. right now I have an element that "is typed as string and cannot be nested." I've been able to get JSONML to output but the JSON is this morass of nested Arrays... Attributes seem to get transformed into Objects but elements/tags and their values are pushed into Arrays for some rationale - which I suppose is on purpose. My question is how can I get Objects for simple key:value properties from <tag>value</tag> 's. Are there options I'm not utilizing? Would it be feasible to transform the XML output to some middle form first - setting it up to become Objects, before serializing it to JSON? Thanks! Zach Pride Associate Software Engineer Ultra Electronics, ProLogic 1000 Green River Drive, Ste. 201 Fairmont, WV 26554 zachary.pride(a)ultra-prologic.com Tel: +1 304 333 2680 ext.308 www.ultra-prologic.com This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. This e-mail from Ultra Electronics, ProLogic and any attachments to it are confidential to the intended recipient and may also be privileged or controlled by U.S. export control laws and regulations. No technical data, information or other items provided by Ultra Electronics, ProLogic in connection with this email shall be shared or provided to any foreign persons, entities, or subsidiaries without the expressed written authorization of Ultra Electronic, ProLogic. If you have received it in error please notify the sender and delete it from your system. If you are not the intended recipient you must not copy it or use it for any purpose nor disclose or distribute its contents to any other person. All communications may be subject to interception or monitoring for operational and/or security purposes. Please rely on your own virus checking as the sender cannot accept any liability for any damage arising from any bug or virus infection. Please consider the environment before printing this email.

4 4

Dynamic Module Loading
by Jean-philippe Magué 19 May '14

19 May '14

Hello, Exist-db has an util:import-module<http://exist-db.org/exist/apps/fundocs/view.html?uri=http://exist-db.org/xq…>function that allows to dynamically import an XQuery module at run time. I haven't found anything equivalent in BaseX. Is that right ? I have also tried to see how to implement such a function directly in Java, but as far as I understand the module parsing process, functions prefix are checked at compile time. That would compromise any attempt to write such a function. Am I right ? Best, Jean-Philippe -- Jean-Philippe Magué Maître de Conférences en Humanités Numériques Responsable de l'Atelier des Humanités Numériques : ahn.ens-lyon.fr Ecole Normale Supérieure de Lyon +33 (0)4 26 23 38 08 -- "Using computers will therefore lead us to a more profound and systematic knowledge of human expression; in principle, it can help us to be more humanistic than before." Busa, 1980.

6 16

bug in QueryCollection.java example
by Morris 11 Jan '14

11 Jan '14

Hi there I tried out the QueryCollection example from github and discovered there is a bug in line 47 ``` for $doc in collection() ``` causes [FODC0002] No default collection available. I think it should be ``` for $doc in collection("Collection") ``` then the error is gone.

2 1

add-dayTimeDuration-to-date
by jean-marc Mercier 11 Jan '14

11 Jan '14

Hello, I am trying to add dates and duration through BaseX, in conformance with http://www.w3.org/TR/xpath-functions-30/#func-add-dayTimeDuration-to-date. However, BaseX interpreter does not recognize the function add-dayTimeDuration-to-date, nor op:add-dayTimeDuration-to-date. Did I misunderstood something ? Thanx for your answer, Cheers, Jean-Marc

2 2

query function like matches can't work fast as = op , how to optimizer it? how to create range index?
by easy 11 Jan '14

11 Jan '14

hi,all, I found the @attribute='value' operation will fast after create attribute index, but function like matches,contains,starts-with has no effect even after create text index. how to optimum it , how to create path index, range index? thanks. -- 此致 easy 莫愁前路无知己，天下谁人不识君。

2 6

thesaurus
by Xavier-Laurent SALVADOR 07 Jan '14

07 Jan '14

Hi, waiting for Christmas, i was playing with Basex. I had no problem for using a short Thesaurus i built a few days ago. But when i tried to use the extended one (26Mo), i get this error message. Is this a problem of mine ? Here is an extract of my thesaurus: <thesaurus xmlns="http://www.crealscience.fr"> <entry> <term>excusable</term> <synonym> <term>amnistiable</term> </synonym> <synonym> <term>pardonnable</term> </synonym> </entry> </thesaurus> Error: Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 7.7.2 Java: Oracle Corporation, 1.7.0_45 OS: Windows 7, x86 Stack Trace: java.lang.NullPointerException at org.basex.query.ft.Thesaurus.text(Thesaurus.java:178) at org.basex.query.ft.Thesaurus.build(Thesaurus.java:135) at org.basex.query.ft.Thesaurus.init(Thesaurus.java:115) at org.basex.query.ft.Thesaurus.find(Thesaurus.java:190) at org.basex.query.ft.ThesQuery.find(ThesQuery.java:48) at org.basex.query.ft.FTTokenizer.cache(FTTokenizer.java:112) at org.basex.query.ft.FTWords.contains(FTWords.java:259) at org.basex.query.ft.FTWords.item(FTWords.java:113) at org.basex.query.ft.FTContainsExpr.item(FTContainsExpr.java:45) at org.basex.query.ft.FTContainsExpr.item(FTContainsExpr.java:24) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:46) at org.basex.query.MainModule.iter(MainModule.java:93) at org.basex.query.QueryContext.iter(QueryContext.java:282) at org.basex.query.QueryContext.execute(QueryContext.java:541) at org.basex.query.QueryProcessor.execute(QueryProcessor.java:98) at org.basex.core.cmd.AQuery.query(AQuery.java:76) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:345) at org.basex.core.Command.exec(Command.java:321) at org.basex.core.Command.execute(Command.java:78) at org.basex.gui.GUI.exec(GUI.java:397) at org.basex.gui.GUI$7.run(GUI.java:347) Query: 'abaca' contains text 'chanvre' using thesaurus at '../thesauruslight.xml' Query plan: <QueryPlan> <FTContainsExpr> <Str value="abaca" type="xs:string"/> <FTWords> <Str value="chanvre" type="xs:string"/> </FTWords> </FTContainsExpr> </QueryPlan> Well, Ty for your help and ...Merry Christmas ! Xavier Salvador

3 4

Re: [basex-talk] Again need help on ft:search() :)
by Dirk Kirsten 31 Dec '13

31 Dec '13

Hello Anand, please make sure to send all help requests to the mailing list - this way all users can benefit from it. At the moment I don't see much potential to improve your query (but I am no expert on full-text search, so this is merely my opinion). The "all words" keywords are unnecessary, as you only use one word. The most important consideration is if the Full-Text Index is actually applied to your query. You can check by analyzing the query info, something like "Applying full-text index" should be found. You can find more information at https://docs.basex.org/wiki/Full-Text#Index_Processing So, have you created a Full-Text Index? This should definitely be your first step, as this will certainly boost your performance. You should also check the query info as suggested and also take a look at the optimized query plan given by the compiler, as this can point you to some bottlenecks in your query. Cheers, Dirk On 28/12/13 10:25, Anand Chiney wrote: > Dear Dirk, > > How are you ? > > Need some help on using ft:search() in following condition, if applicable. > > Following is the structure of XML file. Around 6 GB of articles in 3 XML DBs > > --- > > > <Docs> > <Doc> > <Title name="Speed of Light" author="John Best" /> > <SDesc> > <Summary> > <SSum> > <Keyword w="Speed of Light"/> > Short Summary Text here. > </SSum> > <LSum> > Long Summary. > </LSum> > </Summary> > </SDesc> > <LDesc> > Complete Description of the Article. > </LDesc> > </Doc> > <Doc> > <Title name="Vibration Analysis" author="John Best" /> > <SDesc> > <Summary> > <SSum> > <Keyword w="Vibration"/> > Short Summary Text here. > </SSum> > <LSum> > <P>Long Summary Para 1</P> > <P>Long Summary Para 2</P> > </LSum> > </Summary> > </SDesc> > <LDesc> > Complete Description of the Article. > </LDesc> > </Doc> > </Docs> > > Execution of below query is taking around 1 min !!! > > for $db in("Doc1","Doc2", "Doc3") > for $x in doc($db)/Docs/Doc > where $x/SDesc/Summary/SSum/Keyword/lower-case(@w) contains text > "vibration" and ($x/SDesc/Summary/LSum/P/text() contains text "spring" all > words or SDesc/Summary/SSum/text() contains text "spring" all words) > return $x/Title/@name > > Can this be queried using ft:search() ? I tried but failed. > > > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

:)
by Montante Tuggles 30 Dec '13

30 Dec '13

Happy new year !

1 0

BaseX for noobs : how to add user module ?
by jean-marc Mercier 30 Dec '13

30 Dec '13

Hello, I am trying to add some external features to BaseX, and would like to use them into a BaseX client XQUERY module. I can't see any simple way to do it, is there any ? Here is the scenario : suppose that you want to add a super-mega map module to BaseX, let us call it supermegamap, that is a collection of functions : supermegamap:new, supermegamap:contains, supermegamap:get. I would like to use my supermegamap through BaseX via a xquery module : let $my_supermegamp := supermegamap:new(). I see only two quite not very handy ways to do this : 1) The first one is to use JAVA bindings. Ok, it will work, but is not really elegant. 2) The second one is to fork BaseX code : adding the JAVA code to BaseX, modifying the file Function.JAVA. That might work, should be efficient, but it is quite heavy, and overall, will be most probably a dead-code the next time I will have to upgrade BaseX. Is there any alternative way ? Thx Jean-Marc

3 3

Re: [basex-talk] BaseX-Talk Digest, Vol 48, Issue 60
by Anand Chiney 30 Dec '13

30 Dec '13

Hi, The number (1, 2, 3,....) are the various searches done.. The huge amount (its not $$$$ ;) ) is the memory usage in K as indicated by Windows Task Manager. Query's, rather XQuery's are of various kinds, including XQuery functions like disitnct-values, casting functions, and many more.. some using joins, some using ft:search()... Well, I think, the reason would be in JAVA code itself, not related to BaseX.. On Mon, Dec 30, 2013 at 4:30 PM, <basex-talk-request(a)mailman.uni-konstanz.de > wrote: > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Memory usage !! (John Best) > 2. Re: Memory usage !! (jean-marc Mercier) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 30 Dec 2013 16:04:40 +0530 > From: John Best <johnbest5673(a)gmail.com> > To: basex-talk(a)mailman.uni-konstanz.de > Subject: [basex-talk] Memory usage !! > Message-ID: > <CAO14Co4C85Y+VA6fURygkb-jUbeqX4qJ0Hm= > biduq8vMFDnzKg(a)mail.gmail.com> > Content-Type: text/plain; charset="iso-8859-1" > > Dear Team, > > I have developed and application using Eclipse RCP. I am using BaseX 7.6 to > store XML data. > > Yesterday, when I was testing the application with various kind of > searches, the response was quite slow as I went ahead with more and more > searches. > > To my surprise, I notices the in Windows Task Manager, the javaw.exe was > consuming more memory... Then I restarted the laptop and did this procedure > again > > Following is the memory usage - > > 1 - 84920 > 2 - 101584 > 3 - 108224 > 4 - 109284 > 5 - 111768 > 6 - 128468 > 7 - 160616 > 8 - 180212 > 9 - 198313 > 10 - 212592 > > > Why this is so ? and how can I reduce this memory usage by javaw.exe ? > > > > -- > Have a nice day > JBest >

1 0