- BaseX-Talk - mailman.uni-konstanz.de

running xquery scripts in REST server
by pw＠themail.co.uk 23 Oct '12

23 Oct '12

Hello List this is a noob question: I have BaseX 7.3 set up using httpserver. I can add a script to HTTPPATH and run it using http://{server:port}/rest?run=myScript.xq However, if I add myScript.xq to a database and try to run it then [http://{server:port}/rest/DB/myScript.xq ] then all I get returned is the XQuery script itself as a text file, the query doesn't run. >From the examples e.g. http://docs.basex.org/wiki/REST#GET_Requests_2 I thought that I am doing the same type of call, e,g, http://localhost:8984/rest/DB/mult.xq?a=21&b=2 What should I be doing? Many thanks Peter

3 2

Re: [basex-talk] Need help on Xquery create Collection using java
by Lukas Kircher 23 Oct '12

23 Oct '12

Hi Riyaz, that's a good starting point - a huge load of things changed with BaseX since 671, so just have a look. Are you using the full text index? Regards, Lukas On Thu, Oct 18, 2012 at 11:20 AM, riyaz <riyaz.basha(a)intense.in> wrote: > Dear Lukas, > > Thanks for the quick response. > > 1) I am using Basex671.jar and basex-api.jar. Seems it is not latest > one. I will check with latest jar and update you. > > and also > > 2) while iterating in a for loop we are adding one by one xml and > where each xml is of 100kb on an average to collection. > > 199MB of multiple files( around 2000+ xml documents) to a single > collection is taking 440 mb on harddisk. > > //strAtr is a string array and contains file paths > for (int j = 0; j < strAtr.length; j++) { > new Add(strAtr[j]).execute(context); > } > > Please let me know if anything can be done, or anything needed for more > clarification. > > -- > Thanks & Regards, > Riyaz Shaik, > In10^s Technologies Ltd. > > * "What you risk reveals what you value."* > > > > > On 10/18/2012 2:18 PM, Lukas Kircher wrote: > > just a little addition: > > Depending on the nature of the document you add > and the kind of active indexes there will be some > overhead in size and space. > > 400MB/3min for a 199MB document sounds a little > special though ... > > > > On Thu, Oct 18, 2012 at 10:33 AM, Lukas Kircher <lukaskircher1(a)gmail.com> <lukaskircher1(a)gmail.com>wrote: > > > Hi Riyaz, > > 1) do you use the [latest stable snapshot] or [latest release] of BaseX? > > 2) Could you equip us with some more facts about your case, like the > exact query, the document (structure) or maybe even an SSCCE? You > could also send it directly to one of us if you don't want to post it to > the > list. > > Regards, > Lukas > > > [latest stable snapshot] http://files.basex.org/releases/latest/ > [latest release] http://files.basex.org/releases/7.3/ > > > On Thu, Oct 18, 2012 at 6:54 AM, riyaz <riyaz.basha(a)intense.in> <riyaz.basha(a)intense.in> wrote: > > > Dear Team, > > This is Riyaz from Hyderabad , India. I have been using X query > since one and half year. I need help on the following query. > > When I add xmls of 199 MB to create collection using " new > Add(xmlfilepath).execute( > context)" (JAVA), it is taking 440 MB on hard disk > and 3 mins to complete the > process. Is there any other way to reduce the size and time? > > Thanks a ton in advance and would appreciate the earliest response. > Please help me on this. > > -- > Thanks & Regards, > Riyaz Shaik, > In10^s Technologies Ltd. > > * "What you risk reveals what you value."* > > _______________________________________________ > BaseX-Talk mailing listBaseX-Talk@mailman.uni-konstanz.dehttps://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > > >

3 3

Bug in db:rename()
by Charles Kowalski 22 Oct '12

22 Oct '12

Hi, Upon executing: db:rename('dbname', '', 'path') All database data was put under a root collection named 'ath' not the expected 'path'. The first letter gets chopped, something to do probably with string manipulation and zero string length. Thanks, alex

3 3

Fw: Popular Glass Holder in Year 2012
by Handmade Glass 22 Oct '12

22 Oct '12

Dear Client, Thank you for your time . We are handblown glass decoration factory include Christmas Glass spheres, spun glass Angel, colored glass figure, perfume bottle, candle holder , glass vase etc.. Below pics are some most popular stylish candle holders in year 2012 ! Cusomized project is welcome ! Any question pls contact us at : info(a)sino-glassware.com Linda Sino Glass Ornamental Manufacture Ltd Add: Economic Development Zone ,Baoying , Jiangsu. China Website: http://www.sino-glassware.com Christmas Design: www.decoxmas.com Email: info(a)sino-glassware.com SKYPE: mouth-blownglass

1 0

Re: [basex-talk] Navigating a DOM
by Charles Foster 21 Oct '12

21 Oct '12

Hi Rainer, May I suggest XOM? [1]. Also, navigating a DOM tree is quite irksome in comparison to using XQuery/XPath. Perhaps you could consider slicing up your large document into "manageable chunks" (e.g. smaller documents) then inserting the smaller documents into BaseX with a view to then running XQuery to get specific parts of the logical large document when and as required. This approach would use less memory and may well be more efficient. May I also suggest checking out the BaseX XQJ API [2], where retrieved XML can be obtained as a Java DOM Node (e.g. Element / Document), StaX XMLStreamReader and SAX ContentHandler. Regards, Charles [1] http://www.xom.nu/ [2] http://xqj.net/basex > Hi, > > I did some first steps with BaseX, but unfortunately I was not very > successful. > > I have a really large XML file which does not fit into memory, and I > would like to navigate it as a DOM. My hope was that I could store it as > a BaseX database, retrieve the root element as a org.w3c.dom.Node, and > then start navigating down and up the DOM as needed without having to > have the whole stuff in memory. > > I tried something like this: > > QueryProcessor processor = new QueryProcessor("doc('catalog')/*", > context); > Iter iter = processor.iter(); > Item item = iter.next(); > Object node = item.toJava(); > > According to the debugger the item variable indeed denoted my root > element. However, when calling item.toJava() not only that very node was > returned. Instead BaseX obviously tried to retrieve the whole DOM > which was just the very thing I wanted to avoid. > > Am I doing something wrong here? Or is this an unforeseen use case? > > By the way, I also had trouble getting any result at all. Only with > "doc('catalog')/*" I got an item that was not null. When I tried to > retrieve all elements named "article" using "doc('catalog')//article" > the item was null. I also tried the item.iter() in order to find a > node's children. However, it turned out that item().iter().next() == item. > > And I had quite a tough time fiddling around with the documentation and > with the JavaDoc. While the documentation puts a lot of effort into > XQuery, it remains unclear to some extend how to do some basic stuff > with BaseX programmatically. This is a hurdle for the BaseX beginner. > Some more Java examples and explanations would be nice showing how to > connect to the database, submit a query and process the result. > Currently the examples show only how to dump a query result to > System.out. It would be interesting to learn about processing it further > see my troubles with Iter. > > -- > > Best regards > Rainer Klute

6 13

BaseX performance
by Christopher Harper 21 Oct '12

21 Oct '12

Hi @ll, I'm working on an CM/DM solution that uses BaseX as the metadata repository. This isn't my first stab at a DM/CM system just that the XML database portion is new to me Now when trying to scale the system up I find that I have created at least one offending query: count( distinct-values( let $item := doc('db')/repository/items/*//object for $path in $item/paths/path where starts-with($path/@name, '/Root/Temp/Import/') return $item/@uuid ) ) The '*/' could be replaced with 'documents/document' and 'folders', but that would be two separate queries and their individual times would still be offending. The goal of the query is to list items placed into a certain folder structure represented by items in the database. This seems like a straight forward query but I'm stumped at trying to get it to perform adequately. Any suggestions? / Chris

2 2

Using full Java regular expressions
by The Trainspotter 21 Oct '12

21 Oct '12

Hi, I'm currently converting my project to use BaseX instead of Saxon. One thing you can do in Saxon is provide a flag (an exclamation mark) to your regular expression to tell the matches function to use the Java regular expression processor, rather than the rather cut down expressions available in the XQuery spec. Is there anything similar in BaseX? If not what do you recommend to define a Java regular expression based function for XQuery? Thanks in advance, Gary

4 7

Need help on Xquery create Collection using java
by riyaz 18 Oct '12

18 Oct '12

Dear Team, This is Riyaz from Hyderabad , India. I have been using X query since one and half year. I need help on the following query. When I add xmls of 199 MB to create collection using " new Add(xmlfilepath).execute(context)" (JAVA), it is taking 440 MB on hard disk and 3 mins to complete the process. Is there any other way to reduce the size and time? Thanks a ton in advance and would appreciate the earliest response. Please help me on this. -- Thanks & Regards, Riyaz Shaik, In10^s Technologies Ltd. /"What you risk reveals what you value."/

2 2

running xquery scripts in REST server
by pw＠themail.co.uk 16 Oct '12

16 Oct '12

Hello List this is a noob question: I have BaseX 7.3 set up using httpserver. I can add a script to HTTPPATH and run it using http://{server:port}/rest?run=myScript.xq However, if I add myScript.xq to a database and try to run it then [http://{server:port}/rest/DB/myScript.xq ] then all I get returned is the XQuery script itself as a text file, the query doesn't run. >From the examples e.g. http://docs.basex.org/wiki/REST#GET_Requests_2 I thought that I am doing the same type of call, e,g, http://localhost:8984/rest/DB/mult.xq?a=21&b=2 What should I be doing? Many thanks Peter

1 0

Clusters
by Raymond Meester 16 Oct '12

16 Oct '12

Is it possible to set up a BaseX server as a clustered database (where data is synchronized over the servers by BaseX)? For example on two servers where a client session can be set up with "host1,host2". If one of the hosts fails then there is immediate fault tolerant failover to the second host (url). If this is possible is there an example available (couldn't find anything in this direction on GitHub)?

2 1