October 2012 - BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] Unable to get jetty servlet to see existing database
by Christian Grün 23 Oct '12

23 Oct '12

Perfect! Thanks for the confirmation. Am 23.10.2012 20:10 schrieb "Michael Mendez" <michaelgmendez(a)gmail.com>: > That was it - I was still changing the war config instead of the .basex > for the server after changing from 7.3 to 7.5 even though I had started > using the basexhttp server instead. > > Thank you! I really look forward to testing our system with basex, I > expect a vast improvement in speed based on an alpha build I've been > playing with on the windows side. > > Michael Mendez > > > > On Tue, Oct 23, 2012 at 1:07 PM, Christian Grün <christian.gruen(a)gmail.com > > wrote: > >> Hi Michael, >> >> with 7.5, there are several, alternative options to start the BaseX >> HTTP Server, which are listed at [1]. You either need to deploy the >> WAR file, or run basexhttp. >> >> a) if you deploy the WAR file, your databases will be contained in the >> archived webapp directory. With the latest snapshots, the database >> server will be automatically started along with the web server >> >> b) if you run basexhttp, you can specify DBPATH and the path to the >> webapp directory (WEBPATH) in the .basex configuration file. >> >> Hope this helps, feel free to ask for more, >> Christian >> >> [1] http://docs.basex.org/wiki/Startup#BaseX_HTTP_Server >> ___________________________ >> >> > I am running the 7.5 snapshot now, which has been a bit easier to work >> with, >> > but I still end up stuck in the same place. >> > >> > Ultimately, I would like to be able to: >> > run basex from a cli >> > offer REST >> > be able to interact with the db via python without using REST (so I >> can >> > perform maintenance with it off and maintain separation of duties) >> > and have all of these actions performed against the same database >> > >> > I know client spawns a different instance, so I have no plans to use >> it. As >> > far as I can tell, I should be able to do all of this. I can execute >> basex >> > and perform operations, I should (haven't tested yet) be able to use >> python >> > to communicate via 1984, and I have rest running on 8984. However, I >> cannot >> > seem to get REST to recognize the existing database. >> > >> > In my set up, the DB created using basex is at /ats/BaseXData. The >> actual >> > xml files are at /ats/xml/[folders], and my install of basex is at >> > /ats/basex. Looking at the web.xml, it originally read WEB-INF/Data as >> the >> > dbapth parameter. I have tried /ats/BaseXData, ../../ats/BaseXData, and >> > other variants without any luck (stopping and starting basexhttp after >> each >> > change). I'm guessing this is more of a jetty question, but I don't >> seem to >> > get anything useful when looking for information on setting absolute >> paths >> > in a web.xml, which is where I think I'm hitting the wall. >> > >> > Thank you again! >> > >> > Michael Mendez >> > >> > >> > >> > >> > >> > On Tue, Oct 23, 2012 at 7:47 AM, Christian Grün < >> christian.gruen(a)gmail.com> >> > wrote: >> >> >> >> Dear Michael, >> >> >> >> sorry for the late feedback. Along with BaseX 7.5, several changes >> >> have been performed in the web application context, so I would like to >> >> hear if you have already tried our latest snapshot [1], and if the >> >> problems are resolved with that version. The new version will be >> >> released pretty soon, which means there will only be minor changes in >> >> the code. If you are running BaseX as web application, the .basex can >> >> be safely ignored. >> >> >> >> Christian >> >> >> >> [1] http://files.basex.org/releases/latest/ >> >> ___________________________ >> >> >> >> On Fri, Oct 19, 2012 at 5:21 PM, Michael Mendez >> >> <michaelgmendez(a)gmail.com> wrote: >> >> > I have an existing install of basex running on a centos machine. The >> >> > install >> >> > runs fine, I am able to edit .basex files to point to the main >> >> > database, >> >> > and can run the client from anywhere and connect once I make .basex >> >> > changes. >> >> > >> >> > I also have jetty6 running (on the same box) with the basex war >> package >> >> > (7.3), which also runs, is accessible, and returns valid rest >> responses. >> >> > >> >> > My issue is the rest response shows no resources available, which as >> far >> >> > as >> >> > I can tell means it is not connecting to my existing database but >> >> > creating >> >> > (or created) it's own. Based on the documentation on the site, I have >> >> > changed the web.xml's dbpath variable to the existing BaseXData >> path. I >> >> > have >> >> > used the same value I used in the .basex files, repackaged the .war, >> and >> >> > restarted jetty, with no success. >> >> > >> >> > Other changes, like to the index.html in the war, will show, so I >> know I >> >> > am >> >> > rebuilding the war and viewing those changes correctly. >> >> > >> >> > What do I need to change to make the servlet of basex see a database >> >> > folder >> >> > already available? >> >> > >> >> > I have posted this question on stackoverflow as well: >> >> > >> >> > >> http://stackoverflow.com/questions/12976335/basex-servlet-doesnt-see-existi… >> >> > >> >> > Here is my web.xml: >> >> > >> >> > >> >> > <?xml version="1.0" encoding="UTF-8"?> >> >> > <web-app >> >> > xmlns="http://java.sun.com/xml/ns/javaee" >> >> > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" >> >> > xsi:schemaLocation="http://java.sun.com/xml/ns/javaee >> >> > http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd" >> >> > version="2.5"> >> >> > >> >> > <display-name>ATS</display-name> >> >> > <description>REST Services for XML data</description> >> >> > >> >> >  >> >> > >> >> >  >> >> > <context-param> >> >> > <param-name>org.basex.mode</param-name> >> >> > <param-value>local</param-value> >> >> > </context-param> >> >> > <context-param> >> >> > <param-name>org.basex.server</param-name> >> >> > <param-value>local</param-value> >> >> > </context-param> >> >> > >> >> >  >> >> > <context-param> >> >> > <param-name>org.basex.user</param-name> >> >> > <param-value>admin</param-value> >> >> > </context-param> >> >> > <context-param> >> >> > <param-name>org.basex.password</param-name> >> >> > <param-value>admin</param-value> >> >> > </context-param> >> >> > >> >> >  >> >> > >> >> >  >> >> > <servlet> >> >> > <servlet-name>REST</servlet-name> >> >> > <servlet-class>org.basex.http.rest.RESTServlet</servlet-class> >> >> > </servlet> >> >> > <servlet-mapping> >> >> > <servlet-name>REST</servlet-name> >> >> > <url-pattern>/rest/*</url-pattern> >> >> > </servlet-mapping> >> >> > </web-app> >> >> > >> >> > >> >> > >> >> > Thank you for your time! >> >> > >> >> > >> >> > >> >> > _______________________________________________ >> >> > BaseX-Talk mailing list >> >> > BaseX-Talk(a)mailman.uni-konstanz.de >> >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> >> > >> > >> > >> > >

1 0

Re: [basex-talk] Unable to get jetty servlet to see existing database
by Christian Grün 23 Oct '12

23 Oct '12

Hi Michael, with 7.5, there are several, alternative options to start the BaseX HTTP Server, which are listed at [1]. You either need to deploy the WAR file, or run basexhttp. a) if you deploy the WAR file, your databases will be contained in the archived webapp directory. With the latest snapshots, the database server will be automatically started along with the web server b) if you run basexhttp, you can specify DBPATH and the path to the webapp directory (WEBPATH) in the .basex configuration file. Hope this helps, feel free to ask for more, Christian [1] http://docs.basex.org/wiki/Startup#BaseX_HTTP_Server ___________________________ > I am running the 7.5 snapshot now, which has been a bit easier to work with, > but I still end up stuck in the same place. > > Ultimately, I would like to be able to: > run basex from a cli > offer REST > be able to interact with the db via python without using REST (so I can > perform maintenance with it off and maintain separation of duties) > and have all of these actions performed against the same database > > I know client spawns a different instance, so I have no plans to use it. As > far as I can tell, I should be able to do all of this. I can execute basex > and perform operations, I should (haven't tested yet) be able to use python > to communicate via 1984, and I have rest running on 8984. However, I cannot > seem to get REST to recognize the existing database. > > In my set up, the DB created using basex is at /ats/BaseXData. The actual > xml files are at /ats/xml/[folders], and my install of basex is at > /ats/basex. Looking at the web.xml, it originally read WEB-INF/Data as the > dbapth parameter. I have tried /ats/BaseXData, ../../ats/BaseXData, and > other variants without any luck (stopping and starting basexhttp after each > change). I'm guessing this is more of a jetty question, but I don't seem to > get anything useful when looking for information on setting absolute paths > in a web.xml, which is where I think I'm hitting the wall. > > Thank you again! > > Michael Mendez > > > > > > On Tue, Oct 23, 2012 at 7:47 AM, Christian Grün <christian.gruen(a)gmail.com> > wrote: >> >> Dear Michael, >> >> sorry for the late feedback. Along with BaseX 7.5, several changes >> have been performed in the web application context, so I would like to >> hear if you have already tried our latest snapshot [1], and if the >> problems are resolved with that version. The new version will be >> released pretty soon, which means there will only be minor changes in >> the code. If you are running BaseX as web application, the .basex can >> be safely ignored. >> >> Christian >> >> [1] http://files.basex.org/releases/latest/ >> ___________________________ >> >> On Fri, Oct 19, 2012 at 5:21 PM, Michael Mendez >> <michaelgmendez(a)gmail.com> wrote: >> > I have an existing install of basex running on a centos machine. The >> > install >> > runs fine, I am able to edit .basex files to point to the main >> > database, >> > and can run the client from anywhere and connect once I make .basex >> > changes. >> > >> > I also have jetty6 running (on the same box) with the basex war package >> > (7.3), which also runs, is accessible, and returns valid rest responses. >> > >> > My issue is the rest response shows no resources available, which as far >> > as >> > I can tell means it is not connecting to my existing database but >> > creating >> > (or created) it's own. Based on the documentation on the site, I have >> > changed the web.xml's dbpath variable to the existing BaseXData path. I >> > have >> > used the same value I used in the .basex files, repackaged the .war, and >> > restarted jetty, with no success. >> > >> > Other changes, like to the index.html in the war, will show, so I know I >> > am >> > rebuilding the war and viewing those changes correctly. >> > >> > What do I need to change to make the servlet of basex see a database >> > folder >> > already available? >> > >> > I have posted this question on stackoverflow as well: >> > >> > http://stackoverflow.com/questions/12976335/basex-servlet-doesnt-see-existi… >> > >> > Here is my web.xml: >> > >> > >> > <?xml version="1.0" encoding="UTF-8"?> >> > <web-app >> > xmlns="http://java.sun.com/xml/ns/javaee" >> > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" >> > xsi:schemaLocation="http://java.sun.com/xml/ns/javaee >> > http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd" >> > version="2.5"> >> > >> > <display-name>ATS</display-name> >> > <description>REST Services for XML data</description> >> > >> >  >> > >> >  >> > <context-param> >> > <param-name>org.basex.mode</param-name> >> > <param-value>local</param-value> >> > </context-param> >> > <context-param> >> > <param-name>org.basex.server</param-name> >> > <param-value>local</param-value> >> > </context-param> >> > >> >  >> > <context-param> >> > <param-name>org.basex.user</param-name> >> > <param-value>admin</param-value> >> > </context-param> >> > <context-param> >> > <param-name>org.basex.password</param-name> >> > <param-value>admin</param-value> >> > </context-param> >> > >> >  >> > >> >  >> > <servlet> >> > <servlet-name>REST</servlet-name> >> > <servlet-class>org.basex.http.rest.RESTServlet</servlet-class> >> > </servlet> >> > <servlet-mapping> >> > <servlet-name>REST</servlet-name> >> > <url-pattern>/rest/*</url-pattern> >> > </servlet-mapping> >> > </web-app> >> > >> > >> > >> > Thank you for your time! >> > >> > >> > >> > _______________________________________________ >> > BaseX-Talk mailing list >> > BaseX-Talk(a)mailman.uni-konstanz.de >> > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > > >

1 0

Unable to get jetty servlet to see existing database
by Michael Mendez 23 Oct '12

23 Oct '12

I have an existing install of basex running on a centos machine. The install runs fine, I am able to edit .basex files to point to the main database, and can run the client from anywhere and connect once I make .basex changes. I also have jetty6 running (on the same box) with the basex war package (7.3), which also runs, is accessible, and returns valid rest responses. My issue is the rest response shows no resources available, which as far as I can tell means it is not connecting to my existing database but creating (or created) it's own. Based on the documentation on the site, I have changed the web.xml's dbpath variable to the existing BaseXData path. I have used the same value I used in the .basex files, repackaged the .war, and restarted jetty, with no success. Other changes, like to the index.html in the war, will show, so I know I am rebuilding the war and viewing those changes correctly. What do I need to change to make the servlet of basex see a database folder already available? I have posted this question on stackoverflow as well: http://stackoverflow.com/questions/12976335/basex-servlet-doesnt-see-existi… Here is my web.xml: <?xml version="1.0" encoding="UTF-8"?> <web-app xmlns="http://java.sun.com/xml/ns/javaee" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://java.sun.com/xml/ns/javaee http://java.sun.com/xml/ns/javaee/web-app_2_5.xsd" version="2.5"> <display-name>ATS</display-name> <description>REST Services for XML data</description>   <context-param> <param-name>org.basex.mode</param-name> <param-value>local</param-value> </context-param> <context-param> <param-name>org.basex.server</param-name> <param-value>local</param-value> </context-param>  <context-param> <param-name>org.basex.user</param-name> <param-value>admin</param-value> </context-param> <context-param> <param-name>org.basex.password</param-name> <param-value>admin</param-value> </context-param>   <servlet> <servlet-name>REST</servlet-name> <servlet-class>org.basex.http.rest.RESTServlet</servlet-class> </servlet> <servlet-mapping> <servlet-name>REST</servlet-name> <url-pattern>/rest/*</url-pattern> </servlet-mapping> </web-app> Thank you for your time!

2 1

running xquery scripts in REST server
by pw＠themail.co.uk 23 Oct '12

23 Oct '12

Hello List this is a noob question: I have BaseX 7.3 set up using httpserver. I can add a script to HTTPPATH and run it using http://{server:port}/rest?run=myScript.xq However, if I add myScript.xq to a database and try to run it then [http://{server:port}/rest/DB/myScript.xq ] then all I get returned is the XQuery script itself as a text file, the query doesn't run. >From the examples e.g. http://docs.basex.org/wiki/REST#GET_Requests_2 I thought that I am doing the same type of call, e,g, http://localhost:8984/rest/DB/mult.xq?a=21&b=2 What should I be doing? Many thanks Peter

3 2

Re: [basex-talk] Need help on Xquery create Collection using java
by Lukas Kircher 23 Oct '12

23 Oct '12

Hi Riyaz, that's a good starting point - a huge load of things changed with BaseX since 671, so just have a look. Are you using the full text index? Regards, Lukas On Thu, Oct 18, 2012 at 11:20 AM, riyaz <riyaz.basha(a)intense.in> wrote: > Dear Lukas, > > Thanks for the quick response. > > 1) I am using Basex671.jar and basex-api.jar. Seems it is not latest > one. I will check with latest jar and update you. > > and also > > 2) while iterating in a for loop we are adding one by one xml and > where each xml is of 100kb on an average to collection. > > 199MB of multiple files( around 2000+ xml documents) to a single > collection is taking 440 mb on harddisk. > > //strAtr is a string array and contains file paths > for (int j = 0; j < strAtr.length; j++) { > new Add(strAtr[j]).execute(context); > } > > Please let me know if anything can be done, or anything needed for more > clarification. > > -- > Thanks & Regards, > Riyaz Shaik, > In10^s Technologies Ltd. > > * "What you risk reveals what you value."* > > > > > On 10/18/2012 2:18 PM, Lukas Kircher wrote: > > just a little addition: > > Depending on the nature of the document you add > and the kind of active indexes there will be some > overhead in size and space. > > 400MB/3min for a 199MB document sounds a little > special though ... > > > > On Thu, Oct 18, 2012 at 10:33 AM, Lukas Kircher <lukaskircher1(a)gmail.com> <lukaskircher1(a)gmail.com>wrote: > > > Hi Riyaz, > > 1) do you use the [latest stable snapshot] or [latest release] of BaseX? > > 2) Could you equip us with some more facts about your case, like the > exact query, the document (structure) or maybe even an SSCCE? You > could also send it directly to one of us if you don't want to post it to > the > list. > > Regards, > Lukas > > > [latest stable snapshot] http://files.basex.org/releases/latest/ > [latest release] http://files.basex.org/releases/7.3/ > > > On Thu, Oct 18, 2012 at 6:54 AM, riyaz <riyaz.basha(a)intense.in> <riyaz.basha(a)intense.in> wrote: > > > Dear Team, > > This is Riyaz from Hyderabad , India. I have been using X query > since one and half year. I need help on the following query. > > When I add xmls of 199 MB to create collection using " new > Add(xmlfilepath).execute( > context)" (JAVA), it is taking 440 MB on hard disk > and 3 mins to complete the > process. Is there any other way to reduce the size and time? > > Thanks a ton in advance and would appreciate the earliest response. > Please help me on this. > > -- > Thanks & Regards, > Riyaz Shaik, > In10^s Technologies Ltd. > > * "What you risk reveals what you value."* > > _______________________________________________ > BaseX-Talk mailing listBaseX-Talk@mailman.uni-konstanz.dehttps://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > > >

3 3

Bug in db:rename()
by Charles Kowalski 22 Oct '12

22 Oct '12

Hi, Upon executing: db:rename('dbname', '', 'path') All database data was put under a root collection named 'ath' not the expected 'path'. The first letter gets chopped, something to do probably with string manipulation and zero string length. Thanks, alex

3 3

Fw: Popular Glass Holder in Year 2012
by Handmade Glass 22 Oct '12

22 Oct '12

Dear Client, Thank you for your time . We are handblown glass decoration factory include Christmas Glass spheres, spun glass Angel, colored glass figure, perfume bottle, candle holder , glass vase etc.. Below pics are some most popular stylish candle holders in year 2012 ! Cusomized project is welcome ! Any question pls contact us at : info(a)sino-glassware.com Linda Sino Glass Ornamental Manufacture Ltd Add: Economic Development Zone ,Baoying , Jiangsu. China Website: http://www.sino-glassware.com Christmas Design: www.decoxmas.com Email: info(a)sino-glassware.com SKYPE: mouth-blownglass

1 0

Re: [basex-talk] Navigating a DOM
by Charles Foster 21 Oct '12

21 Oct '12

Hi Rainer, May I suggest XOM? [1]. Also, navigating a DOM tree is quite irksome in comparison to using XQuery/XPath. Perhaps you could consider slicing up your large document into "manageable chunks" (e.g. smaller documents) then inserting the smaller documents into BaseX with a view to then running XQuery to get specific parts of the logical large document when and as required. This approach would use less memory and may well be more efficient. May I also suggest checking out the BaseX XQJ API [2], where retrieved XML can be obtained as a Java DOM Node (e.g. Element / Document), StaX XMLStreamReader and SAX ContentHandler. Regards, Charles [1] http://www.xom.nu/ [2] http://xqj.net/basex > Hi, > > I did some first steps with BaseX, but unfortunately I was not very > successful. > > I have a really large XML file which does not fit into memory, and I > would like to navigate it as a DOM. My hope was that I could store it as > a BaseX database, retrieve the root element as a org.w3c.dom.Node, and > then start navigating down and up the DOM as needed without having to > have the whole stuff in memory. > > I tried something like this: > > QueryProcessor processor = new QueryProcessor("doc('catalog')/*", > context); > Iter iter = processor.iter(); > Item item = iter.next(); > Object node = item.toJava(); > > According to the debugger the item variable indeed denoted my root > element. However, when calling item.toJava() not only that very node was > returned. Instead BaseX obviously tried to retrieve the whole DOM > which was just the very thing I wanted to avoid. > > Am I doing something wrong here? Or is this an unforeseen use case? > > By the way, I also had trouble getting any result at all. Only with > "doc('catalog')/*" I got an item that was not null. When I tried to > retrieve all elements named "article" using "doc('catalog')//article" > the item was null. I also tried the item.iter() in order to find a > node's children. However, it turned out that item().iter().next() == item. > > And I had quite a tough time fiddling around with the documentation and > with the JavaDoc. While the documentation puts a lot of effort into > XQuery, it remains unclear to some extend how to do some basic stuff > with BaseX programmatically. This is a hurdle for the BaseX beginner. > Some more Java examples and explanations would be nice showing how to > connect to the database, submit a query and process the result. > Currently the examples show only how to dump a query result to > System.out. It would be interesting to learn about processing it further > see my troubles with Iter. > > -- > > Best regards > Rainer Klute

6 13

BaseX performance
by Christopher Harper 21 Oct '12

21 Oct '12

Hi @ll, I'm working on an CM/DM solution that uses BaseX as the metadata repository. This isn't my first stab at a DM/CM system just that the XML database portion is new to me Now when trying to scale the system up I find that I have created at least one offending query: count( distinct-values( let $item := doc('db')/repository/items/*//object for $path in $item/paths/path where starts-with($path/@name, '/Root/Temp/Import/') return $item/@uuid ) ) The '*/' could be replaced with 'documents/document' and 'folders', but that would be two separate queries and their individual times would still be offending. The goal of the query is to list items placed into a certain folder structure represented by items in the database. This seems like a straight forward query but I'm stumped at trying to get it to perform adequately. Any suggestions? / Chris

2 2

Using full Java regular expressions
by The Trainspotter 21 Oct '12

21 Oct '12

Hi, I'm currently converting my project to use BaseX instead of Saxon. One thing you can do in Saxon is provide a flag (an exclamation mark) to your regular expression to tell the matches function to use the Java regular expression processor, rather than the rather cut down expressions available in the XQuery spec. Is there anything similar in BaseX? If not what do you recommend to define a Java regular expression based function for XQuery? Thanks in advance, Gary

4 7