BaseX-Talk

basex-talk@mailman.uni-konstanz.de

12 participants
5242 discussions

export to CSV, or even Excel
by Andreas Karpf 26 Sep '11

26 Sep '11

Hello, I have got question regarding the export function of Basex. I used BaseX to load the Reuters Corpus Volume 1 which is a corpus of around 800k files, unzipped nealry 3GB in size. Is there any way to export some parts of these files (with xpath), parsed into a Basex database, to csv? I am aware that those kind of questions would probably fall under the support which costs. But if there is any simpler solution for that it would be very nice if you could post it. It would help me a lot! Best regards, Andreas

3 2

Builds full-text information.
by Toshio HIRAI 26 Sep '11

26 Sep '11

Hi. Although I was trying implements of Japanese Lexer to 6.8 beta, I have noticed that the result of a ft:mark() function shifts. 55 line of https://github.com/BaseXdb/basex/blob/master/src/main/java/org/basex/query/… final FTLexer lex = new FTLexer(ftopt).sc().init(nd.atom()); FTLexer will generate the tokenizer of the default language instead of an original language, if it does not perform in this way. How is it? In code which I am correcting, ft:mark() operated normally by carrying out like this. thanks. -- Toshio HIRAI

2 1

Query question
by Wiard Vasen 26 Sep '11

26 Sep '11

Dear All, Is it possible to formulate a query which gives the distinct documents from a repository containing a specific word: let $range := 1 to 640 for $doc in collection('brievenvangogh') let $uri := base-uri($doc), $num := substring($uri, string-length($uri) - 6, 3) where $num castable as xs:integer and xs:integer($num) = $range return <document uri='{$uri}'>{ for $n score $s in $doc//*[text() contains text 'cezanne'] return <hit score='{$s}'>{ $n }</hit> }</document> In this query I get the number of hits of all documents in the repository. Thanks in advance! Regards, Wiard

1 0

NPE Error in GUI 6.7.1
by Randy reed 25 Sep '11

25 Sep '11

HI all, I am running basex 6.7.1 on Ubuntu 10.10 using the .jar module running on OpenJDK runtime 6b20-1.9.9. I received an NPE in the GUI (message below). I have attached my .xq file for your perusal. Let me know if there is any way to work around this, or if downloading a different build will solve it. Thanks so much Error: Potential bug? Improper use? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 6.7.1 Java: Sun Microsystems Inc., 1.6.0_26 OS: Linux, i386 Stack Trace: java.lang.NullPointerException org.basex.util.Token.token(Token.java:152) org.basex.query.item.DTd.<init>(DTd.java:103) org.basex.query.item.AtomType$31.e(AtomType.java:441) org.basex.query.item.SeqType.cast(SeqType.java:303) org.basex.query.expr.Cast.item(Cast.java:57) org.basex.query.expr.Arith.item(Arith.java:54) org.basex.query.expr.ParseExpr.value(ParseExpr.java:73) org.basex.query.expr.UserFunc.value(UserFunc.java:121) org.basex.query.expr.BaseFuncCall.value(BaseFuncCall.java:60) org.basex.query.expr.Let$1.next(Let.java:90) org.basex.query.expr.FLWR$1.next(FLWR.java:62) org.basex.query.iter.Iter.finish(Iter.java:65) org.basex.query.expr.ParseExpr.value(ParseExpr.java:76) org.basex.query.expr.UserFunc.value(UserFunc.java:121) org.basex.query.expr.BaseFuncCall.value(BaseFuncCall.java:60) org.basex.query.expr.Let$1.next(Let.java:90) org.basex.query.expr.FLWR$1.next(FLWR.java:62) org.basex.query.iter.Iter.finish(Iter.java:65) org.basex.query.expr.ParseExpr.value(ParseExpr.java:76) org.basex.query.expr.UserFunc.value(UserFunc.java:121) org.basex.query.expr.BaseFuncCall.value(BaseFuncCall.java:60) org.basex.query.expr.BaseFuncCall.iter(BaseFuncCall.java:73) org.basex.query.QueryContext.iter(QueryContext.java:351) org.basex.query.func.FNGen.data(FNGen.java:110) org.basex.query.func.FNGen.iter(FNGen.java:66) org.basex.query.QueryContext.iter(QueryContext.java:351) org.basex.query.expr.Constr.<init>(Constr.java:54) org.basex.query.expr.CElem.item(CElem.java:117) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:54) org.basex.query.QueryContext.iter(QueryContext.java:351) org.basex.query.expr.Constr.<init>(Constr.java:54) org.basex.query.expr.CElem.item(CElem.java:117) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:54) org.basex.query.QueryContext.iter(QueryContext.java:351) org.basex.query.expr.List$1.next(List.java:81) org.basex.query.expr.FLWR$1.next(FLWR.java:58) org.basex.query.expr.Constr.<init>(Constr.java:55) org.basex.query.expr.CElem.item(CElem.java:117) org.basex.query.expr.CElem.item(CElem.java:1) org.basex.query.expr.CFrag.item(CFrag.java:1) org.basex.query.expr.ParseExpr.iter(ParseExpr.java:54) org.basex.query.QueryContext.iter(QueryContext.java:351) org.basex.query.QueryContext.iter(QueryContext.java:301) org.basex.query.QueryContext.eval(QueryContext.java:260) org.basex.query.QueryProcessor.execute(QueryProcessor.java:128) org.basex.core.cmd.AQuery.query(AQuery.java:83) org.basex.core.cmd.XQuery.run(XQuery.java:22) org.basex.core.Command.run(Command.java:320) org.basex.core.Command.exec(Command.java:301) org.basex.core.Command.execute(Command.java:73) org.basex.gui.GUI.exec(GUI.java:410) org.basex.gui.GUI$5.run(GUI.java:358) -- Dr. Randall Reed Assistant Professor, Dept. of Philosophy and Religion Appalachian State University

2 2

BaseX/REST: Update
by Christian Grün 24 Sep '11

24 Sep '11

Hi there, once more, our integrated REST implementation has been updated (the Wiki should reflect all changes [1]), and should soon reach its final state: - POST is now limited to only perform operations (query, run or command) - Resources can now be returned via GET by simply specifying their exact path - Binary resources are returned with the correct content type - PUT can also be used to store binary files - The HTTP Server now starts the BaseX Server by default Your feedback, be it public or private, is welcome as usual, Christian [1] http://docs.basex.org/wiki/REST ___________________________ BaseX Team Christian Grün Uni KN, Box 188 D-78457 Konstanz http://www.basex.org

1 0

Passing XML data to a query
by Ralf Jung 24 Sep '11

24 Sep '11

Hi list, I am currently looking into BaseX to find out if it meets my requirements for an XML database with XQuery implementation and REST interface. I already got the data imported, now I'm looking into the queries I need. I just stumbled upon the following problem, and could not find any documentation to overcome it, just a bug report that I think is related (https://github.com/BaseXdb/jax-rx/issues/3). The problem is that I need to work on XML data that is POSTed to the query, the data must be available during query execution. However I could not find a way to do so, the jax-rx parameters seem to be restricted to atomic values. Did I miss anything? As work-around, I tried to construct the entire query in the database client (which in my case is Orbeon, the runtime for the XForms application that serves as user interface), serializing the XML into a string and making it part of the query, i.e. something like let $data = <xsl:value-of select="saxon:serialize($data)"/> The query is created correctly, however, I can not get it to execute on the server as BaseX requires a content-type of application/query+xml, whereas XForms submissions (the only way to issue POST requests from Orbeon) have a content-type of application/xml. Is there any way to pass an XML data parameter, or at least to send a custom query without using a special mime-type? Any help would be appreciated, Ralf

3 15

Schema validation
by Ralf Jung 24 Sep '11

24 Sep '11

Hi list, I noticed in the docs that BaseX currently does not support any form of XML Schema validation. Are there any plans to implement this, and in which timeframe? I'd especially be interested in requiring validation for a database, so that BaseX refuses to store documents that do not conform to an XMLSchema. Don't worry, I understand this is open-source and free and all, I just want to know what the plans are :) Kind regards, Ralf

2 3

multiple updates in a transform query
by Sony Vijay 23 Sep '11

23 Sep '11

Hi, Given the following xquery: import module namespace functx = "http://www.functx.com" at " http://www.xqueryfunctions.com/xq/functx-1.0-nodoc-2007-01.xq"; declare variable $entryid_prefix as xs:string external; declare variable $src_prefix as xs:string external; declare variable $other_src_prefix as xs:string external; let $feeds_metadoc := <feed> <entry> <id>1</id> <child src='2' /> <child src='libx.org(a)gmail.com/core' /> </entry> </feed> return( copy $feed_copy := $feeds_metadoc modify ( for $entry in $feed_copy/entry return ( for $entry_id in $entry/id where fn:not(fn:contains($entry_id, '/')) return replace value of node $entry_id with concat($entryid_prefix, $entry_id) for $src in $entry/child/@src return ( if (fn:contains(data($src), '/')) then ( let $src_id_new := concat($other_srcprefix, $src_id) return replace value of node $src with $src_id_new ) else ( let $src_data := concat($src_prefix, data($src)) return replace value of node $src with $src_data ) ) ) ) return $feed_copy ) Say, the values are passed are - $entryid_prefix = 'http://X/", $src_prefix="http://Y/", and $other_src_prefix="http://Z/". After running the above xqueries by passing these values, I expect the output to be: <feed> <entry> <id>http://X/1</id> <child src='http://Y/2' /> <child src='http://Z/libx.org@gmail.com/core' /> </entry> </feed> I am trying to use multiple for statements within the modify statement and this does not work. I see the following error: java.io.IOException: Stopped at line 23, column 10: [XPST0003] Expecting ")", found "f". I highlighted line 23 for convenience. Please help me fix this. Thanks, Sony

2 2

Search path for "import module"
by Ralf Jung 22 Sep '11

22 Sep '11

Hi list, since my XQuery's share some common utility functions, I created a "global.xq" file to contain those functions, and the actual scripts import that file using import module namespace red-db="red-db" at "global.xq"; However, BaseX then looks for that file in the working directory where it was started. Is there any way to configure that behaviour, e.g. to look into the HTTPPATH folder the script is located in, or maybe to make the lookup relative to the script that contains this command? Currently I always have to cd to the HTTPPATH folder before starting BaseX. I am using the current git master version. Kind regards, Ralf

3 5

Building BaseX
by Ralf Jung 22 Sep '11

22 Sep '11

Hi list, I am trying to build and run the current git master version of BaseX. Unfortunately I could not find proper documentation on that process, just a bunch of docs saying how to use git etc. I should add that I did not use maven before. So I just went ahead, cloned both the basex and the basex-api repos, and called "mvn compile" in both of them (after an sudo apt-get install maven2, I am using Debian testing). That was guesswork, after noticing that "maven build" does not work and asking google ;-) In the basex folder, this compiled a lot of stuff, but all I could find is a bunch of class files - I had expected to find the jar file with all the data I need somewhere. By pure accident I then found a remark in the "integration" wiki page saying mvn has a "package" target, which at least gave me the jar file I looked for (maybe that could be added to the readme file, and the development section could clarify that "integrate into IDE" also contains the "how to build basex on command-line" doc). Now I wonder, can I re-use the etc and lib folder from 6.7.1, or do I need different versions? In basex-api, all I got was an error that maven could not find the artefact "org.basex:basex:jar:6.8-SNAPSHOT" - whatever that exactly means, I assume I have to tell it somehow where it can find the basex core jar file? I am quite a loss here, maybe someone can shed some light on the build process. Kind regards, Ralf

2 2

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk