BaseX-Talk

basex-talk@mailman.uni-konstanz.de

13 participants
5244 discussions

Query / Iteration on server side.
by Fabian Hickert 29 Nov '11

29 Nov '11

Hi all, I was playing with the python examples of basex version 6.7.1-1 from the debian-wheezy repository. I've used the corresponding BaseXClient.py to establish a connection/add/update/query stuff and so on, it worked very well. Now I've noticed the new 7.0.2 version and now I've got problems with the query/iterate operation. In the 6.7 example one starts a query and iterates over the results, using the more method, which sends \x01 followed by the query-result id. But the examples of 7.0.2 don't behave like this anymore, instead they cache the complete result on the client side. I've tried to rebuild the old 6.7 behaviour with the commands shown here, http://docs.basex.org/wiki/Server_Protocol but I wasn't successful. Is is still possible to query and iterate on the server side instead, of caching the complete result on the client side? Am I doing things the wrong way? If I do, could you please point me to the right direction or examples, documentation? Best regards Fabian -- Fabian Hickert <fabian.hickert(a)GONICUS.de> (System Engineer) * GONICUS GmbH * Moehnestrasse 11-17 * D-59755 Arnsberg * Tel.: +49 (0) 29 32 / 9 16 - 0 * Fax: +49 (0) 29 32 / 9 16 - 242 * http://www.GONICUS.de * http://twitter.com/gonicus *Sitz der Gesellschaft: Moehnestrasse 11-17 * D-59755 Arnsberg *Geschaeftsfuehrer: Rainer Luelsdorf, Alfred Schroeder *Vorsitzender des Beirats: Juergen Michels *Amtsgericht Arnsberg * HRB 1968

2 2

"declare copy-namespaces no-preserve, inherit; " must come first
by jidanni＠jidanni.org 29 Nov '11

29 Nov '11

"declare copy-namespaces no-preserve, inherit;" must come first: $ cat e declare option output:omit-xml-declaration "no"; declare copy-namespaces no-preserve, inherit; <z/> $ basex e Stopped at line 2, column 8 in /tmp/e: [XPST0003] Unexpected end of query: 'copy-namespaces...'. $ cat f declare copy-namespaces no-preserve, inherit; declare option output:omit-xml-declaration "no"; <z/> $ basex f <?xml version="1.0" encoding="UTF-8"?> <z/> $ apt-cache policy basex basex: Installed: 7.0.2-1

2 1

Question about the Fulltext search!
by Truong An Nguyen 28 Nov '11

28 Nov '11

Hi, I've two questions about the fulltext search. 1) I've created fulltext i for my BaseX doesn't understand ftcontains. When I try a CONTAINS query in a 1 Gigabyte Database, using text index is slower than without text index. How can I use fulltext index rightly? 2) Does BaseX supports regular expression in the fulltext extension? If yes, could you please give me an example. Thanks Cheers, An

5 20

how does one output the first line?
by jidanni＠jidanni.org 28 Nov '11

28 Nov '11

Hello, We read "The PITarget of a processing instruction may not consist of the characters "XML" in any combination of upper and lower case. The DirPIContents of a processing instruction may not contain the string "?>"." So how can one output the line <?xml version="1.0" encoding="UTF-8"?> I need to put it at the top of my output. Also, is there a way to only write the fn:matches line once here?: let $d := doc("p.xml") let $region := ('基隆|新北|台北','桃園|新竹|苗栗','台中|彰化|南投','雲林|嘉義|台南', '高雄|屏東','宜蘭|花蓮|台東','澎湖|金門|連江') for $count in 1 to count($region) return <Folder> <name>{$region[$count]}({count($d/Folder/Placemark[fn:matches(./description, concat('/li><li>','(',$region[$count],')'))])})</name> <open>0</open> {$d/Folder/Placemark[fn:matches(./description, concat('/li><li>','(',$region[$count],')'))]} </Folder> Also, in perl one can use decode_entities() to convert < to < etc., however reading http://www.w3.org/TR/xpath-functions/ one notes xquery has no such function. What if I want to reduce my output by using CDATA instead? Or maybe xquery output must be valid XML no ifs ands or buts.

2 1

insert node takes really long to complete
by Jan Vlčinský (CAD) 27 Nov '11

27 Nov '11

Hi I am trying to add some attribute into my data, doing it this way: for $msg in //MSG let $evi := $msg//TMCE/EVI[1] let $updclass := $evi/@updateclass let $tmcloc := $msg//MLOC/TMCL[1] let $dir := $tmcloc/@direction let $loccode := $tmcloc/@primarycode let $alertc-id := concat($loccode, $dir, $updclass) return insert node (attribute alertc-id {$alertc-id}) into $msg If I simply return result similar to this, using following query: for $msg in //MSG let $evi := $msg//TMCE/EVI[1] let $updclass := $evi/@updateclass let $tmcloc := $msg//MLOC/TMCL[1] let $dir := $tmcloc/@direction let $loccode := $tmcloc/@primarycode let $alertc-id := concat($loccode, $dir, $updclass) return element enhancedmsg {attribute alertc-id {$alertc-id}, $msg} it takes just 27 s With the insert node, it takes for ever, I had to cancel the query after 90 minutes. I wonder, if there is any relation between this long execution time and possible inefficiency with automatic index update (but I am not aware of what is current status of this approach). Currently, I see, it would be much more efficient to output the result as files, and then import them back, as importing the data I am working on took just 2 minutes. Attached are few sample xml files in the format, I use in my database. Real database consists of 129097 MSG elements and number of DOC elements and documents is exactly the same. With best regards Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

2 2

why do I have to strip all the namespaces?
by jidanni＠jidanni.org 26 Nov '11

26 Nov '11

Dear Sirs, It is driving me nuts. You see all the basex examples here on Debian, only have simple examples, with no NAMESPACES involved. However, http://gdata.youtube.com/feeds/api/playlists/1ADE82BB5C96D594?prettyprint=t… is the kind of data I am trying to deal with. Yes, you could say just do $ sed '2s/.*/<feed>/' and strip the namespaces. Ha ha ha. Well I did. And then there is media:* how do I deal with that. sed s/:// ? So instead I tried to look up how do declare namespaces. But I could never mind. Here's my makefile N=\ declare namespace atom='http://www.w3.org/2005/Atom';\ declare namespace app='http://purl.org/atom/app#';\ declare namespace media='http://search.yahoo.com/mrss/';\ declare namespace openSearch='http://a9.com/-/spec/opensearchrss/1.0/';\ declare namespace gd='http://schemas.google.com/g/2005';\ declare namespace gml='http://www.opengis.net/gml';\ declare namespace yt='http://gdata.youtube.com/schemas/2007';\ declare namespace georss='http://www.georss.org/georss'; F=1ADE82BB5C96D594?prettyprint=true P=http://gdata.youtube.com/feeds/api/playlists/$F s1:;basex -Vc "OPEN input; XQUERY $N " strippedF:$F;sed '2s/.*/<feed>/' $? |basex -Vc "CREATE DB input /dev/stdin; XQUERY /" xm:$F;basex -Vc "OPEN input; XQUERY (: xmlns:atom='http://www.w3.org/2005/Atom':) /*:feed" 1m:$F;basex -c "OPEN input; XQUERY declare copy-namespaces no-preserve,inherit;//*[local-name()='thumbnail']"|sed q edwm:$F;basex -Vc "OPEN input; XQUERY declare default element namespace 'ccc';//*[local-name()='thumbnail']" wm:$F;basex -Vc "OPEN input; XQUERY /*[local-name()='feed']/*[local-name()='entry']" m:$F;basex -Vc "OPEN input; XQUERY data(/*:feed/*:entry/*:id)"|tr ' ' \\n m1:$F;basex -Vc "OPEN input; XQUERY /*:feed" c:$F;basex -Vc "OPEN input; XQUERY data(//*:name)[1]" c1:$F;basex -Vc "OPEN input; XQUERY (//*:name)[1]" b:$F;basex -Vc "CREATE DB input $?; XQUERY /" My question: is it possible to use basex reasonably here shedding it of all the namespace baggage that I can not deal with. Thanks.

4 4

xupdate question
by Pascal Heus 25 Nov '11

25 Nov '11

Is there a particular reason why I can't do this (mixing let with copy/modify): declare namespace ddi = "http://www.icpsr.umich.edu/DDI"; let $codeBook := collection()[1]/ddi:codeBook let $titlStmt := $codeBook/ddi:stdyDscr/ddi:citation/ddi:titlStmt copy $titlStmt1 := $titlStmt modify ( rename node $titlStmt1 as QName('http://www.icpsr.umich.edu/DDI','CopyOfTitlStmt') ) return $titlStmt1 but this works: declare namespace ddi = "http://www.icpsr.umich.edu/DDI"; copy $titlStmt1 := collection()[1]/ddi:codeBook/ddi:stdyDscr/ddi:citation/ddi:titlStmt modify ( rename node $titlStmt1 as QName('http://www.icpsr.umich.edu/DDI','CopyOfTitlStmt') ) return $titlStmt1 thanks *P

2 1

Fwd: basex 7.0.2-1 MIGRATED to testing
by Alexander Holupirek 23 Nov '11

23 Nov '11

Begin forwarded message: > From: Debian testing watch <noreply(a)release.debian.org> > Subject: basex 7.0.2-1 MIGRATED to testing > Date: 23. November 2011 17:39:09 MEZ > To: basex(a)packages.debian.org > > FYI: The status of the basex source package > in Debian's testing distribution has changed. > > Previous version: 6.7.1-1 > Current version: 7.0.2-1 > > -- > This email is automatically generated once a day. As the installation of > new packages into testing happens multiple times a day you will receive > later changes on the next day. > See http://release.debian.org/testing-watch/ for more information.

1 0

Complied XSLT
by Fabrice Etanchaud 22 Nov '11

22 Nov '11

Dear all at BaseX, Due to memory limitations, One has to transform big xml data in chuncks, applying the same XSLT stylesheet several times. For efficiency purposes, do you plan to add compiled XSLT support in the xslt module ? Thank you for your fantastic job. Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 3

how to mix db:XXXX functions with standard xquery
by Fabrice Etanchaud 22 Nov '11

22 Nov '11

Dear all, We cannot mix updating and non updating instructions in the same list, so instruction sequences like this are not allowed : ( db:add(any document from disk), for ... in ... return .... ) because db:add is a updating function. could you please explain me how I can use db:add, db:delete, etc... functions in a simple way ? best regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk