November 2011 - BaseX-Talk - mailman.uni-konstanz.de

how does one output the first line?
by jidanni＠jidanni.org 28 Nov '11

28 Nov '11

Hello, We read "The PITarget of a processing instruction may not consist of the characters "XML" in any combination of upper and lower case. The DirPIContents of a processing instruction may not contain the string "?>"." So how can one output the line <?xml version="1.0" encoding="UTF-8"?> I need to put it at the top of my output. Also, is there a way to only write the fn:matches line once here?: let $d := doc("p.xml") let $region := ('基隆|新北|台北','桃園|新竹|苗栗','台中|彰化|南投','雲林|嘉義|台南', '高雄|屏東','宜蘭|花蓮|台東','澎湖|金門|連江') for $count in 1 to count($region) return <Folder> <name>{$region[$count]}({count($d/Folder/Placemark[fn:matches(./description, concat('/li><li>','(',$region[$count],')'))])})</name> <open>0</open> {$d/Folder/Placemark[fn:matches(./description, concat('/li><li>','(',$region[$count],')'))]} </Folder> Also, in perl one can use decode_entities() to convert < to < etc., however reading http://www.w3.org/TR/xpath-functions/ one notes xquery has no such function. What if I want to reduce my output by using CDATA instead? Or maybe xquery output must be valid XML no ifs ands or buts.

2 1

insert node takes really long to complete
by Jan Vlčinský (CAD) 27 Nov '11

27 Nov '11

Hi I am trying to add some attribute into my data, doing it this way: for $msg in //MSG let $evi := $msg//TMCE/EVI[1] let $updclass := $evi/@updateclass let $tmcloc := $msg//MLOC/TMCL[1] let $dir := $tmcloc/@direction let $loccode := $tmcloc/@primarycode let $alertc-id := concat($loccode, $dir, $updclass) return insert node (attribute alertc-id {$alertc-id}) into $msg If I simply return result similar to this, using following query: for $msg in //MSG let $evi := $msg//TMCE/EVI[1] let $updclass := $evi/@updateclass let $tmcloc := $msg//MLOC/TMCL[1] let $dir := $tmcloc/@direction let $loccode := $tmcloc/@primarycode let $alertc-id := concat($loccode, $dir, $updclass) return element enhancedmsg {attribute alertc-id {$alertc-id}, $msg} it takes just 27 s With the insert node, it takes for ever, I had to cancel the query after 90 minutes. I wonder, if there is any relation between this long execution time and possible inefficiency with automatic index update (but I am not aware of what is current status of this approach). Currently, I see, it would be much more efficient to output the result as files, and then import them back, as importing the data I am working on took just 2 minutes. Attached are few sample xml files in the format, I use in my database. Real database consists of 129097 MSG elements and number of DOC elements and documents is exactly the same. With best regards Jan *Ing. Jan Vlčinský* CAD programy Slunečnicová 338/3, 734 01 Karviná Ráj, Czech Republic tel: +420-597 602 024; mob: +420-608 979 040 skype: janvlcinsky; GoogleTalk: jan.vlcinsky(a)gmail.com http://cz.linkedin.com/in/vlcinsky

2 2

why do I have to strip all the namespaces?
by jidanni＠jidanni.org 26 Nov '11

26 Nov '11

Dear Sirs, It is driving me nuts. You see all the basex examples here on Debian, only have simple examples, with no NAMESPACES involved. However, http://gdata.youtube.com/feeds/api/playlists/1ADE82BB5C96D594?prettyprint=t… is the kind of data I am trying to deal with. Yes, you could say just do $ sed '2s/.*/<feed>/' and strip the namespaces. Ha ha ha. Well I did. And then there is media:* how do I deal with that. sed s/:// ? So instead I tried to look up how do declare namespaces. But I could never mind. Here's my makefile N=\ declare namespace atom='http://www.w3.org/2005/Atom';\ declare namespace app='http://purl.org/atom/app#';\ declare namespace media='http://search.yahoo.com/mrss/';\ declare namespace openSearch='http://a9.com/-/spec/opensearchrss/1.0/';\ declare namespace gd='http://schemas.google.com/g/2005';\ declare namespace gml='http://www.opengis.net/gml';\ declare namespace yt='http://gdata.youtube.com/schemas/2007';\ declare namespace georss='http://www.georss.org/georss'; F=1ADE82BB5C96D594?prettyprint=true P=http://gdata.youtube.com/feeds/api/playlists/$F s1:;basex -Vc "OPEN input; XQUERY $N " strippedF:$F;sed '2s/.*/<feed>/' $? |basex -Vc "CREATE DB input /dev/stdin; XQUERY /" xm:$F;basex -Vc "OPEN input; XQUERY (: xmlns:atom='http://www.w3.org/2005/Atom':) /*:feed" 1m:$F;basex -c "OPEN input; XQUERY declare copy-namespaces no-preserve,inherit;//*[local-name()='thumbnail']"|sed q edwm:$F;basex -Vc "OPEN input; XQUERY declare default element namespace 'ccc';//*[local-name()='thumbnail']" wm:$F;basex -Vc "OPEN input; XQUERY /*[local-name()='feed']/*[local-name()='entry']" m:$F;basex -Vc "OPEN input; XQUERY data(/*:feed/*:entry/*:id)"|tr ' ' \\n m1:$F;basex -Vc "OPEN input; XQUERY /*:feed" c:$F;basex -Vc "OPEN input; XQUERY data(//*:name)[1]" c1:$F;basex -Vc "OPEN input; XQUERY (//*:name)[1]" b:$F;basex -Vc "CREATE DB input $?; XQUERY /" My question: is it possible to use basex reasonably here shedding it of all the namespace baggage that I can not deal with. Thanks.

4 4

xupdate question
by Pascal Heus 25 Nov '11

25 Nov '11

Is there a particular reason why I can't do this (mixing let with copy/modify): declare namespace ddi = "http://www.icpsr.umich.edu/DDI"; let $codeBook := collection()[1]/ddi:codeBook let $titlStmt := $codeBook/ddi:stdyDscr/ddi:citation/ddi:titlStmt copy $titlStmt1 := $titlStmt modify ( rename node $titlStmt1 as QName('http://www.icpsr.umich.edu/DDI','CopyOfTitlStmt') ) return $titlStmt1 but this works: declare namespace ddi = "http://www.icpsr.umich.edu/DDI"; copy $titlStmt1 := collection()[1]/ddi:codeBook/ddi:stdyDscr/ddi:citation/ddi:titlStmt modify ( rename node $titlStmt1 as QName('http://www.icpsr.umich.edu/DDI','CopyOfTitlStmt') ) return $titlStmt1 thanks *P

2 1

Fwd: basex 7.0.2-1 MIGRATED to testing
by Alexander Holupirek 23 Nov '11

23 Nov '11

Begin forwarded message: > From: Debian testing watch <noreply(a)release.debian.org> > Subject: basex 7.0.2-1 MIGRATED to testing > Date: 23. November 2011 17:39:09 MEZ > To: basex(a)packages.debian.org > > FYI: The status of the basex source package > in Debian's testing distribution has changed. > > Previous version: 6.7.1-1 > Current version: 7.0.2-1 > > -- > This email is automatically generated once a day. As the installation of > new packages into testing happens multiple times a day you will receive > later changes on the next day. > See http://release.debian.org/testing-watch/ for more information.

1 0

Complied XSLT
by Fabrice Etanchaud 22 Nov '11

22 Nov '11

Dear all at BaseX, Due to memory limitations, One has to transform big xml data in chuncks, applying the same XSLT stylesheet several times. For efficiency purposes, do you plan to add compiled XSLT support in the xslt module ? Thank you for your fantastic job. Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 3

how to mix db:XXXX functions with standard xquery
by Fabrice Etanchaud 22 Nov '11

22 Nov '11

Dear all, We cannot mix updating and non updating instructions in the same list, so instruction sequences like this are not allowed : ( db:add(any document from disk), for ... in ... return .... ) because db:add is a updating function. could you please explain me how I can use db:add, db:delete, etc... functions in a simple way ? best regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

id and element-with-id behaviour
by Andy Bunce 22 Nov '11

22 Nov '11

Hi, The BaseX 7.0.2 handling of fn:element-with-id seems wrong to me. BaseX seems to treat attributes named id as ids - fair enough, I guess it has no id elements. http://www.w3.org/TR/xpath-functions-30/#func-element-with-id says: The effect of this function is identical to fn:id in respect of elements that have an attribute with the is-id property. so given: let $xml :=document{ <a id="0"> f <g id="2.1">hello</g> goodbye </a> } I would expect $xml/id("1") and $xml/element-with-id("1") to both return f . ------result-------------------------------------------------------- f ---- <a id="0"> f <g id="2.1">hello</g> l </a> --------------------------- /Andy

2 1

Performance problem with function declaration
by Andy Bunce 21 Nov '11

21 Nov '11

Hi Using Basex 7.0.2 and the factbook.xml database, I observe the following: declare variable $data:=db:open("factbook"); > > declare function local:myid1($id){ > $data//*[@id=$id] > }; > (: get a 1000 ids to test :) > let $ids:=subsequence($data//@province/string(.),1,1000) > > for $s in $ids return local:myid1($s) > Takes 30 seconds! Replacing the final line with > for $s in $ids return $data//*[@id=$s] > The time is 123ms. /Andy

2 3

Fwd: Error by retrieving an attribute of the element returned by the root function
by Lukas Lewandowski 21 Nov '11

21 Nov '11

Any ideas? Anfang der weitergeleiteten E-Mail: > Von: Truong An Nguyen <ngtruongan(a)gmail.com> > Betreff: Re: [basex-talk] Error by retrieving an attribute of the element returned by the root function > Datum: 21. November 2011 14:38:51 MEZ > An: Lukas Lewandowski <lukas.lewandowski(a)uni-konstanz.de> > > Thanks very much for your response. > > How can I use "instance of" with Basex? I can not do: $a instance of Action. Action an abstract ComplexType. > > Thanks > > An > > > > On Mon, Nov 21, 2011 at 10:34 AM, Lukas Lewandowski <lukas.lewandowski(a)uni-konstanz.de> wrote: > Hi An, > > the root function returns the root of the tree to which the current node belongs, usually be a document node. You can retrieve the attribute according to your root element e.g. by $otx/ROOT_ELEMENT/@package, where ROOT_ELEMENT ist the root element of your document. > > Lukas > > > 2011/11/21 Truong An Nguyen <ngtruongan(a)gmail.com> > Hi, > > In my xquery, I use the root() function to return the root element of an element. I could get the root element, but I couldn't get any attributes of it. > > For example: > for $value in collection()/otx/imports/import > let $otx:=root($value) > return $otx/@package > > Thanks > > Cheers, > An > > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > > >

2 1