- BaseX-Talk - mailman.uni-konstanz.de

Counting Occurences
by Ana Victória Ladeira 20 Nov '15

20 Nov '15

Good afternoon! I have a collection of XML files in which all files contain the attribute //ENDERECO-PROFISISONAL/@UF In which UF is the province in which the person to whom the file makes reference to lives. I want to develop a query that returns to me the number of occurences of each province in the collection. I've tried using count and distinct-values, but it always return the value "1" for me. The query I'm trying to use is the following: for $x in collection('Teste500')/CURRICULO-VITAE/DADOS-GERAIS/ENDERECO/ENDERECO-PROFISSIONAL let $y := count(distinct-values($x/@UF)) return $y The desired result would be, in a collection of documents in which 5 people live in SP, 3 in DF and 9 in AM would be the following: SP: 5 DF: 3 AM:9 Can somebody please help me with that? I'm still struggling with xQuery.

2 1

Applicative Cache
by Marco Lettere 20 Nov '15

20 Nov '15

Hi all, I went though the emails talking about mainmemory databases and related but I've not been able to find an answer to this loud thinking ... Would it be possible to create an in memory database with a RESTXQ call and keep it accessible for other RESTXQ invocations as if it was a disk db throughout the lifecycle of a basexhttp server? Application level cacheing of (possibly distributed) dbs or management of transient volatile data items like tokens are the scenarios I have in mind. Just wondering whether this makes any sense. Whether it's feasible or whether someone already did this with other means. Thanks a lot! Marco.

3 6

Bash command
by meumapple 19 Nov '15

19 Nov '15

Hi all, I am using proc:system for a bash command but I cannot run it. It looks like opennlp postagger model.bin < file.txt. I suspect that the problem is the less-than sign, which is converted into < Is there any way to keep the less-than sign and pass it to the bash properly? Thanks. Joseph

4 8

How to improve performance of join query
by Chuck Bearden 18 Nov '15

18 Nov '15

Hi all, I'm joining elements from two sets of documents in a single database. There are many elements (six figures) in each set. The query doesn't finish after several minutes. My suspicion is that the indices aren't being used, except to limit the fingerprint 'content' elements to those with "Person" as the value of 'contentFamily'. Perhaps my data and query demand some form of optimization that hasn't been implemented yet, but perhaps there is something I could do to fix the query. I'm using BaseX 8.3.0. The query: ------------------------- xquery version "3.0"; declare namespace fingerprint="http://atira.dk/schemas/pure4/wsdl/template/fingerprint/current"; declare namespace concept="http://atira.dk/schemas/pure4/wsdl/template/concept/current"; declare namespace core="http://atira.dk/schemas/pure4/model/core/current"; declare namespace xsi="http://www.w3.org/2001/XMLSchema-instance"; declare namespace fincur="http://atira.dk/schemas/pure4/model/template/fingerprint/current"; declare namespace concur="http://atira.dk/schemas/pure4/model/template/concept/current"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method "csv"; declare option output:csv "header=yes, separator=comma"; let $coll := collection('pure_20151109') let $concept_contents := $coll/concept:GetConceptResponse/core:result/core:content let $fingerprint_contents := $coll/fingerprint:GetFingerprintResponse/core:result/core:content for $fin_con in $fingerprint_contents[fincur:contentFamily/text()="Person"] /fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid := $fin_con/fincur:conceptUuid let $rank := $fin_con/fincur:rank let $weighted_rank := $fin_con/fincur:weightedRank let $person_uuid := $fin_con/ancestor::core:content[1]/@uuid let $concept_name := $concept_contents[@uuid=$concept_uuid]/concur:name/core:localizedString return <csv> <record> <person_uuid>{data($person_uuid)}</person_uuid> <concept_uuid>{$concept_uuid/text()}</concept_uuid> <rank>{$rank/text()}</rank> <weighted_rank>{$weighted_rank/text()}</weighted_rank> <concept_name>{$concept_name/text()}</concept_name> </record> </csv> ------------------------- The query info from the query, which I stopped after 3 minutes: ------------------------- Error: Interrupted. Compiling: - pre-evaluating collection("pure_20151109") - inlining $coll_0 - inlining $fingerprint_contents_2 - applying text index for "Person" - inlining $rank_5 - inlining $weighted_rank_6 - inlining $person_uuid_7 - inlining $concept_name_8 Query: xquery version "3.0"; declare namespace fingerprint="http://atira.dk/schemas/pure4/wsdl/template/fingerprint/current"; declare namespace concept="http://atira.dk/schemas/pure4/wsdl/template/concept/current"; declare namespace core="http://atira.dk/schemas/pure4/model/core/current"; declare namespace xsi="http://www.w3.org/2001/XMLSchema-instance"; declare namespace fincur="http://atira.dk/schemas/pure4/model/template/fingerprint/current"; declare namespace concur="http://atira.dk/schemas/pure4/model/template/concept/current"; declare namespace output = "http://www.w3.org/2010/xslt-xquery-serialization"; declare option output:method "csv"; declare option output:csv "header=yes, separator=comma"; let $coll := collection('pure_20151109') let $concept_contents := $coll/concept:GetConceptResponse/core:result/core:content let $fingerprint_contents := $coll/fingerprint:GetFingerprintResponse/core:result/core:content for $fin_con in $fingerprint_contents[fincur:contentFamily/text()="Person"] /fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid := $fin_con/fincur:conceptUuid let $rank := $fin_con/fincur:rank let $weighted_rank := $fin_con/fincur:weightedRank let $person_uuid := $fin_con/ancestor::core:content[1]/@uuid let $concept_name := $concept_contents[@uuid=$concept_uuid]/concur:name/core:localizedString return <csv> <record> <person_uuid>{data($person_uuid)}</person_uuid> <concept_uuid>{$concept_uuid/text()}</concept_uuid> <rank>{$rank/text()}</rank> <weighted_rank>{$weighted_rank/text()}</weighted_rank> <concept_name>{$concept_name/text()}</concept_name> </record> </csv> Optimized Query: let $concept_contents_1 := (db:open-pre("pure_20151109",0), ...)/concept:GetConceptResponse/core:result/core:content for $fin_con_3 in db:text("pure_20151109", "Person")/parent::fincur:contentFamily/parent::core:content[parent::core:result/parent::fingerprint:GetFingerprintResponse/parent::document-node()]/fincur:rankedConcepts/fincur:rankedConcept let $concept_uuid_4 := $fin_con_3/fincur:conceptUuid return element csv { (element record { (element person_uuid { (data($fin_con_3/ancestor::core:content[position() = 1]/@uuid)) }, element concept_uuid { ($concept_uuid_4/text()) }, element rank { ($fin_con_3/fincur:rank/text()) }, element weighted_rank { ($fin_con_3/fincur:weightedRank/text()) }, element concept_name { (($concept_contents_1)[(@uuid = $concept_uuid_4)]/concur:name/core:localizedString/text()) }) }) } Query plan: <QueryPlan compiled="true"> <GFLWOR> <Let> <Var name="$concept_contents" id="1"/> <IterPath> <DBNodeSeq size="51261"> <DBNode name="pure_20151109" pre="0"/> <DBNode name="pure_20151109" pre="1603"/> <DBNode name="pure_20151109" pre="2781"/> <DBNode name="pure_20151109" pre="5227"/> <DBNode name="pure_20151109" pre="7212"/> </DBNodeSeq> <IterStep axis="child" test="concept:GetConceptResponse"/> <IterStep axis="child" test="core:result"/> <IterStep axis="child" test="core:content"/> </IterPath> </Let> <For> <Var name="$fin_con" id="3"/> <CachedPath> <ValueAccess data="pure_20151109" type="TEXT"> <Str value="Person" type="xs:string"/> </ValueAccess> <IterStep axis="parent" test="fincur:contentFamily"/> <IterStep axis="parent" test="core:content"> <CachedPath> <IterStep axis="parent" test="core:result"/> <IterStep axis="parent" test="fingerprint:GetFingerprintResponse"/> <IterStep axis="parent" test="document-node()"/> </CachedPath> </IterStep> <IterStep axis="child" test="fincur:rankedConcepts"/> <IterStep axis="child" test="fincur:rankedConcept"/> </CachedPath> </For> <Let> <Var name="$concept_uuid" id="4"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:conceptUuid"/> </IterPath> </Let> <CElem> <QNm value="csv" type="xs:QName"/> <CElem> <QNm value="record" type="xs:QName"/> <CElem> <QNm value="person_uuid" type="xs:QName"/> <FnData name="data([items])"> <CachedPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterPosStep axis="ancestor" test="core:content"> <Pos min="1" max="1"/> </IterPosStep> <IterStep axis="attribute" test="uuid"/> </CachedPath> </FnData> </CElem> <CElem> <QNm value="concept_uuid" type="xs:QName"/> <CachedPath> <VarRef> <Var name="$concept_uuid" id="4"/> </VarRef> <IterStep axis="child" test="text()"/> </CachedPath> </CElem> <CElem> <QNm value="rank" type="xs:QName"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:rank"/> <IterStep axis="child" test="text()"/> </IterPath> </CElem> <CElem> <QNm value="weighted_rank" type="xs:QName"/> <IterPath> <VarRef> <Var name="$fin_con" id="3"/> </VarRef> <IterStep axis="child" test="fincur:weightedRank"/> <IterStep axis="child" test="text()"/> </IterPath> </CElem> <CElem> <QNm value="concept_name" type="xs:QName"/> <CachedPath> <IterFilter> <VarRef> <Var name="$concept_contents" id="1"/> </VarRef> <CmpG op="="> <CachedPath> <IterStep axis="attribute" test="uuid"/> </CachedPath> <VarRef> <Var name="$concept_uuid" id="4"/> </VarRef> </CmpG> </IterFilter> <IterStep axis="child" test="concur:name"/> <IterStep axis="child" test="core:localizedString"/> <IterStep axis="child" test="text()"/> </CachedPath> </CElem> </CElem> </CElem> </GFLWOR> </QueryPlan> ------------------------- Thanks in advance for any advice! Chuck

2 2

BaseX request from Saxon XSL transformation
by cmarchand＠oxiane.com 18 Nov '15

18 Nov '15

Hello, I have to query a BaseX database from a XSL transformation. Does someone has ever done this ? I have no idea where to look in... I use SaxonEE, so I can write an extension function, if needed... Best regards, Christophe

3 3

Upcoming: XMLPrague 2016
by Christian Grün 18 Nov '15

18 Nov '15

Dear all, In around three months, it will be the 5th time that we'd like to organize user meeting in Prague. This time, the XML Prague conference takes place from Thursday to Saturday, Feb 11-13, and our meeting will be onThursday. As you all do so many exciting things with BaseX, we would be more than interested to have some of you as speakers! We are very thankful to those of you who have already talked on one of our previous meetings; it has been your contributions that made the past event so awesome! Please don't hesitate and tell us if you are interested in presenting your work to the members of the community. If you have presented before, you are of course invited as well. More to come, Christian

1 0

zip:update-entries - unexpected results
by Hondros, Constantine (ELS-AMS) 18 Nov '15

18 Nov '15

Hi all, I'm attempting to create a modified copy a zipfile using zip:update-entries, but my output is a zip structure with zero-byte files. Am I missing a step? I've followed the example in: http://docs.basex.org/wiki/ZIP_Module#zip:update-entries Code snippet as follows: declare function util:clean-zip($zip as xs:string, $out as xs:string) { copy $doc := zip:entries($zip) modify delete node $doc//zip:entry[ends-with(lower-case(@name), '.pdf')] return zip:update-entries($doc, $out) }; Thanks for any pointers ;-) C. ________________________________ Elsevier B.V. Registered Office: Radarweg 29, 1043 NX Amsterdam, The Netherlands, Registration No. 33156677, Registered in The Netherlands.

2 3

sending variables to xquery module via client api (python)
by Cholfin, Bryan 17 Nov '15

17 Nov '15

Hi- Hoping someone can help me with this. I'm trying to write a python script that calls an xquery module in the database. It seems to be pretty easy to use a line such as: session.execute("run gettext.xqm") and get back the response I want. What I want to do is pass a bound variable to the module. The client api has a provision to bind a variable to a query object, but I'm not making a query object. I'm simply executing the stored query. I don't find anything in the documentation to suggest that a variable can be added to the run command this way. Bryan Cholfin Associate Editor for Digital Projects and Metadata Harvard University Press 617.496.9116 79 Garden Street | Cambridge, MA 02138-1400 www.hup.harvard.edu<http://www.hup.harvard.edu/>

3 8

Restxq
by meumapple 16 Nov '15

16 Nov '15

Hi All, I am using restxq. I wrote a function which takes one variable (this should be a chunk of text, not a single word). The output is xml. I can have the function work if I pass the content of the variable with curl -X POST --data "variable=my text is long" http://address How can I get the same result of the curl command with an xquery function? More in general, is this a good way to write a function in restxq when the variable is not a single word but the content of a file? (I am not even sure if a file can be passed as such in restxq) Thanks, Joseph

3 4

Treating SQL Results
by Ana Victória Ladeira 16 Nov '15

16 Nov '15

Good morning. I have an XML file of the following format: <?xml version="1.0" encoding="UTF-8"?> <resultsets> <resultset xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <row> <column name="TITULO">A Adequação de Sistemas Baseados em Casos no Sequenciamento Inteligente de Ações</column> <column name="NOMECOMPLETO">José Pacheco de Almeida Prado</column> </row> <row> <column name="TITULO">Sistemas Distribuídos Inteligentes</column> <column name="NOMECOMPLETO">José Pacheco de Almeida Prado</column> </row> <row> <column name="TITULO">Uma Arquitetura para Planejamento Inteligente</column> <column name="NOMECOMPLETO">José Pacheco de Almeida Prado</column> </row> <row> <column name="TITULO">Navegação de robôs móveis com Lógica Paracpmsistente Anotada e método de Campos Potenciais</column> <column name="NOMECOMPLETO">José Pacheco de Almeida Prado</column> </row> <row> <column name="TITULO">Adaptation in a Traffic Control System</column> <column name="NOMECOMPLETO">José Pacheco de Almeida Prado</column> </row> ... The file contains titles for articles and their authors.. I was asked to develop a query that returns the author's name followed by the titles of all of its articles, so the result would be something like this: <Author1>:<Article1>, <Article2>, <Article3>... <Author2>:<Article1>, <Article2>... ... Any ideas on how can I do it? Thank you in advance.

2 1