BaseX-Talk July 2011

basex-talk@mailman.uni-konstanz.de

29 participants
39 discussions

how to specify xml-stylesheet when generating xml ?
by Fabrice Etanchaud 15 Jul '11

15 Jul '11

Dear all at BaseX, how can one specify xml-stylesheet (for example in XQuery 3 prolog) ? I would like to add something like <?xml-stylesheet type="text/xsl" href="linktomystylesheet.xsl"?> between the xml declaration and the generated xml. I did not find any xml-stylesheet option for serialization. BaseX is just wonderful. best regards, Fabrice ETANCHAUD Senior Software Engineer edital Berkenlaan 1 B-1831 Brussels, Belgium <skype:fabrice.etanchaud?call> +32 2 716 32 32 general +32 2 716 32 20 fax fetanchaud(a)edital.com corsearch.com <http://www.corsearch.com/> | edital.com <http://www.edital.com/> Confidentiality Notice: This email and its attachments (if any) contain confidential information of the sender. The information is intended only for the use by the direct addressees of the original sender of this email. If you are not an intended recipient of the original sender (or responsible for delivering the message to such person), you are hereby notified that any review, disclosure, copying, distribution or the taking of any action in reliance of the contents of and attachments to this email is strictly prohibited. If you have received this email in error, please immediately notify the sender at the address shown herein and permanently delete any copies of this email (digital or paper) in your possession.

2 1

Best approach for 10 million+ documents?
by Michael Paddon 14 Jul '11

14 Jul '11

Hi, I'm currently evaluating BaseX for a project. I've read all the online documentation but the underlying storage and indexing mechanisms are still a bit of a mystery to me, so I'm having trouble making optimal decisions in designing a large collection of documents. I have 10 million documents of moderate size. These are intended to be regularly replaced/updated. I have the choice of storing each document individually in a collection, or inserting/updating into a single document. Which approach will generally perform better? In an experiment, I found that after adding a few million documents, adding new documents got really slow. The JVM pegs at 100% CPU so it is doing a lot of work. What's going on here? Indexing? Would increasing the JVM memory help? Can indexing be disabled for bulk loads? Rather than try random things to see what worked, I was hoping to get some insight into how the system stores, indexes and uses resources. Many thanks, Michael

2 1

Re: [basex-talk] BaseX.org Webmailer
by BaseX Support 14 Jul '11

14 Jul '11

> I will use DELETE command in advance. > But supposing I have a DB with 5000 documents, which is the XQuery command > to find out if there are duplicated names? One popular way is to use the db:open() or collection() function, and include the path to the relevant documents: count( collection("db/path/to/document.xml") ) > Thank you You're welcome, Christian

1 0

(Attribute with) namespace problem.
by Huib Verweij 14 Jul '11

14 Jul '11

Hi guys, I'm having a weird thing with BaseX, it's probably something I do wrong, but I can't find what it is so I am asking your help. I am PUTting a XML document to the JAX-RX server: ================================================ PUT /basex/jax-rx/lexus/2e7a78c8-fdce-488b-993e-019ad812bc04 HTTP/1.1 Content-Type: text/xml; charset=UTF-8 Authorization: Basic YWRtaW46YWRtaW4= User-Agent: Jakarta Commons-HttpClient/3.1 Host: localhost:8489 Content-Length: 699099 <?xml version="1.0" encoding="UTF-8"?> <lexus id="uuid:2e7a78c8-fdce-4993e-019ad812bc04"> <meta version="1.0"> <name>Lexicon</name> <description>lexicon</description> <note>[This lexicon was imported by demo on 2011-06-24T12:48:02.194+02:00.] </note> <owner ref="uuid:2c9090a20ad6bf2e009f096563"/> <users> <user ref="uuid:2c9090a20ad6bf2e01f096563"> <permissions> <read>true</read> <write>true</write> </permissions> </user> </users> <schema> <container admin-info="" description="" id="MmM5MDkwYTIxNjdjMjFkNzAxMTY4MDQ2OTg5MTRhMDE=" mandatory="true" multiple="false" name="lexicon" note="" type="lexicon"> <container admin-info="" description="Represents a word, a multi-word expression, or an affix in a given language" id="uuid:5f5be48f-089b-4da3-9493-ea302b082fb7" note="" type="lexical-entry"> <container admin-info="" description="" id="uuid:09775cfd-acaf-46cd-98f8-ca878386d133" mandatory="false" multiple="true" name="lexemeGroup" note="" type="container"> <container xmlns:dcr="http://www.isocat.org/ns/dcr" admin-info="http://www.isocat.org/datcat/DC-1325" dcr:datcat="http://www.isocat.org/datcat/DC-1325" description="Minimal unit of language which : has a semantic interpretation and embodies a distinct cultural concept. " id="uuid:a8eb40c4-2068-462d-946b-031a74202a68" mandatory="false" multiple="true" name="lexeme" note="" type="data"/> ================================================ etc. Note the xmlns:dcr declaration. (I am using tcpmon to see what's sent and received. So tcpmon is sitting just in between my app and the JAX-RX server.) When I request the document I am getting something I do not expect, the xmlns:dcr seems to be replaced with a xmlns:xhtml and therefor I receive an error when processing the jax-rx result: The query: ================================================ POST /basex/jax-rx/ HTTP/1.1 Content-Type: application/query+xml; charset=UTF-8 Authorization: Basic YWRtaW46YWRtaW4= User-Agent: Jakarta Commons-HttpClient/3.1 Host: localhost:8489 Content-Length: 673 <?xml version="1.0" encoding="UTF-8"?> <query> <text> (: Returns lexus/meta element :) element lexus { attribute id { 'uuid:2e7a78c8-fdce-4993e-019ad812bc04' }, collection('lexus')/lexus[@id eq 'uuid:2e7a78c8-fdce-4993e-019ad812bc04']/meta } </text> <parameter name="output" value="media-type=text/xml; omit-xml-declaration=no"/> </query> ================================================ and the result: ================================================ HTTP/1.1 200 OK Content-Type: text/xml;omit-xml-declaration=no Content-Length: 15285 Server: Jetty(6.1.25) <jax-rx:results xmlns:jax-rx="http://jax-rx.sourceforge.net"><jax-rx:result><lexus id="uuid:2e7a78c8-fdce-4993e-019ad812bc04"> <meta version="1.0"> <name>Lexicon</name> <description>lexicon</description> <note>[This lexicon was imported by demo on 2011-06-24T12:48:02.194+02:00.]</note> <owner ref="uuid:2c9090a20ad6bf2e010b22509f096563"/> <users> <user ref="uuid:2c9090a20ad6bf2e010b22509f096563"> <permissions> <read>true</read> <write>true</write> </permissions> </user> </users> <schema> <container admin-info="" description="" id="MmM5MDkwYTIxNjdjMjFkNzAxMTY4MDQ2OTg5MTRhMDE=" mandatory="true" multiple="false" name="lexicon" note="" type="lexicon"> <container admin-info="" description="Represents a word, a multi-word expression, or an affix in a given language" id="uuid:5f5be48f-089b-4da3-9493-ea302b082fb7" note="" type="lexical-entry"> <container admin-info="" description="" id="uuid:09775cfd-acaf-46cd-98f8-ca878386d133" mandatory="false" multiple="true" name="lexemeGroup" note="" type="container"> <container xmlns:xhtml="http://www.w3.org/1999/xhtml" admin-info="http://www.isocat.org/datcat/DC-1325" dcr:datcat="http://www.isocat.org/datcat/DC-1325" description="Minimal unit of language which : has a semantic interpretation and embodies a distinct cultural concept. " id="uuid:a8eb40c4-2068-462d-946b-031a74202a68" mandatory="false" multiple="true" name="lexeme" note="" type="data"/> ================================================ I vaguely remember having seen this before, but I can't find it in the mailing list archive, so sorry if I missed an obvious answer, and please help me anyway. Hartelijke groet, Huib Verweij.

3 5

duplicated document in collection
by Craig Venter 14 Jul '11

14 Jul '11

Hello, I am trying BaseX 6.7 and have noticed that the same document can be added to a collection many times using the ADD command (add z.xml), duplicating data wich is not desirable. Is this a bug of this version? In comparison, using Sedna 3.4, the same document can not be added to a collection if it already exists, treating document names as primary key. Is there a solution to this, or is there a way in BaseX 6.7 to have a kind of primary key constraint? Thank you.

2 1

file:write ADMIN permission needed
by Isidro Vila Verde 13 Jul '11

13 Jul '11

Dear All, I am trying to use xquery file:write function to create new documents but it seems only ADMIN users can do that. This is a little bit limited (IMHO) as I don't want to give admin privileges to my users. In other hand, it also seems incoherent as the user can add documents to data base directly from command line. > add as t.xml <r/> Path '/t.xml' added in 24.72 ms. > xquery declare namespace fx="http://expath.org/ns/file"; fx:write('file1.xml','<w/>') Stopped at line 1, column 78: [BASX0005] ADMIN permission needed. > xquery declare namespace fx="http://expath.org/ns/file"; fx:write('./file1.xml','<w/>') Stopped at line 1, column 80: [BASX0005] ADMIN permission needed. > xquery declare namespace fx="http://expath.org/ns/file"; fx:write('/f.xml','<w/>') Stopped at line 1, column 75: [BASX0005] ADMIN permission needed. > --------------------------------------------------------------------------------------------------------------------------------- I also try to give the user ADMIN privileges to the correspondent database but although it seems possible in the HELP, the fact is that it is not. > show users on test Username Read Write --------------------- test X X 1 Users. > help grant GRANT [NONE|READ|WRITE|CREATE|ADMIN] (ON [database]) TO [user] Grant user permissions. Grants permissions (on a database) to a user. > grant admin on test to test ADMIN permission is unknown. > grant create on test to test CREATE permission is unknown. > So, my question is: These are bugs, limitations, or some kind of wrong understood on my part? Thanks Isidro --- avast! Antivirus: Outbound message clean. Virus Database (VPS): 110712-0, 12-07-2011 Tested on: 12-07-2011 17:38:29 avast! - copyright (c) 1988-2011 AVAST Software. http://www.avast.com

2 3

Can I create a database from PHP
by yoann maingon 12 Jul '11

12 Jul '11

Hi, I've seen the java code to create a new database. Is there a way i can create a new database from PHP? Will there be many people being able to use different databases at the same time on the same server? is it just a matter of hardware Server performance? Best Regards, Yoann Maingon Minerva France +33 6 64 32 49 66

2 2

basex 6.7-1 MIGRATED to testing
by Alexander Holupirek 12 Jul '11

12 Jul '11

From: Debian testing watch <noreply(a)release.debian.org> Date: 12. Juli 2011 18:39:12 MESZ To: basex(a)packages.debian.org Subject: basex 6.7-1 MIGRATED to testing FYI: The status of the basex source package in Debian's testing distribution has changed. Previous version: 6.6.2-1 Current version: 6.7-1 -- This email is automatically generated once a day. As the installation of new packages into testing happens multiple times a day you will receive later changes on the next day. See http://release.debian.org/testing-watch/ for more information.

1 0

help: XQST0054 ?
by Burkert, Michael 12 Jul '11

12 Jul '11

-----Ursprüngliche Nachricht----- Von: basex-talk-bounces(a)mailman.uni-konstanz.de [mailto:basex-talk-bounces@mailman.uni-konstanz.de] Im Auftrag von basex-talk-request(a)mailman.uni-konstanz.de Gesendet: Dienstag, 12. Juli 2011 12:27 An: basex-talk(a)mailman.uni-konstanz.de Betreff: BaseX-Talk Digest, Vol 19, Issue 14 Send BaseX-Talk mailing list submissions to basex-talk(a)mailman.uni-konstanz.de To subscribe or unsubscribe via the World Wide Web, visit https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk or, via email, send a message with subject or body 'help' to basex-talk-request(a)mailman.uni-konstanz.de You can reach the person managing the list at basex-talk-owner(a)mailman.uni-konstanz.de When replying, please edit your Subject line so it is more specific than "Re: Contents of BaseX-Talk digest..." Today's Topics: 1. XQST0054 ? (Burkert, Michael) ---------------------------------------------------------------------- Message: 1 Date: Tue, 12 Jul 2011 10:28:15 +0000 From: "Burkert, Michael" <Michael.Burkert(a)gigatronik.com> To: "basex-talk(a)mailman.uni-konstanz.de" <basex-talk(a)mailman.uni-konstanz.de> Subject: [basex-talk] XQST0054 ? Message-ID: <A037E4EDAB128E42A44F20AF7E898C69017BD3(a)S-MEX2.GT.local> Content-Type: text/plain; charset="iso-8859-1" Hallo ! Der Fehler XQST0054 soll aussagen: A global variable depends on itself. This may be triggered by a circular variable definition. Nun verwende ich gar keine globale Variable. Die Aufgabe ist einfach: Ein XML-Schema (xsd) soll geparst werden und die Abh?ngigkeit der Elemente (xsd:element) in eine gew?nschte Darstellung gebracht werden. Etwa so: <XSDBaum> <elem name="ElNameX1" min="" max=""> <elem name=" ElNameX2" min="0" max="1"/> <elem name=" ElNameX3" min="0" max="1"> Der Fehler tritt erst auf, wenn die Stelle im xml-File bearbeitet wird. Blendet man diese aus, gibt es keine Fehler-Meldung von BaseX. Fehlermeldung mit: if ( name($node) = "xsd:element") then erg:element($root, $node) Keine Fehlermeldung mit: if ( name($node) = "xsd:elementAUSBLENDEN") then erg:element($root, $node) Die problemeatische Stelle im xml-File sieht in etwa folgenderma?en aus: <xsd:complexType name="CTName1"> <xsd:sequence> <xsd:choice minOccurs="0" maxOccurs="unbounded"> <xsd:element name="eLName1" type="ns:ELName1" minOccurs="1" maxOccurs="1" /> <xsd:element name="eLName2" type="ns:ELName2" minOccurs="1" maxOccurs="1" /> </xsd:choice> <xsd:choice minOccurs="0" maxOccurs="1"> <xsd:element name="eLName5" type="ns:ELName5" minOccurs="1" maxOccurs="1" /> <xsd:element name="eLName6" type="ns:ELName6" minOccurs="1" maxOccurs="1" /> </xsd:choice> </xsd:sequence> </xsd:complexType> Die Bearbeitung stockt demzufolge nach xsd:choice, auf die Ebene xsd:element. Die Abfrage: declare namespace xsd="http://www.w3.org/2001/XMLSchema"; declare namespace erg="http://www.MB.org/OTXErg"; declare function erg:next( $root , $CC) { for $node in $CC return <ende>{$node}</ende> }; declare function erg:all( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element( $root , $node) else <endeAll>{$node}</endeAll> }; declare function erg:getCTName( $n) { let $CTNAME := substring($n/@type,5,string-length($n/@type)) return $CTNAME }; declare function erg:choice( $root , $CC) { <choice min="{$CC/@minOccurs}" max="{$CC/@maxOccurs}"> { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element($root, $node) else <endeCC nodeName="{name($node)}"></endeCC> } </choice> }; declare function erg:sequence( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element( $root , $node) else if ( name($node) = "xsd:choice") then erg:choice( $root , $node) else if ( name($node) = "xsd:any") then () else <endeSEQ>{$node}</endeSEQ> }; declare function erg:extension( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:sequence") then erg:sequence($root, $node) else if ( name($node) = "xsd:attribute") then () else <endeEXT>{$node}</endeEXT> }; declare function erg:complexContent( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:extension") then erg:extension($root, $node) else <endeCC>{$node}</endeCC> }; declare function erg:complexType( $root , $CTName) { for $node in $root/xsd:complexType[ @name=$CTName]/* return if ( name($node) = "xsd:complexContent") then erg:complexContent($root, $node) else if ( name($node) = "xsd:sequence") then erg:sequence($root, $node) else if ( name($node) = "xsd:choice") then erg:choice($root, $node) else if ( name($node) = "xsd:anyAttribute") then () else if ( name($node) = "xsd:attribute") then () else if ( name($node) = "xsd:attributeGroup") then () else if ( name($node) = "xsd:all") then erg:all($root, $node) else <endeCT>{$node}</endeCT> }; declare function erg:element( $root , $elem ) { let $CTName := erg:getCTName($elem) return <elem name="{$elem/@name}" min="{$elem/@minOccurs}" max="{$elem/@maxOccurs}" >{erg:complexType( $root, $CTName)}</elem> }; <XSDBaum> { let $elem := //xsd:element[@name='otx'] return erg:element( /* , $elem) } </XSDBaum> Mit freundlichen Gr??en Michael

1 0

XQST0054 ?
by Burkert, Michael 12 Jul '11

12 Jul '11

Hallo ! Der Fehler XQST0054 soll aussagen: A global variable depends on itself. This may be triggered by a circular variable definition. Nun verwende ich gar keine globale Variable. Die Aufgabe ist einfach: Ein XML-Schema (xsd) soll geparst werden und die Abhängigkeit der Elemente (xsd:element) in eine gewünschte Darstellung gebracht werden. Etwa so: <XSDBaum> <elem name="ElNameX1" min="" max=""> <elem name=" ElNameX2" min="0" max="1"/> <elem name=" ElNameX3" min="0" max="1"> Der Fehler tritt erst auf, wenn die Stelle im xml-File bearbeitet wird. Blendet man diese aus, gibt es keine Fehler-Meldung von BaseX. Fehlermeldung mit: if ( name($node) = "xsd:element") then erg:element($root, $node) Keine Fehlermeldung mit: if ( name($node) = "xsd:elementAUSBLENDEN") then erg:element($root, $node) Die problemeatische Stelle im xml-File sieht in etwa folgendermaßen aus: <xsd:complexType name="CTName1"> <xsd:sequence> <xsd:choice minOccurs="0" maxOccurs="unbounded"> <xsd:element name="eLName1" type="ns:ELName1" minOccurs="1" maxOccurs="1" /> <xsd:element name="eLName2" type="ns:ELName2" minOccurs="1" maxOccurs="1" /> </xsd:choice> <xsd:choice minOccurs="0" maxOccurs="1"> <xsd:element name="eLName5" type="ns:ELName5" minOccurs="1" maxOccurs="1" /> <xsd:element name="eLName6" type="ns:ELName6" minOccurs="1" maxOccurs="1" /> </xsd:choice> </xsd:sequence> </xsd:complexType> Die Bearbeitung stockt demzufolge nach xsd:choice, auf die Ebene xsd:element. Die Abfrage: declare namespace xsd="http://www.w3.org/2001/XMLSchema"; declare namespace erg="http://www.MB.org/OTXErg"; declare function erg:next( $root , $CC) { for $node in $CC return <ende>{$node}</ende> }; declare function erg:all( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element( $root , $node) else <endeAll>{$node}</endeAll> }; declare function erg:getCTName( $n) { let $CTNAME := substring($n/@type,5,string-length($n/@type)) return $CTNAME }; declare function erg:choice( $root , $CC) { <choice min="{$CC/@minOccurs}" max="{$CC/@maxOccurs}"> { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element($root, $node) else <endeCC nodeName="{name($node)}"></endeCC> } </choice> }; declare function erg:sequence( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:element") then erg:element( $root , $node) else if ( name($node) = "xsd:choice") then erg:choice( $root , $node) else if ( name($node) = "xsd:any") then () else <endeSEQ>{$node}</endeSEQ> }; declare function erg:extension( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:sequence") then erg:sequence($root, $node) else if ( name($node) = "xsd:attribute") then () else <endeEXT>{$node}</endeEXT> }; declare function erg:complexContent( $root , $CC) { for $node in $CC/* return if ( name($node) = "xsd:extension") then erg:extension($root, $node) else <endeCC>{$node}</endeCC> }; declare function erg:complexType( $root , $CTName) { for $node in $root/xsd:complexType[ @name=$CTName]/* return if ( name($node) = "xsd:complexContent") then erg:complexContent($root, $node) else if ( name($node) = "xsd:sequence") then erg:sequence($root, $node) else if ( name($node) = "xsd:choice") then erg:choice($root, $node) else if ( name($node) = "xsd:anyAttribute") then () else if ( name($node) = "xsd:attribute") then () else if ( name($node) = "xsd:attributeGroup") then () else if ( name($node) = "xsd:all") then erg:all($root, $node) else <endeCT>{$node}</endeCT> }; declare function erg:element( $root , $elem ) { let $CTName := erg:getCTName($elem) return <elem name="{$elem/@name}" min="{$elem/@minOccurs}" max="{$elem/@maxOccurs}" >{erg:complexType( $root, $CTName)}</elem> }; <XSDBaum> { let $elem := //xsd:element[@name='otx'] return erg:element( /* , $elem) } </XSDBaum> Mit freundlichen Grüßen Michael

1 0

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk July 2011