BaseX-Talk

basex-talk@mailman.uni-konstanz.de

9 participants
5241 discussions

Fwd: Re: Parsing entities
by Imsieke, Gerrit, le-tex 28 Jan '11

28 Jan '11

Oops, just noticed that replies don't go to the list by default. -------- Original Message -------- Subject: Re: [basex-talk] Parsing entities Date: Fri, 28 Jan 2011 22:35:24 +0100 From: Imsieke, Gerrit, le-tex <gerrit.imsieke(a)le-tex.de> Organization: le-tex publishing services GmbH To: chas(a)munat.com While I was writing my lengthy reply to Patrick and your original post, I simply forgot about the TinyMCE issue. But anyway, this internal subset stuff is interesting for the young people on this list who grew up in unprecedented wealth, but without DOCTYPEs and catalogs. Given the new site search facility, this knowledge will be discoverable in eternity. Amen. Patching TinyMCE's output with a DOCTYPE declaration with an internal subset might be a challenge, too. There must be a configuration option that will tell TinyMCE to serialize numerical entities. It turns out that they actually put some effort in creating the named entities: see the list on [1]. Indeed, there is such an option: [2] So you'll have to find out where tinyMCE.init() is called (if nowhere then maybe just add this call in a script tag on the page that invokes TinyMCE? Don't know exactly.) and add the appropriate entity_encoding name/value pair. -Gerrit [1] http://drupal.org/node/373542 [2] http://tinymce.moxiecode.com/wiki.php/Configuration:entity_encoding On 28.01.2011 22:17, Charles F. Munat wrote: > In response to the question below, yes, I could do a replace on the > string and exchange   for  , but then what would I do about > the hundred-plus *other* character entity references? Like ” or > —? TinyMCE uses the HTML entity references and there are lots of > them. I can't rewrite TinyMCE, and searching and replacing for all of > these is going to be a bear. > > There must be some way to get the parser to accept the HTML entities. > > I intend to create a DTD for my data anyway, and I can simply include > the HTML entities in that. How do I set the database to test against a > DTD (as the default namespace)? > > Thanks! > > Chas. > > > > Charles: > Can you replace   with   ? > *P > > On 1/28/11 9:07 AM, Charles F. Munat wrote: >> I'm having trouble using XHTML generated by TinyMCE in a BaseX database. >> >> I get the error: The entity "nbsp" was referenced, but not declared. >> >> OK, I understand that it doesn't parse entities automatically. I need >> to add a DTD. >> >> So I have a setup like this: >> >> In a file called catalog.xml: >> >> <?xml version="1.0"?> >> <catalog prefer="system" >> xmlns="urn:oasis:names:tc:entity:xmlns:xml:catalog"> >> <rewriteSystem >> systemIdStartString="http://www.w3.org/TR/xhtml1/DTD/" >> rewritePrefix="file:///var/www/xxx/content/dtds/" /> >> </catalog> >> >> In /var/www/xxx/content/dtds/ I have a file called xhtml1-strict.dtd >> which is exactly what it says it is (downloaded from the W3C). >> >> Now I need to add the DOCTYPE to my database. But how? >> >> I create this database via a web interface using Vaadin (a bunch of >> forms, tables, etc. Then I just do XQuery inserts, deletes, etc. There >> are no XML documents. It's all done piecemeal. >> >> My root node is <data>. Some of my nodes have a <content> node that >> contains XHTML: >> >> <data> >> <remarks> >> <remark id='1'> >> <name>Test Remark</name> >> <content> >> This contains a   non-breaking space! >> </content> >> </remark> >> </remarks> >> </data> >> >> How do I add the DTD? How do I indicate that it should be applied to >> the contents of the <content> node only? How can I do that without >> adding namespaces to all the XHTML tags? >> >> Can anyone provide a brief example? >> >> By the way, when I connect to the database I do this: >> >> val session = new ClientSession("localhost", 1984, "admin", "x") >> >> session.setOutputStream(System.out) >> >> session.execute("SET CATFILE /var/www/xxx/catalog.xml") >> session.execute("SET CHOP off") >> session.execute("SET INTPARSE on") >> session.execute("SET ENTITY on") >> session.execute("SET PATHINDEX on") >> session.execute("SET TEXTINDEX on") >> session.execute("SET ATTRINDEX on") >> session.execute("SET FTINDEX on") >> session.execute("SET WILDCARDS on") >> session.execute("SET DIACRITICS on") >> session.execute("INFO") >> >> Thanks! >> >> Chas. >> _______________________________________________ >> BaseX-Talk mailing list >> BaseX-Talk at mailman.uni-konstanz.de >> https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >> > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk(a)mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk -- Gerrit Imsieke Geschäftsführer / Managing Director le-tex publishing services GmbH Weissenfelser Str. 84, 04229 Leipzig, Germany Phone +49 341 355356 110, Fax +49 341 355356 510 gerrit.imsieke(a)le-tex.de, http://www.le-tex.de Registergericht / Commercial Register: Amtsgericht Leipzig Registernummer / Registration Number: HRB 24930 Geschäftsführer: Gerrit Imsieke, Svea Jelonek, Thomas Schmidt, Dr. Reinhard Vöckler

1 0

Re: [basex-talk] Parsing entities
by Charles F. Munat 28 Jan '11

28 Jan '11

In response to the question below, yes, I could do a replace on the string and exchange   for  , but then what would I do about the hundred-plus *other* character entity references? Like ” or —? TinyMCE uses the HTML entity references and there are lots of them. I can't rewrite TinyMCE, and searching and replacing for all of these is going to be a bear. There must be some way to get the parser to accept the HTML entities. I intend to create a DTD for my data anyway, and I can simply include the HTML entities in that. How do I set the database to test against a DTD (as the default namespace)? Thanks! Chas. Charles: Can you replace   with   ? *P On 1/28/11 9:07 AM, Charles F. Munat wrote: > I'm having trouble using XHTML generated by TinyMCE in a BaseX database. > > I get the error: The entity "nbsp" was referenced, but not declared. > > OK, I understand that it doesn't parse entities automatically. I need > to add a DTD. > > So I have a setup like this: > > In a file called catalog.xml: > > <?xml version="1.0"?> > <catalog prefer="system" > xmlns="urn:oasis:names:tc:entity:xmlns:xml:catalog"> > <rewriteSystem > systemIdStartString="http://www.w3.org/TR/xhtml1/DTD/" > rewritePrefix="file:///var/www/xxx/content/dtds/" /> > </catalog> > > In /var/www/xxx/content/dtds/ I have a file called xhtml1-strict.dtd > which is exactly what it says it is (downloaded from the W3C). > > Now I need to add the DOCTYPE to my database. But how? > > I create this database via a web interface using Vaadin (a bunch of > forms, tables, etc. Then I just do XQuery inserts, deletes, etc. There > are no XML documents. It's all done piecemeal. > > My root node is <data>. Some of my nodes have a <content> node that > contains XHTML: > > <data> > <remarks> > <remark id='1'> > <name>Test Remark</name> > <content> > This contains a   non-breaking space! > </content> > </remark> > </remarks> > </data> > > How do I add the DTD? How do I indicate that it should be applied to > the contents of the <content> node only? How can I do that without > adding namespaces to all the XHTML tags? > > Can anyone provide a brief example? > > By the way, when I connect to the database I do this: > > val session = new ClientSession("localhost", 1984, "admin", "x") > > session.setOutputStream(System.out) > > session.execute("SET CATFILE /var/www/xxx/catalog.xml") > session.execute("SET CHOP off") > session.execute("SET INTPARSE on") > session.execute("SET ENTITY on") > session.execute("SET PATHINDEX on") > session.execute("SET TEXTINDEX on") > session.execute("SET ATTRINDEX on") > session.execute("SET FTINDEX on") > session.execute("SET WILDCARDS on") > session.execute("SET DIACRITICS on") > session.execute("INFO") > > Thanks! > > Chas. > _______________________________________________ > BaseX-Talk mailing list > BaseX-Talk at mailman.uni-konstanz.de > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk >

1 0

Parsing entities
by Charles F. Munat 28 Jan '11

28 Jan '11

I'm having trouble using XHTML generated by TinyMCE in a BaseX database. I get the error: The entity "nbsp" was referenced, but not declared. OK, I understand that it doesn't parse entities automatically. I need to add a DTD. So I have a setup like this: In a file called catalog.xml: <?xml version="1.0"?> <catalog prefer="system" xmlns="urn:oasis:names:tc:entity:xmlns:xml:catalog"> <rewriteSystem systemIdStartString="http://www.w3.org/TR/xhtml1/DTD/" rewritePrefix="file:///var/www/xxx/content/dtds/" /> </catalog> In /var/www/xxx/content/dtds/ I have a file called xhtml1-strict.dtd which is exactly what it says it is (downloaded from the W3C). Now I need to add the DOCTYPE to my database. But how? I create this database via a web interface using Vaadin (a bunch of forms, tables, etc. Then I just do XQuery inserts, deletes, etc. There are no XML documents. It's all done piecemeal. My root node is <data>. Some of my nodes have a <content> node that contains XHTML: <data> <remarks> <remark id='1'> <name>Test Remark</name> <content> This contains a   non-breaking space! </content> </remark> </remarks> </data> How do I add the DTD? How do I indicate that it should be applied to the contents of the <content> node only? How can I do that without adding namespaces to all the XHTML tags? Can anyone provide a brief example? By the way, when I connect to the database I do this: val session = new ClientSession("localhost", 1984, "admin", "x") session.setOutputStream(System.out) session.execute("SET CATFILE /var/www/xxx/catalog.xml") session.execute("SET CHOP off") session.execute("SET INTPARSE on") session.execute("SET ENTITY on") session.execute("SET PATHINDEX on") session.execute("SET TEXTINDEX on") session.execute("SET ATTRINDEX on") session.execute("SET FTINDEX on") session.execute("SET WILDCARDS on") session.execute("SET DIACRITICS on") session.execute("INFO") Thanks! Chas.

3 2

how to get BaseXClient console speak unicode under Windows ?
by Fabrice Etanchaud 27 Jan '11

27 Jan '11

Dear all, under Windows, I would like to see correct unicode results when running Xqueries under BaseXClient application (xml content is in russian). Could you please help me ? best regards, Fabrice Etanchaud

3 7

BaseX is 100% trusted !
by Vera Zubor - DownloadAtlas.com 27 Jan '11

27 Jan '11

January 27, 2011 BaseX, we have done your NEW complete security tests. To assure our users that BaseX is clean and safe to install, we awarded your software with our DownloadAtlas.com *100% Safe Award*. If you want to notify your users about this certification, you can display this award on your website. You can visit now the awards section within our website and pick your award banner from there: http://www.downloadatlas.com/freeware-52cba7a6.html Please, login for instructions. http://user.downloadatlas.com/?account=support@basex.org That's all for today. Cheers, Vera Zubor - webmaster e-mail: editor(a)downloadatlas.com ----------------------------------------------------------------------------------------------------------------------- To unsubscribe or change options please login to your account using email address support(a)basex.org or click here : http://user.downloadatlas.com/

1 0

Granted Editor's Pick to BaseX
by DownloadRoute.com 27 Jan '11

27 Jan '11

Hello Sir/Madam, this is not a spam. In the year 2010 your software "BaseX" has been chosen by our visitors and was selected as an editorial pick. We are impressed by the quality and cleanliness of the program. Read here: http://www.downloadroute.com/BaseX-DBIS-Group-University-of-Konstanz/awards… Sincerely, George DownloadRoute.com team Note: Click to unsubscribe from our future mailings: http://www.downloadroute.com/no-mailing/BaseX-DBIS-Group-University-of-Kons…

1 0

BaseX in Cocoon?
by Joachim Wackerow 26 Jan '11

26 Jan '11

Hello, Does anybody has experience in using BaseX in the Cocoon framework? Currently I'm using eXist with Cocoon (by the XML:DB protocol). I would be interested to use BaseX with Cocoon. Now I'm wondering if anybody tried this and can give me some hints. Cheers, Achim -- GESIS - Leibniz Institute for the Social Sciences Department: Monitoring Society and Social Change Unit: Social Science Metadata Standards Visiting address: B2 1, 68159 Mannheim, Germany Postal address: P.O. Box 122155, 68072 Mannheim, Germany Phone: +49 (0)621 1246 262 Fax: +49 (0)621 1246 100 E-mail: joachim.wackerow(a)gesis.org www.gesis.org/en/institute/

4 6

Options to convert coordinates from S-JTSK to WGS84 by XQuery
by Jan Vlčinský (CAD) 26 Jan '11

26 Jan '11

Hi I am facing problem, that my XML data have coordinates in system S-JTSK (used a lot for area of Czech Republic) and resulting data must be in WGS84, as they will be used by Google Maps. Be sure, that the conversion is not trivial task (the other way is simpler, but S-JTSK to WGS84 is well known complexity) - so I am not sure, if writing complete conversion code by XQuery function itself is feasible. I can try do some conversion by other tools before I insert the XML or after I create resulting data - but elegant solution would accomplish this by XQuery. I know, that there are Java libs available for this (like GeoTools - http://geotools.org/). My question is: - is there any option to add more XQuery methods/functions written in Java to BaseX? Like the conversion function for coordinates? - It would go: add some JAR into class path - register it somehow and then be able to use it. - optionally writing some interface, which would make the jar available to BaseX XQuery processing. Any ideas what to do with my crazy wishes? With best regards Jan

2 2

Unique node identifier?
by NewIntellectual 25 Jan '11

25 Jan '11

Is there a function to retrieve a persistent unique node identifier from any given retrieved node? I thought it would be db:node-id($node) but that is returning '0'.

2 3

Re: [basex-talk] Strange query plan difference
by Christian Grün 25 Jan '11

25 Jan '11

Hi Philip (cc:mailing list), does the index still work if you reopen the GUI and run your query? Next, which full-text options have you set? Christian ___________________________ On Tue, Jan 25, 2011 at 10:15 AM, Philip Oliver <phil3(a)olivercomputing.com> wrote: > Christian - I've gotten around to trying BaseX 6.5.1 (generated from SVN) with some code changes, and I'm trying to figure out some strange behavior: a query executed in the GUI is using an index, whereas the same query executed in my program via client/server execution, does not (so is very slow.) > > (One thing I've noticed is that the fulltext indices are not used if the "English" language option is chosen. I figure this is the same principle as the indices not being used if the "contains text" query options don't match the database fulltext index properties - but I don't know what fulltext options to use in the query, then. I don't know if this is related to the problem I'm seeing.) > > ---------------------------------------- > This is the query: > > let $paras:=db:open('CIVWAR')//node()[text() contains text "ohio"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > > ---------------------------------------- > This is the result of session.info() with "set queryinfo on", after the query is executed in my program: > > Query: let $paras:=db:open('CIVWAR')//node()[text() contains text "zanesville"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > > Compiling: > - pre-evaluating open("CIVWAR") > - optimizing descendant-or-self step(s) > - binding static variable $paras > - merging axis paths > - binding static variable $books > - rewriting where clause to predicate(s) > - rewriting exists(@*:id) > - removing variable $paras > - removing variable $books > - simplifying flwor expression > > Result: for $book in (document-node { "DYERS_P1.xml" }, ...)/descendant::node()[text() contains text "zanesville"]/ancestor::*:book[@*:id] order by number($book/@id) return element { "book" } { attribute { "id" } { $book/@id }, attribute { "series" } { $book/@series }, attribute { "title" } { $book/title } } > > Parsing: 1.83 ms > Compiling: 8.73 ms > Evaluating: 36902.45 ms > Printing: 0.71 ms > Total Time: 36913.74 ms > Results: 15 Items > Updated: 0 Items > Printed: 964 Bytes > Memory: 11970 KB > > Query executed in 36914.08 ms. > > > ---------------------------------------- > And this is the query info from the GUI: > > Query: let $paras:=db:open('CIVWAR')//node()[text() contains text "ohio"] let $books:=$paras/ancestor::book return (for $book in $books where exists($book/@id) order by number($book/@id) return <book id="{$book/@id}" series="{$book/@series}" title="{$book/title}"/>) > Compiling: > - pre-evaluating open("CIVWAR") > - optimizing descendant-or-self step(s) > - applying full-text index > - binding static variable $paras > - merging axis paths > - binding static variable $books > - rewriting where clause to predicate(s) > - rewriting exists(@id) > - removing variable $paras > - removing variable $books > - simplifying flwor expression > Result: for $book in FTIndexAccess("CIVWAR", "ohio")/..[ancestor::document-node()]/ancestor::book[@id] order by number($book/@id) return element { "book" } { attribute { "id" } { $book/@id }, attribute { "series" } { $book/@series }, attribute { "title" } { $book/title } } > Query plan: > <GFLWOR> > <For var="$book"> > <AxisPath> > <FTIndexAccess data="CIVWAR"> > <FTWords>ohio</FTWords> > </FTIndexAccess> > <IterStep axis="parent" test="node()"> > <AxisPath> > <IterStep axis="ancestor" test="document-node()"/> > </AxisPath> > </IterStep> > <IterStep axis="ancestor" test="book"> > <AxisPath> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </IterStep> > </AxisPath> > </For> > <Order> > <OrderByExpr dir="ascending" empty="least"> > <FNAcc name="number(item?)"> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </FNAcc> > </OrderByExpr> > </Order> > <Return> > <CElem> > <Item value="book" type="xs:QName"/> > <CAttr> > <Item value="id" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="id"/> > </AxisPath> > </CAttr> > <CAttr> > <Item value="series" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="attribute" test="series"/> > </AxisPath> > </CAttr> > <CAttr> > <Item value="title" type="xs:QName"/> > <AxisPath> > <VarRef name="$book"/> > <IterStep axis="child" test="title"/> > </AxisPath> > </CAttr> > </CElem> > </Return> > </GFLWOR> > Timing: > - Parsing: 0.99 ms > - Compiling: 0.59 ms > - Evaluating: 864.56 ms > - Printing: 1.09 ms > - Total Time: 867.25 ms > >

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk