Bug (?): Document damaged after db upload
Dear BaseX team, I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this: <Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ... Note the xmlns="", side by side with xmlns="...". This is the query: let $c := *return element {node-name($c)} {$c/*:Availabilities} And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file: <Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ... I wanted to reproduce the problem with a minimal input document, but then the error did not occur. The document producing the error has 286 KB. One more remark: after droping all databases and repeating the exercise, the problem still remained. Kind regards, Hans-Juergen PS: If a team member would like to receive the input file, I would send it to him or her directly.
Hi, Thanks, this sounds like issue [#664]. If you find a temporary workaround, i'll be interested as well. cheers Arve [#664] https://github.com/BaseXdb/basex/issues/664 On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau <hrennau@yahoo.de>wrote:
Dear BaseX team,
I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xmlns=" http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...
Note the xmlns="", side by side with xmlns="...".
This is the query:
let $c := * return element {node-name($c)} {$c/*:Availabilities}
And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...
I wanted to reproduce the problem with a minimal input document, but then the error did not occur.
The document producing the error has 286 KB.
One more remark: after droping all databases and repeating the exercise, the problem still remained.
Kind regards, Hans-Juergen
PS: If a team member would like to receive the input file, I would send it to him or her directly.
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
-- Arve Gengelbach, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22
Hi Hans-Juergen and Arve, I'm taking a look at the issue and get back to you as soon as it's fixed or we know how to deal with it. Cheers, Lukas On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau <hrennau@yahoo.de>wrote:
Dear BaseX team,
I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xmlns=" http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...
Note the xmlns="", side by side with xmlns="...".
This is the query:
let $c := * return element {node-name($c)} {$c/*:Availabilities}
And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...
I wanted to reproduce the problem with a minimal input document, but then the error did not occur.
The document producing the error has 286 KB.
One more remark: after droping all databases and repeating the exercise, the problem still remained.
Kind regards, Hans-Juergen
PS: If a team member would like to receive the input file, I would send it to him or her directly.
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Hi Lukas, great, thank you! One more remark: I observed that an "Out of memory" problem emerged very quickly using db:create (after seconds), and only very late using a command (after minutes), taking up a suggestion Fabrice made. I did not investigate further, but I believe that memory problems may happen with db:create which do not occur using commands. This would also be a very important issue, in my opinion. Kind regards, Hans-Juergen ________________________________ Von: Lukas Kircher <lukaskircher1@gmail.com> An: Hans-Juergen Rennau <hrennau@yahoo.de> CC: Base X <basex-talk@mailman.uni-konstanz.de> Gesendet: 12:41 Sonntag, 24.März 2013 Betreff: Re: [basex-talk] Bug (?): Document damaged after db upload Hi Hans-Juergen and Arve, I'm taking a look at the issue and get back to you as soon as it's fixed or we know how to deal with it. Cheers, Lukas On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau <hrennau@yahoo.de> wrote: Dear BaseX team,
I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability>
...
Note the xmlns="", side by side with xmlns="...".
This is the query:
let $c := * return element {node-name($c)} {$c/*:Availabilities}
And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...
I wanted to reproduce the problem with a minimal input document, but then the error did not occur.
The document producing the error has 286 KB.
One more remark: after droping all databases and repeating the exercise, the problem still remained.
Kind regards, Hans-Juergen
PS: If a team member would like to receive the input file, I would send it to him or her directly.
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Hi Hans-Juergen, I did not investigate further, but I believe that memory problems may
happen with db:create which do not occur using commands.
this is due to the fact that db:create (as an XQuery expression) must adhere to the basic principles of our XQuery Udate module. Insertion sequences have to be cached (for everything that happens within a query), whereas with the commands insertion data is inserted on-the-fly. In this case the command offers the benefit of speed and memory. DB:create increases coding convenience by i.e. allowing to create and fill db's during the same query. So the choice depends on the use case. However, if you experience severe limitations with db:create regarding memory consumption it'd make sense to take a closer look at it. Hope this helps, cheers, Lukas
Dear Hans-Jürgen, hi Arve, with the help of Lukas, the serious db:create() namespace issue has now been fixed. You are welcome to check out the latest stable snapshot [1]! Thanks for reporting this, Christian [1] http://files.basex.org/releases/latest/ ___________________________ On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau <hrennau@yahoo.de> wrote:
Dear BaseX team,
I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...
Note the xmlns="", side by side with xmlns="...".
This is the query:
let $c := * return element {node-name($c)} {$c/*:Availabilities}
And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:
<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...
I wanted to reproduce the problem with a minimal input document, but then the error did not occur.
The document producing the error has 286 KB.
One more remark: after droping all databases and repeating the exercise, the problem still remained.
Kind regards, Hans-Juergen
PS: If a team member would like to receive the input file, I would send it to him or her directly.
_______________________________________________ BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
Wonderful, thank you very much! A first test was successful. Kind regards, Hans-Juergen ________________________________ Von: Christian Grün <christian.gruen@gmail.com> An: Hans-Juergen Rennau <hrennau@yahoo.de>; Arve Gengelbach <ag@basex.org> CC: Base X <basex-talk@mailman.uni-konstanz.de> Gesendet: 0:28 Freitag, 29.März 2013 Betreff: Re: [basex-talk] Bug (?): Document damaged after db upload Dear Hans-Jürgen, hi Arve, with the help of Lukas, the serious db:create() namespace issue has now been fixed. You are welcome to check out the latest stable snapshot [1]! Thanks for reporting this, Christian [1] http://files.basex.org/releases/latest/ ___________________________
participants (4)
-
Arve Gengelbach -
Christian Grün -
Hans-Juergen Rennau -
Lukas Kircher