Bug (?): Document damaged after db upload

List overview All Threads
Download

newer

older

space in attributes

BaseX: How to create database with...

Hans-Juergen Rennau

22 Mar 2013 22 Mar '13

10:22 a.m.

Dear BaseX team,

I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:

...

Note the xmlns="", side by side with xmlns="...".

This is the query:

let $c := *return element {node-name($c)} {$c/*:Availabilities}

And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...

I wanted to reproduce the problem with a minimal input document, but then the error did not occur.

The document producing the error has 286 KB.

One more remark: after droping all databases and repeating the exercise, the problem still remained.

Kind regards, Hans-Juergen

PS: If a team member would like to receive the input file, I would send it to him or her directly.

Attachments:

attachment.html (text/html — 5.9 KB)

Show replies by date

Arve Gengelbach

23 Mar 23 Mar

11:58 a.m.

Hi, Thanks, this sounds like issue [#664].

If you find a temporary workaround, i'll be interested as well.

cheers Arve

[#664] https://github.com/BaseXdb/basex/issues/664

On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau hrennau@yahoo.dewrote:

...

Dear BaseX team,

I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xmlns=" http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...

Note the xmlns="", side by side with xmlns="...".

This is the query:

let $c := * return element {node-name($c)} {$c/*:Availabilities}

And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...

I wanted to reproduce the problem with a minimal input document, but then the error did not occur.

The document producing the error has 286 KB.

One more remark: after droping all databases and repeating the exercise, the problem still remained.

Kind regards, Hans-Juergen

PS: If a team member would like to receive the input file, I would send it to him or her directly.

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

-- Arve Gengelbach, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

Lukas Kircher

24 Mar 24 Mar

7:41 a.m.

Hi Hans-Juergen and Arve,

I'm taking a look at the issue and get back to you as soon as it's fixed or we know how to deal with it.

Cheers, Lukas

On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau hrennau@yahoo.dewrote:

...

Dear BaseX team,

I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xmlns=" http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...

Note the xmlns="", side by side with xmlns="...".

This is the query:

let $c := * return element {node-name($c)} {$c/*:Availabilities}

And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...

I wanted to reproduce the problem with a minimal input document, but then the error did not occur.

The document producing the error has 286 KB.

One more remark: after droping all databases and repeating the exercise, the problem still remained.

Kind regards, Hans-Juergen

PS: If a team member would like to receive the input file, I would send it to him or her directly.

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Hans-Juergen Rennau

7:53 a.m.

Hi Lukas,

great, thank you! One more remark: I observed that an "Out of memory" problem emerged very quickly using db:create (after seconds), and only very late using a command (after minutes), taking up a suggestion Fabrice made. I did not investigate further, but I believe that memory problems may happen with db:create which do not occur using commands. This would also be a very important issue, in my opinion.

Kind regards, Hans-Juergen

________________________________ Von: Lukas Kircher lukaskircher1@gmail.com An: Hans-Juergen Rennau hrennau@yahoo.de CC: Base X basex-talk@mailman.uni-konstanz.de Gesendet: 12:41 Sonntag, 24.März 2013 Betreff: Re: [basex-talk] Bug (?): Document damaged after db upload

Hi Hans-Juergen and Arve,

I'm taking a look at the issue and get back to you as soon as it's fixed or we know how to deal with it.

Cheers, Lukas

On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau hrennau@yahoo.de wrote:

Dear BaseX team,

...

I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability>

...

Note the xmlns="", side by side with xmlns="...".

This is the query:

let $c := * return element {node-name($c)} {$c/*:Availabilities}

And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...

I wanted to reproduce the problem with a minimal input document, but then the error did not occur.

The document producing the error has 286 KB.

One more remark: after droping all databases and repeating the exercise, the problem still remained.

Kind regards, Hans-Juergen

PS: If a team member would like to receive the input file, I would send it to him or her directly.

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Lukas Kircher

8:20 a.m.

Hi Hans-Juergen,

I did not investigate further, but I believe that memory problems may

...

happen with db:create which do not occur using commands.

this is due to the fact that db:create (as an XQuery expression) must adhere to the basic principles of our XQuery Udate module. Insertion sequences have to be cached (for everything that happens within a query), whereas with the commands insertion data is inserted on-the-fly. In this case the command offers the benefit of speed and memory. DB:create increases coding convenience by i.e. allowing to create and fill db's during the same query. So the choice depends on the use case.

However, if you experience severe limitations with db:create regarding memory consumption it'd make sense to take a closer look at it.

Hope this helps, cheers, Lukas

Christian Grün

28 Mar 28 Mar

7:28 p.m.

Dear Hans-Jürgen, hi Arve,

with the help of Lukas, the serious db:create() namespace issue has now been fixed. You are welcome to check out the latest stable snapshot [1]!

Thanks for reporting this, Christian

[1] http://files.basex.org/releases/latest/ ___________________________

On Fri, Mar 22, 2013 at 3:22 PM, Hans-Juergen Rennau hrennau@yahoo.de wrote:

...

Dear BaseX team,

I encountered a strange phenomenon: after loading a document into the database (using db:create), ordinary retrieval yields a phantom with distorted namespaces, like this:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns="" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://otds-group.org/otds" Key="1Z"> <Availability xmlns="" xmlns="http://otds-group.org/otds" Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState xmlns="" xmlns="http://otds-group.org/otds"> <Open xmlns="" xmlns="http://otds-group.org/otds"/> </DefaultDayState> </Availability> ...

Note the xmlns="", side by side with xmlns="...".

This is the query:

let $c := * return element {node-name($c)} {$c/*:Availabilities}

And this is the (correct) result I obtain if I use as input not the uploaded document, but the original file:

<Accommodation xmlns="http://otds-group.org/otds"> <Availabilities xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" Key="1Z"> <Availability Key="1Z" StartDate="2013-05-01" EndDate="2013-10-31"> <DefaultDayState> <Open/> </DefaultDayState> </Availability> ...

I wanted to reproduce the problem with a minimal input document, but then the error did not occur.

The document producing the error has 286 KB.

One more remark: after droping all databases and repeating the exercise, the problem still remained.

Kind regards, Hans-Juergen

PS: If a team member would like to receive the input file, I would send it to him or her directly.

BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk

Hans-Juergen Rennau

29 Mar 29 Mar

3:44 a.m.

Wonderful, thank you very much! A first test was successful.

Kind regards, Hans-Juergen

________________________________ Von: Christian Grün christian.gruen@gmail.com An: Hans-Juergen Rennau hrennau@yahoo.de; Arve Gengelbach ag@basex.org CC: Base X basex-talk@mailman.uni-konstanz.de Gesendet: 0:28 Freitag, 29.März 2013 Betreff: Re: [basex-talk] Bug (?): Document damaged after db upload

Dear Hans-Jürgen, hi Arve,

with the help of Lukas, the serious db:create() namespace issue has now been fixed. You are welcome to check out the latest stable snapshot [1]!

Thanks for reporting this, Christian

[1] http://files.basex.org/releases/latest/ ___________________________

4494

Age (days ago)

4501

Last active (days ago)

basex-talk@mailman.uni-konstanz.de

6 comments

4 participants

tags (0)

participants (4)

Arve Gengelbach
Christian Grün
Hans-Juergen Rennau
Lukas Kircher