- BaseX-Talk - mailman.uni-konstanz.de

Re: [basex-talk] XML could not be parsed - DOCTYPE
by Alexander Holupirek 03 Feb '12

03 Feb '12

>>> Hello everyone ! >>> >>> Can someone tell me why BaseX could not parse my xml ? >>> >>> "ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM" in the doctype could not be parsed.... >>> >>> >>> <?xml version="1.0" encoding="UTF-8"?> >>> <!DOCTYPE dmodule [ >>> <!NOTATION cgm PUBLIC "-//USA-DOD//NOTATION Computer Graphics Metafile//EN"> >>> <!ENTITY ICN-A350-A-291157-A-FAPE3-00015-A-001-01 SYSTEM "ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM" NDATA cgm> >>> ]> >>> >>> <xmlContent> >>> >>> .... >>> >>> >>> </xmlContent> >>> >>> >>> Thank you ! >> Hi Johann, >> >> BaseX expects the file 'ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM' to be present. >> >> $ basex -itest.xml >> Creating Database... >> java.io.FileNotFoundException: /private/tmp/ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM (No such file or directory) >> "/private/tmp/test.xml" (Line 4): "ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM" could not be parsed. >> $ touch ICN-A350-A-291157-A-FAPE3-00015-A-001-01.CGM >> $ basex -itest.xml >> Creating Database... >> Indexing Text... >> Indexing Attributes... >> $ >> >> Hope this helps, >> Alex > Thanks for your reply Alexander ! > > Is there a way not to parse the doctype because If I let my .CGM file in my directory, baseX could not parse the .CGM file ? Or is there a way to take into account only xml files when creatinf the database ? > > Thanks again Hi Johann, it is related to the parser. Switching the internal parser off helps: On command line: $ basex -c 'set intparse false; create database db data.xml' Creating Database... . 158.93 ms (1108 KB) Indexing Text... . 103.98 ms (1457 KB) Indexing Attributes... . 102.86 ms (1588 KB) In GUI: http://cl.ly/272M3V3g28081y1X2i0d HTH, Alex

1 0

a few questions about BaseX as an embedded db
by Anders Hessellund 02 Feb '12

02 Feb '12

Hi, I am experimenting with BaseX and have so far built a little toy application that uses an embedded BaseX database. All xml-files in a certain folder, e.g., c:\myXml, is added to the database using the Create and Add commands. This works fine and I can run interesting (and efficient) queries on this. Now we get to my questions: 1. Next time I start my application, I do not want to rebuild the database so I simply connect using the Open command. How do I make sure that the BaseX representation/indexes are synched with the actual XML files in the c:\myXml folder? Does this happen automatically as a side-effect of Open or do I need to take some steps? I am particularly concerned about the case where other programs have manipulated the files when my app was shutdown. 2. Is it possible to do any parts of creating, adding, and opening concurrently? 3. Is it possible to cache results (full or partial) of XQueries? 4. Is it possible to attach schema validation? I do not mind hacking a bit. It seems like there is a SAXHandler available (new Set(Prop.INTPARSE, "false")), could I possibly override that implementation? Cheers, Anders

2 3

Re: [basex-talk] Two tags in different namespaces with same name
by Christian Grün 01 Feb '12

01 Feb '12

Dear Philipp, I didn't manage to reproduce the issue straight off, so... could you create a small sample XML document that will allow me to reproduce the issue? Thanks, Christian ________________________________ On Wed, Feb 1, 2012 at 12:06 AM, Philipp Hitzler <philipp.hitzler(a)bettermarks.de> wrote: > Hello, > > I recently discovered with delight baseX XML Database. I fired all kind of > XQueries and was pleased how fast the output popped up in the text window. > Now I came across something strange. I have two tags in different namespaces > with same name, e.g. > > edl:skill and tdl:skill > > In the GUI command window I wrote > > declare namespace tdl="http://www.bettermarks.com/TDL"; > declare namespace edl="http://www.bettermarks.com/EDL"; > //edl:skill > > and the edl:skill tags/nodes showed up. > > Then I tried > > > declare namespace tdl="http://www.bettermarks.com/TDL"; > declare namespace edl="http://www.bettermarks.com/EDL"; > //tdl:skill > > and the result set was unexpectedly empty. > This was in BaseX 7.0.2 on Windows 7. > > After that I tried a bit and decided to install the latest snapshot. This > time I searched for //tdl:skill first, same command as above, and found the > expected tags. But the search for //edl:skill yielded not any result. It > feels like the first search "blocks" the second, but maybe/probably there > quite different reasons behind this. > > I hope I chose the right directory to send my dear problem in and I gladly > provide more information on my system, database etc. if needed. > > Kind regards, Philipp > > > -- > Using Opera's revolutionary email client: http://www.opera.com/mail/

1 0

select a node result in php and xquery
by Nafiz Al Naharul Islam Grameenphone IT Ltd. 31 Jan '12

31 Jan '12

Dear All, I'm using factbook.xml and in php trying to return a node value in php and xquery. The xquery is fine in basex GUI mode but not working in php Here is the php code ........................... <?php include("BaseXClient.php"); $CMD_OPEN = "open input"; $xq = "XQUERY //mondial/lake[@id='f0_39401']"; try { $session = new Session("localhost", 1984, "admin", "admin"); $session->execute($CMD_OPEN); print $session->execute($xq); $session->close(); } catch (Exception $e) { print $e->getMessage(); } ?> I'm waiting for your early response as it's my course assignment and left very few hours :(. Regards, Nafiz -Al Naharul Islam ________________________________ The information contained in this email and any attachment(s) to this email are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient and have received this email and/or its attachment(s) in error, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this email and/or its attachment(s) is strictly prohibited. Please notify the sender immediately and delete this email and any attachments. WARNING: Computer viruses can be transmitted via email. Although GPIT has taken reasonable precautions to ensure no viruses are present in this email and/or its attachment(s), GPIT does not guarantee that this email and/or its attachments are secure or error-free. The recipient should check this email and any attachment(s) for the presence of viruses. GPIT shall accept no liability whatsoever for any loss or damage arising from the use of this email and/or its attachment(s).

2 2

add to mailing list
by Nafiz Al Naharul Islam Grameenphone IT Ltd. 30 Jan '12

30 Jan '12

Dear Concern, Please add my mail address to your mail group. Regards, Nafiz -Al Naharul Islam System Engineer Charging & Invoicing | Communication Solutions| Technology [cid:image001.png@01CCDF2F.AAB6DEB0] Mobile: +8801711082652 e-mail: nnislam(a)gpit.com<mailto:monwarul.islam@gpit.com> web: www.gpit.com<http://www.gpit.com> ________________________________ The information contained in this email and any attachment(s) to this email are intended for the exclusive use of the addressee(s) and may contain proprietary, confidential or privileged information. If you are not the intended recipient and have received this email and/or its attachment(s) in error, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this email and/or its attachment(s) is strictly prohibited. Please notify the sender immediately and delete this email and any attachments. WARNING: Computer viruses can be transmitted via email. Although GPIT has taken reasonable precautions to ensure no viruses are present in this email and/or its attachment(s), GPIT does not guarantee that this email and/or its attachments are secure or error-free. The recipient should check this email and any attachment(s) for the presence of viruses. GPIT shall accept no liability whatsoever for any loss or damage arising from the use of this email and/or its attachment(s).

2 1

session.execute("CREATE DB test inputFolder"); => java.io.IOException: Stream Closed
by Johann LEGAYE 27 Jan '12

27 Jan '12

Hello, I'm new on this mailing list and I have a problem when running on my java app : session.execute("CREATE DB test inputFolder"); because after 20 minutes (my input folder is something like 800 Mo). I got this error message in my console : java.io.IOException: Stream Closed java.io.FileOutputStream.writeBytes(Native Method) java.io.FileOutputStream.write(FileOutputStream.java:305) org.basex.server.Log.write(Log.java:74) org.basex.server.ClientListener.quit(ClientListener.java:240) org.basex.server.ClientListener.run(ClientListener.java:170) What can I do to resolve this ? Thanks a lot ! Johann

2 3

GUI query editor --> revert file
by Piotr Bański 27 Jan '12

27 Jan '12

Hi all, I have an feature request for the GUI editor (veeery handy for testing, thanks!): make it possible to revert files from disk. I have a file open in it that I want to update, because it got modified externally. But I can't -- not even if I open the open-file dialog and try to open it again, as if. No go, the old version sits in the editor still, and I was lucky not to overlook this fact or else I wouldn't know why it doesn't work. Thanks for considering this, and thanks for your work on BaseX, Piotr

2 3

Qualified Attributes In Root Elements
by J Gager 26 Jan '12

26 Jan '12

Dear All, I have found some odd behavior when using the db:add XQuery function with the document constructor. When the root element contains a qualified attribute, all namespaces are being dropped. For example: db:add('testing', document{ <a:Root xmlns:a="ns1" xmlns:b="ns2" a:id="test"><b:Child>Text</b:Child></a:Root> },'doc_1') will result in the following being added to the database (note the namespaces are removed): <a:Root a:id="test"> <b:Child>Text</b:Child> </a:Root> Neither of the following queries retrieves the added node: declare namespace a="ns1"; /a:Root /*:Root The only query that seems to acknowledge this node is: /* However, using a string for the document does work: db:add('testing', '<a:Root xmlns:a="ns1" xmlns:b="ns2" a:id="test"><b:Child>Text</b:Child></a:Root>', 'doc_2') but this is not desired as the content to be added may have quotes within its elements. The namespaces are also retained using the document constructor if the root node does not contain a qualified attribute: db:add('testing', document{ <a:Root xmlns:a="ns1" xmlns:b="ns2" id="test"><b:Child>Text</b:Child></a:Root> },'doc_1') Is this a bug or am I missing some special handling rules of the document constructor? Any feedback is much appreciated. Thanks, Jack Gager Metadata Technology

2 2

baseX performance with large number of small documents (are the indexes working??)
by Shahin Roboubi 25 Jan '12

25 Jan '12

I'm trying to see if I can use baseX for a project we have. We need to store a large number of small documents (about 5,000,000 where each document is 1 to 10K). I had some performance issues and searched the mailing list and found some answers like this: https://mailman.uni-konstanz.de/pipermail/basex-talk/2012-January/002478.ht… This suggests I should be able to get good performance (query times that are around ~100ms or so). I'm running this on a linux server with fast disks and 24 GB of RAM (4 GB for JVM). By the way, I'm doing the queries through the baseX GUI... not sure if that makes any difference. I created 3 test databases, small, medium and large. The results are shown below. All databases have full text search disabled (because I don't need it) and "Path Summary", "Text Index", "Attribute index" enabled. It seems like the indexes are not doing anything or just not working, because the query times are going up linearly (up to 5 seconds for the large database!!) with the size of the database... can someone explain what is happening/why, and how I can fix it? Thanks a lot, Shahin Roboubi Software Engineer MDA Embedded Attachment: ----------------------------------------------------------------------------------- Database Properties Name: radarsat2small Size: 97 MB Nodes: 3891930 Resources: 92665 Timestamp: 05.01.2012 15:07:37 Query: /metadata/Radarsat2Signal[Acquisition[orbit_number<200]] Compiling: - adding text() step - rewriting orbit_number/text() < 200 Result: root()/metadata/Radarsat2Signal[Acquisition[orbit_number/text() < 200.0]] Timing: - Parsing: 0.25 ms - Compiling: 0.37 ms - Evaluating: 530.21 ms - Printing: 5.09 ms - Total Time: 535.94 ms Result: - Results: 165 Items - Updated: 0 Items - Printed: 145 KB Query plan: <IterPath> <Root/> <IterStep axis="child" test="metadata"/> <IterStep axis="child" test="Radarsat2Signal"> <AxisPath> <IterStep axis="child" test="Acquisition"> <CmpR min="-INF" max="200"> <AxisPath> <IterStep axis="child" test="orbit_number"/> <IterStep axis="child" test="text()"/> </AxisPath> </CmpR> </IterStep> </AxisPath> </IterStep> </IterPath> ----------------------------------------------------------------------------------- Database Properties Name: radarsat2medium Size: 194 MB Nodes: 7777056 Resources: 185168 Timestamp: 05.01.2012 15:26:07 Query: /metadata/Radarsat2Signal[Acquisition[orbit_number<100]] Compiling: - adding text() step - rewriting orbit_number/text() < 100 Result: root()/metadata/Radarsat2Signal[Acquisition[orbit_number/text() < 100.0]] Timing: - Parsing: 0.25 ms - Compiling: 0.56 ms - Evaluating: 1079.27 ms - Printing: 5.99 ms - Total Time: 1086.08 ms Result: - Results: 185 Items - Updated: 0 Items - Printed: 163 KB Query plan: <IterPath> <Root/> <IterStep axis="child" test="metadata"/> <IterStep axis="child" test="Radarsat2Signal"> <AxisPath> <IterStep axis="child" test="Acquisition"> <CmpR min="-INF" max="100"> <AxisPath> <IterStep axis="child" test="orbit_number"/> <IterStep axis="child" test="text()"/> </AxisPath> </CmpR> </IterStep> </AxisPath> </IterStep> </IterPath> ----------------------------------------------------------------------------------- Database Properties Name: radarsat2large Size: 873 MB Nodes: 34999986 Resources: 833333 Timestamp: 05.01.2012 16:32:29 Query: /metadata/Radarsat2Signal[Acquisition[orbit_number<20]] Compiling: - adding text() step - rewriting orbit_number/text() < 20 Result: root()/metadata/Radarsat2Signal[Acquisition[orbit_number/text() < 20.0]] Timing: - Parsing: 0.28 ms - Compiling: 2.16 ms - Evaluating: 5296.87 ms - Printing: 5.71 ms - Total Time: 5305.04 ms Result: - Results: 174 Items - Updated: 0 Items - Printed: 153 KB Query plan: <IterPath> <Root/> <IterStep axis="child" test="metadata"/> <IterStep axis="child" test="Radarsat2Signal"> <AxisPath> <IterStep axis="child" test="Acquisition"> <CmpR min="-INF" max="20"> <AxisPath> <IterStep axis="child" test="orbit_number"/> <IterStep axis="child" test="text()"/> </AxisPath> </CmpR> </IterStep> </AxisPath> </IterStep> </IterPath>

2 1

referring to the database root node from a function
by Piotr Bański 25 Jan '12

25 Jan '12

Hi all, This is, I'm afraid, a basic question, that in my hasty searches I just must have missed a solution to. I would like to find a clean way of referencing the default context of my main module, where I can easily do "let $x := //whatever", but after I move this line to a function declaration. Is there any kind of database-root() function that would provide such a reference? I realise that I can pass the relevant node as one of the function's arguments, or use a doc() there with the appropriate path, or maybe even use the "declare context item" functionality that i haven't been successful in putting to work so far, but maybe there exists a much simpler way out? I'll be grateful for a hint. Thanks in advance, Piotr

3 7