BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5250 discussions

BaseX performance issue
by Wang, Yvonne 22 Jun '16

22 Jun '16

Hi BaseX team, We currently encountered performance issue using BaseX. We noticed that when # of documents increased in BaseX database, it will double time to retrieve documents in database. Our test cases execution time double when # of documents increased from 200 to 400. And If number of document reach to 5000, The test case execution time increase much more. Is that any performance testing BaseX team can share with us to compare, or there is any documentation or suggestion for BaseX database turning that we should follow? Thanks Yvonne

2 5

about changing default port 1984
by Mohamed kharrat 21 Jun '16

21 Jun '16

Hi everybody,i would like to know how to change the default port 1984 i'm working on windows, i open from /bin the basex.bat, then in console, command "help" works but the command "-p" do not works (it's show stopped at....) basexhttp.bat works (it's show me that server and http server are running correctly) but i can not write anything when i openbasexclient.bat , i write admin admin but then commands -p do not works, only "help" command works

3 7

256 Namespaces
by prasad gavhane 21 Jun '16

21 Jun '16

Hi I have a xml file with more than 256 namespace declared. BaseX is giving me "*"Too many different namespaces (limit: 256)" exception.* *How can I increase the limit to load this xml file?* *Thanks* *Prasad G.*

2 1

(no subject)
by Luiz Matos 21 Jun '16

21 Jun '16

Dear members, I need to know if the prototypes described here [1] are available at BaseX package. Using the lastest version, I can distribute the database and queries with HTTP/REST functions in a collection, but I don't know how to execute a parallel query on a single document database replicated in N nodes of a cluster. My main idea is to reduce the total query time using only BaseX implementation (or any lib compatible). [1] https://www.uni-konstanz.de/mmsp/pubsys/publishedFiles/Lewandowski12.pdf Thanks in advance, -- Luiz Matos PhD student at Federal Fluminense University

2 1

Validate module and catalogs
by France Baril 20 Jun '16

20 Jun '16

I created an entire process for my xquery to read a catalog that is built from multiple catalogs (<nextCatalog/>) so I can find the correct schema to validate my XML topics based on the schema reference (My XML files don't all use the same schemas) <topic xmlns:xsi=" http://www.w3.org/2001/XMLSchema-instance" xml:lang="en-us" class="- topic/topic " xsi:noNamespaceSchemaLocation=" urn:oasis:names:tc:dita:psd:ditabase.xsd:1.3", only to discover that once I have my schema and validate:xsd-info($doc, $xsd), it can't be processed because the main .xsd uses references that also require the catalog: <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:ditaarch=" http://dita.oasis-open.org/architecture/2005/" elementFormDefault= "qualified" attributeFormDefault="unqualified">  <xs:include schemaLocation=" urn:oasis:names:tc:dita:xsd:abbreviateDomain.xsd:1.3"/> <xs:include schemaLocation= "urn:oasis:names:tc:dita:xsd:deliveryTargetAttDomain.xsd:1.3"/> <xs:include schemaLocation= "urn:oasis:names:tc:dita:xsd:equationDomain.xsd:1.3"/> <xs:include schemaLocation= "urn:oasis:names:tc:dita:xsd:hazardDomain.xsd:1.3"/> <xs:include schemaLocation= "urn:oasis:names:tc:dita:psd:highlightDomain.xsd:1.3"/> My question is: Is it worth it for me to keep going with my ugly parse/replace + export game or is BaseX going to support validate:xsd-info($doc, $catalog) soon? If so how soon? Also, any chance we can keep the DOCTYPE and allow the same type of validation with DTDs? Ya, I know, I'm pushing my luck... but I have to ask because some clients cannot move to schemas. -- France Baril Architecte documentaire / Documentation architect france.baril(a)architextus.com

2 2

UNSUBSCRIBE
by Listnr 20 Jun '16

20 Jun '16

Many thanks for insight but volume too great for regular reading and difficult to disseminate content. Even if content specified would still spend time seeing how the other half live! Many thanks, appreciated! Emails are sent in confidence, (et semper bona fide) please be assured that replies are treated likewise. Sincerely, Brian J Graham Exec: House of Graham Desktop: listnr(a)icloud.com - http://www.houseofgraham.com Inspirata per somnia, concreata imaginatio™ This message is confidential. Its content may be privileged or protected by copyright, title, intellectual property or other provision at law. If received in error, please immediately reply, and preferably delete from email client application; further, we advise there is no intention to compromise your lawful right or otherwise deny use of privileged information other than a courteous recognition of integrity and professional ethic. E&OE ©MMXVI. UK > On 20 Jun 2016, at 11:00, basex-talk-request(a)mailman.uni-konstanz.de wrote: > > Send BaseX-Talk mailing list submissions to > basex-talk(a)mailman.uni-konstanz.de > > To subscribe or unsubscribe via the World Wide Web, visit > https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk > or, via email, send a message with subject or body 'help' to > basex-talk-request(a)mailman.uni-konstanz.de > > You can reach the person managing the list at > basex-talk-owner(a)mailman.uni-konstanz.de > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of BaseX-Talk digest..." > > > Today's Topics: > > 1. Re: client:connect reference to DB or storage in RAM (loss in > performance?) (Kapoor, Sumit) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 20 Jun 2016 09:53:15 +0000 > From: "Kapoor, Sumit" <Sumit.Kapoor(a)adesso.de> > To: Christian Gr?n <christian.gruen(a)gmail.com> > Cc: "basex-talk(a)mailman.uni-konstanz.de" > <basex-talk(a)mailman.uni-konstanz.de> > Subject: Re: [basex-talk] client:connect reference to DB or storage in > RAM (loss in performance?) > Message-ID: > <3a53b43667b544b789776972a6d34e05(a)EX2013-DB01.adesso.local> > Content-Type: text/plain; charset="utf-8" > > I mean if we try to access the DB without "client:connect" e.g. : > > if (collection("BIG-DB")/*:node[*:id=3/*:status = 'true') > then _:todoFunc("") > else () > > That would be an access to the DB without "client:connect" if I code it like that more than once I always get the error: "The Database is already in use". Because they block each other. For example if I add this to it: > > let $anotherquery := collection("BIG-DB")/*:node > > > Regards, > Sumit > > -----Urspr?ngliche Nachricht----- > Von: Christian Gr?n [mailto:christian.gruen@gmail.com] > Gesendet: Samstag, 18. Juni 2016 14:40 > An: Kapoor, Sumit <Sumit.Kapoor(a)adesso.de> > Cc: basex-talk(a)mailman.uni-konstanz.de > Betreff: Re: [basex-talk] client:connect reference to DB or storage in RAM (loss in performance?) > >> If I open a connection, send a query and close the connection: What do >> I get? Just a Copy of the Database which will be stored in the >> core/main memory or a reference to the DB? Here a Code Example: > > You will always get a copy of the database node. As you may have seen in the documentation of the Client Module, you should never use it to address the same BaseX instance, as this can cause deadlocks. > >> We have to use such a workaround with ?client:connect? because if we >> try to access directly the DB more than once it will be blocked. > > Do you have more details? > Christian > > ------------------------------------------------------- >>>> business. people. technology. <<< > ------------------------------------------------------- > > adesso AG mit Sitz in Dortmund > Vorstand: Michael Kenfenheuer (Vors.), Christoph Junge, Andreas Prenneis > Vorsitzender des Aufsichtsrates: Prof. Dr. Volker Gruhn > Amtsgericht Dortmund HRB 20663 > > End of BaseX-Talk Digest, Vol 78, Issue 32 > ******************************************

1 0

client:connect reference to DB or storage in RAM (loss in performance?)
by Kapoor, Sumit 20 Jun '16

20 Jun '16

Hello, the Question is: If I open a connection, send a query and close the connection: What do I get? Just a Copy of the Database which will be stored in the core/main memory or a reference to the DB? Here a Code Example: let $cid := client:connect("localhost",port,"user","password") let $query := 'collection("BIG-DB")/*:node' let $req := client:query($cid,$query) let $close := client:close($cid) return $req If it's just a copy in the main memory than (depends on the size oft he DB) it will cost a lot of performance. We have to use such a workaround with "client:connect" because if we try to access directly the DB more than once it will be blocked. So do you have any experience with the return value of "$req" ? Is it still a reference of the DB or is it stored in the main memory? Regards, Sumit Kapoor ------------------------------------------------------- >>> business. people. technology. <<< ------------------------------------------------------- adesso AG mit Sitz in Dortmund Vorstand: Michael Kenfenheuer (Vors.), Christoph Junge, Andreas Prenneis Vorsitzender des Aufsichtsrates: Prof. Dr. Volker Gruhn Amtsgericht Dortmund HRB 20663

3 4

Re: [basex-talk] question about http server
by Mohamed kharrat 20 Jun '16

20 Jun '16

Hi Mr christian,Well, i have contacted the hosting company, the told me that the port 1984 is closed in their server for securty reasons.I'm wondering if we can change the configuration to set another port? Best regards De : Christian Grün <christian.gruen(a)gmail.com> À : Mohamed kharrat <med_khr(a)yahoo.fr> Envoyé le : Lundi 20 juin 2016 0h48 Objet : Re: [basex-talk] question about http server Hi Mohamed> and last question about the DB: if i use db:open() it will be possible to put my DB in my host server ?db:open will open a database on the machine where BaseX is installed. Please check out the documentation for more details).Cheers Christian > > > ________________________________ > De : Christian Grün <christian.gruen(a)gmail.com> > À : Mohamed kharrat <med_khr(a)yahoo.fr> > Envoyé le : Dimanche 19 juin 2016 23h27 > > Objet : Re: [basex-talk] question about http server > > > and please execute it again. > > This is what I got now: > > <li>2.xml talk about 3.xml</li> > <li>2.xml talk about 7.xml</li> > <li>2.xml talk about 14.xml</li> > <li>2.xml talk about 11.xml</li> > > > > but supposing i want to put it in my host server. if possible, i will put > > them where? and what i have to change in php code? > > > It’s usually better to create a database from your input documents > (e.g. with the BaseX GUI), and address it with db:open() instead of > doc(). >

2 1

Re: [basex-talk] Detect if the database is open
by Christian Grün 19 Jun '16

19 Jun '16

I had a look at the actual BaseX sources, and I saw that OPEN is extremely fast if your database is already opened (it boils down to a simple name equality test). Obviously you should only use it if the addressed database already exists. If you want to have a single operation for opening and updating documents, XQuery (with db:add and db:replace) is probably the best solution. Am 20.06.2016 1:03 vorm. schrieb "Kendall Shaw" <kendall.shaw(a)workday.com>: Right now I am just adding or removing documents and executing queries. So, I imagine the time it takes to run CHECK is insignificant. But, if I am going to reuse code, then using the technique of always running CHECK before every operation seem like it might not be the best thing to do. Similarly assuming that my code elsewhere is correctly opening the database and setting a variable to say “isOpen” before it is needed also doesn’t seem like the best idea. But, I gather using CHECK all the time is the typical way to do this. So, I will do that. I thought of CHECK as create or open, it didn’t occur to me that it would optionally open. Thanks, Kendall On 6/19/16, 3:25 PM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: >Hi Kendall, > >> Is using CHECK when the database is already open comparable in CPU cycles to testing a boolean variable that says open true or false? I understand that the time it takes for most commands to execute would make code logic usually insignificant. > >Check will definitely be slower than a pure boolean check. On the >other hand, I wouldn’t expect you to notice any delay, as the >execution time should only be a few milliseconds, or even less. > >What will be the processing time you require for this operation? There >may be some chance to improve the execution time of this command (it >just hasn’t been a bottleneck so far). > >Cheers, >Christian > > >> On 6/18/16, 4:54 AM, "Christian Grün" <christian.gruen(a)gmail.com> wrote: >> >>>Hi Kendall, >>> >>>I would indeed recommend you to use the CHECK command before doing any >>>other operations. This command does exactly what you seem to be >>>looking for (checking if the databases is opened; if not, open it). >>> >>>Does this help? >>>Christian >>> >>> >>> >>>On Wed, Jun 15, 2016 at 7:03 PM, Kendall Shaw <kendall.shaw(a)workday.com> wrote: >>>> Using ClientSession from java, I do this to check if the database is open: >>>> >>>> >>>> >>>> try { >>>> >>>> replace(somewhere, new ArrayInput(bytes)); >>>> >>>> } catch (IOException e) { >>>> String msg = e.getMessage(); >>>> >>>> if (msg == null || !msg.contains(“No database opened”)) >>>> >>>> throw e; >>>> >>>> execute(new Check(databaseName)); >>>> >>>> replace(somewhere, new ArrayInput(bytes)); >>>> >>>> } >>>> >>>> >>>> >>>> Is there a better way to detect if the database is open than testing the >>>> exception message text? >>>> >>>> >>>> >>>> Kendall >>>> >>>> >>

1 0

Detect if the database is open
by Kendall Shaw 19 Jun '16

19 Jun '16

Using ClientSession from java, I do this to check if the database is open: try { replace(somewhere, new ArrayInput(bytes)); } catch (IOException e) { String msg = e.getMessage(); if (msg == null || !msg.contains(“No database opened”)) throw e; execute(new Check(databaseName)); replace(somewhere, new ArrayInput(bytes)); } Is there a better way to detect if the database is open than testing the exception message text? Kendall

2 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk