- BaseX-Talk - mailman.uni-konstanz.de

Efficiently using BaseX and JAXB
by Zachary DeLuca 10 Jun '14

10 Jun '14

Hello, I have a question about unmarshaling a query result into JAXB object(s). My database collection contains documents that all contain the same type of root element, let's call it Element1. Originally I was doing something like this (I know it's silly but it worked just fine for small data sets): String CLOSING_TAG = "</Element1>"; Context context = ... Unmarshaller um = ... String predicate1 = ... String predicate2 = ... String query = "//Element1[" + predicate1 + " and " + predicate2 + "]"; String result = new XQuery(query).execute(context); if (result != null && !result.isEmpty()) { ArrayList<Element1> elements = new ArrayList<>(); int index = -1; int beginIndex = 0; while ((index = result.indexOf(CLOSING_TAG, beginIndex)) != -1) { int endIndex = index + CLOSING_TAG.length(); String element1 = result.substring(beginIndex, endIndex); beginIndex = endIndex + 1; elements.add(((Element1) um.unmarshal(new ByteArrayInputStream(element1.getBytes())))); } // do something with the elements } But when I got into larger data sets (my DB collection is currently approx. 1GB total size and has just over 20k documents) this started to fail apparently due to trying to convert the entire result to a string at one time (out of memory error, despite setting -Xmx16384m). So I dig through the examples to find a better way and changed my code to this: ByteArrayOutputStream baos = new ByteArrayOutputStream(); Iter iter = null; Serializer ser = null; QueryProcessor proc = new QueryProcessor(query, context); iter = proc.iter(); ser = proc.getSerializer(baos); proc.close(); if (iter != null && ser != null) { ArrayList<Element1> elements = new ArrayList<>(); for(Item item; (item = iter.next()) != null;) { baos.reset(); ser.serialize(item); elements.add(((Element1) um.unmarshal(new ByteArrayInputStream(baos.toByteArray())))); } ser.close(); // do something with the elements } This appears to work fine but I am just wondering if there is a better/faster way to do it? At first glance, serializing to a ByteArrayOutputSream only to then turn around and use a ByteArrayInputStream to unmarshal with JAXB seems wasteful. Thanks for taking the time to read, Zach

2 4

BaseX Design
by Vaibhav Khare 07 Jun '14

07 Jun '14

Hi, I have a requirement to build XML repository where I will store millions of XML documents (size may vary) based on some unique Ids (one level path like - \10). For another operation, I need to compare the incoming XML document with the stored XML document for any changes. 1. Can any of you please let me know on how to implement this in BaseX? Apart from inserting the XMLs and comparing them with the incoming XML, there is no other query required. 2. Performance is the major criteria for this. Do you think BaseX will be able to handle this as the repository size grows? Also, is there a way to do batch processing of the above operations to improve performance? Thanks in advance, ~ VK

2 1

Wie ich meinen Tinnitus kuriert habe
by Jessica Neustadt 06 Jun '14

06 Jun '14

To stop receiving these emails:http://mail0.tinnitusdoktor.me/unsubscribe.php?M=76094&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo, Falls Sie oder jemand Ihrer Lieben an Tinnitus leidet, dann ist dies das wichtigste Schreiben, das Sie jemals gelesen werde. Wissen Sie, was die Ursachen für Tinnitus sind? Dieser GRATIS-Artikel wird Sie darüber aufklären: http://www.tinnitusdoktor.me Wachen Sie manchmal mitten in der Nacht auf und hören komische Geräusche? Ja, das kann wirklich angsteinflößend sein, vor allem, wenn Sie nicht wissen, wo diese Geräusche herkommen. Klicken Sie hier, um den Artikel zu lesen und herauszufinden, wie Sie Tinnitus kurieren können: http://www.tinnitusdoktor.me Mit freundlichen Grüßen, Christine Weiss

1 0

BaseX 7.8.2: The Spring Edition
by Christian Grün 06 Jun '14

06 Jun '14

Dear subscribers, today we are please to provide you with BaseX 7.8.2, the Spring Edition! This is what you can expect (find more details in our changelog): * GUI Editor: Efficiently sort large texts (Ctrl-U) * Storage, Updates: Faster processing of documents with namespaces * Database Module: alter, copy, create-backup, drop-backup, restore * Admin Module: new merge option, existing functions revised * XQuery Module: new evaluation options (memory, timeout, permissions) * XQuery: always show full stack trace (enforce it with INLINELIMIT=0) * XQuery Ester egg: calculating partial sums (little Gauss) * Client/Server architecture: reduce waiting time if password is wrong We invite you to get the latest version via http://basex.org, and we are interested in your feedback, Christian BaseX Team

3 5

mainmem bug?
by Marc 04 Jun '14

04 Jun '14

Hi, I try to use the mainmem flag because I use a temporally base to do some specific treatments and extract it after. But when I create the database it isn't! the easy script : --------------------- set mainmem true create db test list open test ------------------- the result : ------------------ MAINMEM: true Database 'test' created in 0.08 ms. name Resources Size Input Path --------------------------------------------------- baseCo 2 3742851 FichiersBase 5958 5357259729 FichiersBaseTest 5958 5205620197 3 database(s). Database 'test' was not found. -------------------- the infos : -------------- General Information: Version: 7.8 Used Memory: 1994 KB The main memory database doesn't exist anymore? Marc

3 5

Erfahren Sie die schockierende Wahrheit über Hefepilzinfektionen
by Claudia Kuster 03 Jun '14

03 Jun '14

To stop receiving these emails:http://mail0.pilzcandida.me/unsubscribe.php?M=189029&C=08a2923af15af1ad713ec0788079def3&L=1&N=2 Hallo, Machen Sie sich selbst schlau zum Thema Candida-Infektionen. Dies ist der erste und wichtigste Schritt zur Heilung dieser schmerzhaften, äußerst lästigen und relativ gefährlichen chronischen Erkrankung. Übernehmen Sie selbst die Verantwortung für Ihre Gesundheit und Ihr Wohlergehen. Das Problem ist, dass ein Großteil der an einer Hefepilzinfektion leidenden Personen sich dafür entscheidet, es anderen zu überlassen , sich darum zu kümmern: Ärzte, Apotheker, Medikamente und rezeptfreie Arzneimittel. Ganz bewusst entscheiden sie sich dafür, für ihre Candida-Infektion, ihre eigene Gesundheit und ihren Körper KEINERLEI Verantwortung zu übernehmen. Klicken Sie hier und lesen Sie mehr dazu: http://www.pilzcandida.me Um TATSACHEN herauszufinden, wie Sie Ihre Hefepilzinfektion tatsächlich und dauerhaft, sozusagen mit der Wurzel und zu 100 % auf natürliche Weise beseitigen können und eine NACHHALTIGE Befreiung von mit Candida verbunden Symptomen erlangen, ohne dafür Ihr schwer verdientes Geld für frei verkäufliche Arzneimittel ausgeben zu müssen... Klicken Sie hier und erfahren Sie mehr: http://www.pilzcandida.me mit freundlichen Grüßen, Christin Strauss

1 0

Re: [basex-talk] [FORG0006] Unknown method:
by Christian Grün 02 Jun '14

02 Jun '14

Hi Erol (cc to the list), > That solved the issue! > Thanks for your help > > I like to know what is difference between xs:int and xs:integer ? Values of type xs:integer may be bigger than Java integers. You'll need BigInteger to accept these values in a Java function. Hope this helps, Christian

2 6

Fw: Increase Performence
by ChandraSekhar 02 Jun '14

02 Jun '14

Dear Team I have collection in gb's ,so I am sending one sample xml along with query.Please give me the tips for performance and please do the need full. Thanks & Regards Chandra Sekhar -----Original Message----- From: Christian Grün Sent: Wednesday, May 28, 2014 1:29 PM To: ChandraSekhar Subject: Re: Reg : Increase Performence Hi Chandra, we clearly need more information to give you hints. Did you e.g. check out the query compilation on the InfoView? Best, Christian PS: To get more information, please write to the basex-talk mailing list. On Wed, May 28, 2014 at 8:12 AM, ChandraSekhar <chandrasekhar.r(a)intense.in> wrote: > Dear Chirstian > > Earlier we are using 6.7 version now we are > migrating this into the latest version,compare to the 6.7 and 7.8.2,In > latest version performance was very high. > But when my collections are in GB'S(we are running the > query's on multiple collections) .Its taking long time and consuming > memory. > Is there any solution that we can handle like this cases. > > > Thanks & Regards > Chandra Sekhar > > -- > This message is for the intended recipient only. If you are not the > intended recipient you are notified that disclosing, copying, > distributing or taking any action in reliance on the contents of the > information is strictly prohibited. > __ -- This message is for the intended recipient only. If you are not the intended recipient you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of the information is strictly prohibited. __

2 1

USPTO XML format causes BaseX GUI errors
by Jose Rey 29 May '14

29 May '14

Hi, I am new to BaseX and will attempt to use it to analyze xml datasets from R at some point in the near future. I am using a BaseX GUI under Windows-7 operating system and had an error while trying to create a database using the GUI by using an XML file as input. The file comes from the US Patents and Trademarks Office (USPTO), and the larger XML datasets they provide have the same problem. The error text is: Command: CREATE DB ipgb20110104Sample C:/Users/admin/Downloads/ipgb20110104Sample.xmlError:"C:/Users/admin/Downloads/ipgb20110104Sample.xml" (Line 306): The processing instruction target matching "[xX][mM][lL]" is not allowed. The XML document I am trying to open is contained in this zip file: http://www.uspto.gov/products/ipgb110104-sample.zip The link to the document is in this page: http://www.uspto.gov/products/xml-resources.jsp under the "Patent Grant Data / XML ST. 36 (ICE) v4.2 (a.k.a. Red Book) (2007 - 2012)" section of the page, under the "Sample Documents (Bibliographic)" bulletpoint >From searching online, I found that the error is because of poor formatting in the file. However, larger datasets of the same kind (USPTO bulk download @ Google) have the same problem. In the specific case of the file I mention, it has a carriage return in the first line, and then has several concatenated XML files, which is the case of the larger XML files from the USPTO. My question is: Is there a work around to this error/problem? Can I somehow tell BaseX to ignore or somehow acknowledge that mistake and load the file(s). Thank you so much, Jose -- Jose I. Rey onlyrey(a)gmail.com

2 2

How to change processor to Saxon
by emchateau＠laposte.net 28 May '14

28 May '14

Using based to publish TEI-XML files, allows to take benefits from the Java's environment using XSLT 2.0. But we didn't cope with putting Saxon in the Classpath for BaseX. Is there any simple steps doing it ? On a mac, we were able to do it by putting the Saxon's jar files into `/Library/Java/Extensions/` Running basexhttp, the expression `xslt:processor()` returns "Saxon" and `xslt:version()` returns "2.0". On an ubuntu machine, there is no such directory for Java. We've first tried to set the CLASSPATH with `export CLASSPATH=/usr/share/java/saxon9he.jar` (and various other things) unhopely without success. Your help would be very welcome ! Emmanuel Chateau and Philippe Pons

4 3