- BaseX-Talk - mailman.uni-konstanz.de

Missing namespaces when storing an excerpt?
by Clark, Ash 29 Mar '21

29 Mar '21

Hi! I’m pulling JSON from an API, converting the string to the XML representation, and storing part of the resulting XML into BaseX. The problem is, I can’t get the xmlns namespace declaration to stick to the XML excerpt once it’s saved to BaseX. It seems to work when I display the unstored excerpt. Here’s a short XQuery that illustrates my problem. Am I missing something? Is this a bug? xquery version "3.1"; (: NAMESPACES :) declare default element namespace "http://www.w3.org/2005/xpath-functions"; declare namespace db="http://basex.org/modules/db"; declare namespace output="http://www.w3.org/2010/xslt-xquery-serialization"; declare namespace update="http://basex.org/modules/update"; (: OPTIONS :) declare option db:chop 'false'; declare option db:stripns 'false'; declare option output:indent 'yes'; declare option output:method 'xml'; (: MAIN QUERY :) let $uri := "https://wwp.northeastern.edu/exist/rest/db/exhibits/xquery/people.xquery?fi…" let $full := json-to-xml(unparsed-text($uri)) let $snippet := $full/fn:array/fn:map[1] let $workaround := <map xmlns="http://www.w3.org/2005/xpath-functions">{ $snippet/* }</map> return ( db:create("test-ns", ($full, $snippet, $workaround), ("full.xml", "snippet.xml", "workaround.xml")), update:output(($snippet, $workaround)) ) Thanks for your time! Warmly, Ash Ash Clark (my pronoun.is/e/em/eir<http://pronoun.is/e/em/eir>) XML Applications Developer Digital Scholarship Group Northeastern University Libraries as.clark(a)northeastern.edu (617) 373-5983

2 6

Question about JSON parsing/serializing
by Hans-Juergen Rennau 22 Mar '21

22 Mar '21

Dear BaseX team, there is something I don't understand about the parsing/serializing of JSON. When I serialize a document without options, backslashes are escaped. So for example ... <url>https://help.openconnectors.ext.hana.ondemand.com/home/google-analytics</url> becomes"url":"https:\/\/help.openconnectors.ext.hana.ondemand.com\/home\/google-analytics" Only using serialization options - map{"escape": "no"} - do I get the output as expected, corresponding to the input. Why are slashes by default escaped when serializing JSON? Kind regards,Hans-Jürgen PS: When parsing, the slashes are not escaped, so it is "asymmetrical" - I need to parse without options, yet to serialize with options.

4 12

Re: [basex-talk] Call for install/setup stories from users
by Graydon 18 Mar '21

18 Mar '21

On Wed, Mar 17, 2021 at 10:43:07PM +0100, Ben Engbers scripsit: > To my knowledge there is no need to remove the data directory. I have never > done this and have never had any problems Well, data/ is in the archive empty and I need to retain the existing data from the incumbent basex when I update BaseX. I find it's simpler to promote data/ to being a sibling of basex/ and use a symbolic link from inside basex/ to find it so I don't have to argue with the defaults. (I am far from sure you can argue with the defaults to the extent of putting the data directory outside of basex/.) So, if you have no need to retain data = no need to do anything with data/. But if you do need to retain data/, giving whatever archive tool a chance to drop an empty data/ over it on upgrade is maybe not the best plan. -- Graydon Saunders | graydonish(a)gmail.com Þæs oferéode, ðisses swá mæg. -- Deor ("That passed, so may this.")

1 0

Preferences do not open, Exception in thread AWT-EventQueue-0
by commandline-be 17 Mar '21

17 Mar '21

Hey, To split off this bug report from the 'first post on this mailinglist' thread. Noteworthy but probably not relevant is every time is start basexgui i see [warning] /usr/bin/basexgui: Unable to locate /usr/share/java/tagsoup.jar in /usr/share/java [warning] /usr/bin/basexgui: Unable to locate /usr/share/java/jline.jar in /usr/share/java This is the output i see in the terminal when running the command basexgui and selecting Preferences in the window. This repeats every time i select Preferences. Exception in thread "AWT-EventQueue-0" java.lang.IndexOutOfBoundsException: Index: 3, Tab count: 3 at java.desktop/javax.swing.JTabbedPane.checkIndex(JTabbedPane.java:1758) at java.desktop/javax.swing.JTabbedPane.setSelectedIndex(JTabbedPane.java:595) at org.basex.gui.dialog.DialogPrefs.<init>(DialogPrefs.java:44) at org.basex.gui.dialog.DialogPrefs.show(DialogPrefs.java:56) at org.basex.gui.GUIMenuCmd$50.execute(GUIMenuCmd.java:778) at org.basex.gui.GUIMenu.lambda$newItem$0(GUIMenu.java:77) at java.desktop/javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1967) at java.desktop/javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2308) at java.desktop/javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:405) at java.desktop/javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:262) at java.desktop/javax.swing.AbstractButton.doClick(AbstractButton.java:369) at java.desktop/javax.swing.plaf.basic.BasicMenuItemUI.doClick(BasicMenuItemUI.java:1020) at java.desktop/javax.swing.plaf.basic.BasicMenuItemUI$Handler.mouseReleased(BasicMenuItemUI.java:1064) at java.desktop/java.awt.Component.processMouseEvent(Component.java:6635) at java.desktop/javax.swing.JComponent.processMouseEvent(JComponent.java:3342) at java.desktop/java.awt.Component.processEvent(Component.java:6400) at java.desktop/java.awt.Container.processEvent(Container.java:2263) at java.desktop/java.awt.Component.dispatchEventImpl(Component.java:5011) at java.desktop/java.awt.Container.dispatchEventImpl(Container.java:2321) at java.desktop/java.awt.Component.dispatchEvent(Component.java:4843) at java.desktop/java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4918) at java.desktop/java.awt.LightweightDispatcher.processMouseEvent(Container.java:4547) at java.desktop/java.awt.LightweightDispatcher.dispatchEvent(Container.java:4488) at java.desktop/java.awt.Container.dispatchEventImpl(Container.java:2307) at java.desktop/java.awt.Window.dispatchEventImpl(Window.java:2772) at java.desktop/java.awt.Component.dispatchEvent(Component.java:4843) at java.desktop/java.awt.EventQueue.dispatchEventImpl(EventQueue.java:772) at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:721) at java.desktop/java.awt.EventQueue$4.run(EventQueue.java:715) at java.base/java.security.AccessController.doPrivileged(Native Method) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:85) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:95) at java.desktop/java.awt.EventQueue$5.run(EventQueue.java:745) at java.desktop/java.awt.EventQueue$5.run(EventQueue.java:743) at java.base/java.security.AccessController.doPrivileged(Native Method) at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:85) at java.desktop/java.awt.EventQueue.dispatchEvent(EventQueue.java:742) at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(EventDispatchThread.java:203) at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(EventDispatchThread.java:124) at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:113) at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:109) at java.desktop/java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:101) at java.desktop/java.awt.EventDispatchThread.run(EventDispatchThread.java:90) Best, Joris- - - mailto:commandline@protonmail.com

6 16

first post on this mailinglist
by commandline-be 17 Mar '21

17 Mar '21

Dear, With a need to dig into ms eventlog converted to xml i landed with BaseX and was amazed by the functionality presented with this tool. I'm new to many things here so i'm going thru a learning curve here. This mail is mostly to propose improvement and feature requests, some minor other may be more elaborate * Map visualisation : a mode in which the keys are listed in hierarchical yet isometric way so they are not abreviated but listed for visual acessibility. * Forms builder : a simple form builder to datamine xml files would be nice, for my current purpose i'm to write a number of queries to identify specific eventid, attributes and values in relation to one another, being able to simply select a query in a drop down would be nice to review results etc * Possible bug : the preferences dialog no longer shows up * upgrade path : working with a linux distro prohibits simple upgrading, an upgrade dialog for drop in out of band upgrades could prove welcome to not flood this mailing list old bugs Thank you, Joris

2 3

Simple xqdoc to HTML converter
by Omar Siam 15 Mar '21

15 Mar '21

Hi, I brushed up the 2006 xqdoc to HTML XQuery a bit to document some of my code. Maybe this is also interesting to others. https://github.com/acdh-oeaw/xqdoc I also found https://github.com/lcahlander/xqDoc-eXist-db mentioned on this mailing list. I plan to look into getting this to work on BaseX. Best regards Omar Siam

3 2

Options for ft:search
by Sebastian Zimmer 15 Mar '21

15 Mar '21

Hi, I'd like to request a feature concerning the ft:search method: An `lserror` option that works exactly like the global option `LSERROR`. It would be nice if we could set the maximum Levenshtein distance specifically for each fuzzy search without having to adjust the global option. Another question on ft:search: Is there a reason why it doesn't have a `case` option just like ft:contains has one? Best regards, Sebastian

2 3

Histogramming a large dataset
by Ron Katriel 10 Mar '21

10 Mar '21

Hi, I would appreciate your advice on optimizing a query against a large BaseX (9.2.4) database. It is loaded with data from the FDA’s Adverse Event Reporting System (FAERS). Currently this is just the 2020 dataset which comprises 12 documents stored as 308,870,597 nodes (6,565 MB). The queries below effectively - though not necessarily efficiently - implement a histogram. The first, which is applied to patient gender (sex), returns the results (3 items) in 52 seconds: 2 893694 1 583999 0 198 The second does this for patient weight - rounded to the closest 10 lbs increment. It takes 580 seconds to place the data into 67 bins. Initially I tried running it on the rounded weights but aborted the run as it was a taking an inordinate amount of time (there are 217 distinct weights in the dataset). Is there a way to improve the performance of this type of query? Thanks, Ron (: 3 items - 52 sec :) let $safetyreport := db:open('FAERS')/ichicsr/safetyreport for $value in distinct-values($safetyreport/patient/patientsex) return concat($value, " ", count(index-of($safetyreport/patient/patientsex, $value))) (: 67 items - 580 sec :) let $safetyreport := db:open('FAERS')/ichicsr/safetyreport for $value in distinct-values($safetyreport/patient/patientweight ! (. div 10.0) ! round(.) ! (. * 10)) return concat($value, " ", count(index-of($safetyreport/patient/patientweight ! (. div 10.0) ! round(.) ! (. * 10), $value))) -- The information in this email and any attachments are intended solely for the recipient(s) to whom it is addressed, and may be confidential and/or privileged. Any unauthorized distribution or copying of this transmittal or its attachments is prohibited. If you are not a named recipient or have received this email in error: (i) you should not read, disclose, or copy it, (ii) please notify the sender of your receipt by reply email and delete this email and all attachments.

3 6

Question about Staircase Join
by Yasir B 03 Mar '21

03 Mar '21

Hello, I am studying the paper "Storing and Querying Large XML Instances". [https://files.basex.org/publications/Gruen%20%5B2010%5D,%20Storing%20and%20…] This is very interesting and helpful to read! I apologize I fail to understand the following in 3.4.2.1 Staircase Join: "In the partitioned plane, the scanned areas are made disjunct, i.e., scanning is canceled whenever the pre value of the currently scanned node equals the pre value of the next context node." Since pre values are unique (?), I couldn't follow how the next context node would have the same pre value. For the partitioning step, I had the impression the next context node is not the same as the current context node, nor would it be a descendant of the current context node. Thank you, Yasir

2 1

map-entries sequence
by Rob Stapper 02 Mar '21

02 Mar '21

Hi Christian, In my casus I’m exporting and importing xQuery maps where the export-format is a xQuery-file or a json-file. Hereby the sequence of the exported map-entries is important: I want the sequence in which the entries are generated to stay in tact when exporting. I can’t get this working. My current work-around is to place the map-entries in an array. It does the trick but it feels redundant. Is there a way to have this kind of control over map-entry sequence? Thnx in advance, Rob Stapper Sent from Mail for Windows 10 -- This email has been checked for viruses by Avast antivirus software. https://www.avast.com/antivirus

2 1