BaseX-Talk

basex-talk@mailman.uni-konstanz.de

6 participants
5250 discussions

Converting to UTF-8 in SQL module
by Tim Thompson 17 Aug '15

17 Aug '15

Hello, I am using the BaseX SQL module to query the Oracle database of a library catalog. Its character data is encoded as ISO 2709 (MARC-8)[1] and is stored in Oracle as US7ASCII. The data contains diacritics with combining characters like this: http://www.fileformat.info/info/unicode/char/0301/index.htm When I run the query in BaseX, all characters with combining accents are output as something like Ì Has anyone had experience handling this kind of encoding issue in BaseX, or does anyone have any solutions/approaches to recommend as a way to convert this data to UTF-8? Thanks in advance, Tim [1] https://en.wikipedia.org/wiki/ISO_2709 [2] http://www.fileformat.info/info/unicode/char/00e8/index.htm -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library <tat2(a)princeton.edu>

2 1

Concurrency Issue while loading documents.
by ankit kumar 17 Aug '15

17 Aug '15

Hi, We are adding number of documents concurrently to the Basex database using basex java api. Our application runs three threads in which each thread is adding documents to it by executing following instructions in java as given below. new Add("",new File(source).getAbsolutePath()).execute(context); while running our application sometimes throws the following error Java: Oracle Corporation, 1.7.0_71 OS: Windows 7, amd64 Stack Trace: java.lang.ArrayIndexOutOfBoundsException: 8 at org.basex.util.hash.TokenSet.index(TokenSet.java:161) at org.basex.util.hash.TokenSet.put(TokenSet.java:97) at org.basex.data.Namespaces.open(Namespaces.java:319) at org.basex.data.NSScope.open(NSScope.java:72) at org.basex.data.Data.insert(Data.java:775) at org.basex.query.up.atomic.Insert.apply(Insert.java:44) at org.basex.query.up.atomic.AtomicUpdateCache.applyUpdates(AtomicUpdateCache.java:297) at org.basex.query.up.atomic.AtomicUpdateCache.execute(AtomicUpdateCache.java:281) at org.basex.core.cmd.Add.run(Add.java:66) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.core.Command.execute(Command.java:123) at com.myapp.MyDataBase.addSource(MyDataBase.java:85) at com.myapp.ProcessorLoader$1.run(ProcessorLoader.java:132) at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.util.concurrent.FutureTask.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) thanks, Anky

2 2

Resolving includes
by cmarchand＠oxiane.com 17 Aug '15

17 Aug '15

Hi, back to my questions on resolving modules includes. I want to produce a .XQ file that includes all the code contained in imported modules (via import module clause). My purpose is to produce a maven plugin to do this. I think such a code already exists in basex, and I would like to reuse it. Any entry-point will be much appreciated. Thanks in advance, Christophe

2 4

Trouble with wildcard lookup operator on maps?
by Marc van Grootel 15 Aug '15

15 Aug '15

Hi, Unless I'm not reading the spec[1] correctly then the following two snippets should have the same result: Example 1: let $map := map { 'a': (1,2,3), 'b': (4,5,6)} for $k in map:keys($map) return array { $map($k) } Example 2: let $map := map { 'a': (1,2,3), 'b': (4,5,6)} for $k in $map?* return array { $k } However, this is not the case. The first outputs, as I expected: ([1,2,3], [4,5,6]) The second, counter intuitively returns (on 8.2.3) this: ([1],[2],[3],[4],[5],[6]) The spec indicates that both examples result should be identical. Didn't check if the same is going on with arrays. Hmmm? [1] http://www.w3.org/TR/xquery-31/#id-lookup

2 2

HTTP response and raising error()
by Marc van Grootel 14 Aug '15

14 Aug '15

Hi, Nothing major but I was wondering what the thinking was behind returning a 400 when fn:error is raised. Basically that says "client, your mistake not mine" where in most cases I guess a 500 would be more appropriate. Where is this decided (RESTXQ?) and is there an easy way to change the status when fn:error is used? Of course I can always catch at the highest level and then decide which HTTP status to return but I'm not sure if I want to wrap all REST calls in try / catch. -- --Marc

3 6

BaseX "subcollections"
by Tim Thompson 13 Aug '15

13 Aug '15

Hello, I see that I can create subcollections or paths within a database if I create the database then use the "ADD TO" command to add a resource at a specified path. Is this the only way to create hiearchical structure within a database? I couldn't find many details about this in the documentation. I see that the changelog for BaseX 6.3.1 includes, [ADD] REST: support for hierarchical collections added; details will follow, but I don't see anything about this in the wiki page for the REST module. Thanks in advance, Tim -- Tim A. Thompson Metadata Librarian (Spanish/Portuguese Specialty) Princeton University Library

3 3

client:info
by Andy Bunce 12 Aug '15

12 Aug '15

Hi, Not really a problem for me but I noticed this in the GUI: let $c := client:connect('localhost', 1984, 'admin', 'admin') let $d:= client:query($c, "2+ 2") return client:info($c) Improper use? Potential bug? Your feedback is welcome: Contact: basex-talk(a)mailman.uni-konstanz.de Version: BaseX 8.2.3 Java: Oracle Corporation, 1.8.0_45 OS: Windows 7, amd64 Stack Trace: java.lang.NullPointerException at org.basex.query.func.client.ClientInfo.item(ClientInfo.java:17) at org.basex.query.expr.ParseExpr.iter(ParseExpr.java:43) at org.basex.query.expr.gflwor.GFLWOR$1.next(GFLWOR.java:99) at org.basex.query.MainModule$1.next(MainModule.java:114) at org.basex.query.QueryContext.cache(QueryContext.java:660) at org.basex.query.QueryProcessor.cache(QueryProcessor.java:103) at org.basex.core.cmd.AQuery.query(AQuery.java:83) at org.basex.core.cmd.XQuery.run(XQuery.java:22) at org.basex.core.Command.run(Command.java:398) at org.basex.core.Command.execute(Command.java:100) at org.basex.gui.GUI.exec(GUI.java:472) at org.basex.gui.GUI.access$400(GUI.java:43) at org.basex.gui.GUI$7.run(GUI.java:412) And slightly related.. In the DBA query window let $c := client:connect('localhost', 1984, 'admin', 'admin') return client:query($c, "2+ 2") will block the basex server for all http users and basexclient (s). Sad, but I can see why this might be :-), Another way to achieve this is on the dba login page enter "localhost:1984" as a *remote *host. but is there any way to programmatically detect this situation has occurred or cancel these queries without restarting the server? /Andy

2 3

basex limits: #ENames
by Simon Görke 12 Aug '15

12 Aug '15

Hello, according to [1], basex supports a maximum of 2^15 #ENames per database. Would there be any feedback (warning / error message / exit from processing) if this limit was exceed? If not: Could this be an explaination for turning the output of a xslt (xml => xml) to be not well-formed (The xslt itself is mature and has been used in exactly the same environment in several projects for > 2 years without problems.)? Now, with the latest project, an export of the database after the (seemingly issue-free) xslt-transform delivers e.g. elements at positions where they should not appear / opening elements not fitting their closing counterparts / missing content at the end? All other projects are ok with the current setup, but have significantly less data. The output dialect is somewhat "creative" and prone to resulting in a diversity of ENames, so this triggered my suspicion here... I am using basex 8.2.3 on Java 1.8.51 / 64bit. Also tried with 8.0.2, but same issue there. The transformations are triggered by a small snippet of xquery sent from a basexclient to the server. Thanks, Simon [1] http://docs.basex.org/wiki/Statistics

2 3

Command history in basex client
by adj7388 12 Aug '15

12 Aug '15

Hello, Does the basex command line client keep no command history? I am using the Linux version. In most Linux command line programs, the up- and down-arrows allow you to scroll through past commands so you don't have to retype them every time. I see "Save command-line history" in the change log for version 8.0.1 ( and I have version 8.2.3 installed) but command history does not appear to work. Thanks, Alan

3 4

HTML parsing in the DBA
by Kristian Kankainen 12 Aug '15

12 Aug '15

Hello! I tried simple cut and paste from the wiki and came up with the following query for importing an HTML file. The DBA says "Query was successful", but no resources are never added to the db. declare option db:parser "html"; declare option db:htmlparser "html=false,nodefaults=true"; db:replace("dbname", "filename.html", "/file/path/filename.html") I'm running the latest war file on Tomcat. Best wishes Kristian Kankainen

2 1

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk