BaseX-Talk

basex-talk@mailman.uni-konstanz.de

7 participants
5251 discussions

Option Parallel Verständnisfrage
by Dennis Wiest 23 Jul '15

23 Jul '15

Hallo, ich habe eine Verständnisfrage bezüglich der Option "Parallel". Ich wollte mir einen Überblick über die Geschwindigkeit von BaseX machen bezüglich mehrerer Benutzeranfragen. Ich verwende Basex 7.7. Ich habe mir ein Java Programm mit Multithreads geschrieben, welches das ganze simuliert. Das Script funktioniert soweit auch und es werden mir im BaseX die Session für jeden Benutzer angezeigt. Als erstes hab ich Parallel auf 20 gesetzt. Mir ist dabei aufgefallen das es pro Benutzer immer langsamer wird und die CPU-Auslastung nicht wirklich hoch ist. Wird das ganze gar nicht Parallel abgearbeitet ? Verteilt BaseX die Last nicht auf die CPU´s?? Danach hab ich Parallel auf 1 gesetzt. Das Ergebnis ist schneller als Parallel 20, das dürfte bei einer sequenziellen Abarbeitung nicht sein oder ?? Das ganze System läuft auf einem HP Server mit 64 GB Arbeitsspeicher einer PCI SSD Festplatte und einem Intel Xeon E5-2690 8-Core 2.90 GHz Prozessor. Könnt ihr mir da vielleicht eine Erklärung liefern ? Ich hab das ganze nochmal in Englisch geschrieben. Vielen dank Gruß Dennis Wiest Hello There, I have a question concerning the understanding of "parallel" option. I wanted to make an overview of the speed of BaseX regarding several user requests. I use Basex 7.7. I have a Java program written with multi-threads, to simulating this. The script works well so far and the session for each user are displayed in BaseX. First I set "parallel" to 20. I've noticed that it is getting slower for each user and the CPU utilization is not really high. Will not parallel processed? Distributes the load on the CPU not BaseX ?? Then I got the same and set "parallel" to 1. The result is faster than parallel 20, that should not be in a sequential processing or ?? The whole system runs on an HP server with 64GB of RAM PCI SSD hard drive and an Intel Xeon E5-2690 8-core 2.90 GHz processor. Can you provide an explanation as me, maybe? I have the whole again written in English. many thanks Greeting Dennis Wiest ________________________________ Avitech GmbH Principal Office: Bahnhofplatz 1 | 88045 Friedrichshafen | Germany Court Registration: Amtsgericht Ulm | HRB 728293 Geschäftsführer/Managing Director: Antonio Maria Gonzalez Gorostiza VAT No.: DE223719716 http://avitech.aero

2 1

BASEX Help
by Yassine Hamdouni 23 Jul '15

23 Jul '15

hello , I'm studying engineering school, I have to make a java method that allows to import the xml file, and put in a database so it ca not exist creates it, and after you optimize, I do this code, but my placement tutor does not agree, is that you can help me please. public void importerImpl(File dossierContenantLesXmls, String nomDeLaBaseDeDonnee, boolean ecraserDb) { final Context context = null; Parser parser = null; File[] listefichierXml = dossierContenantLesXmls.listFiles(); /*tester si la base de donnée exste on l'ouvre sinon on la crée pour le test d'existence il y a ausi cette fonction à voir avec Bruno con.getDatabaseConnection(nomDeLaBaseDeDonnee); */ System.out.println("------------------ opens an existing database or creates a new one------------------ "); if(context.soptions.dbexists("nomDeLaBaseDeDonnee")) { new Open ("nomDeLaBaseDeDonnee"); }else { try { Data data = CreateDB.create( nomDeLaBaseDeDonnee, parser, context, null); new Open ("nomDeLaBaseDeDonnee"); } catch (IOException ex) { ex.getCause(); } } // parcourir une liste de fichier Xml puis ajouter chaque fichier a basex for (int i=0;i<=listefichierXml.length;i++){ new Add("listefichierXml[i].getAbsolutePath()"); } new Optimize(); context.close(); } } -- cordialement HAMDOUNI Yassine

2 1

BaseX 7.9 problem
by cmarchand＠oxiane.com 23 Jul '15

23 Jul '15

Hello ! I have an exception throw on BaseX 7.9 I've just installed it on a linux box, in /usr/local/basex-79, owned by root, chowned -R a+wr *, and run by another user. Here is the problem : $ /usr/local/basex/bin/basex -d BaseX 7.9 [Standalone] Try help to get more information. > SHOW USERS Exception in thread "main" java.lang.NullPointerException at org.basex.core.Context.perm(Context.java:220) at org.basex.core.Command.execute(Command.java:84) at org.basex.server.LocalSession.execute(LocalSession.java:121) at org.basex.server.Session.execute(Session.java:37) at org.basex.core.CLI.execute(CLI.java:106) at org.basex.core.CLI.execute(CLI.java:90) at org.basex.BaseX.console(BaseX.java:197) at org.basex.BaseX.<init>(BaseX.java:171) at org.basex.BaseX.main(BaseX.java:42) Any help will be appreciated to identify the problem... Best regards, Christophe

1 1

basexclient and modules
by cmarchand＠oxiane.com 23 Jul '15

23 Jul '15

Hello ! we would like to execute thru basexclient a xquery script that includes a xquery module : xquery encoding "utf-8"; declare namespace db="http://basex.org/modules/db"; import module namespace om-ll='http://els.eu/ns/efl/offresMetiers/CreateCIActu/lowLevel' at 'lowLevel.xqm'; With basexgui and basex CLI, no problem. But with basexclient, it seems included files are not send to server, so server can not resolve dependencies, and compile xquery. I can understand that compilation must be done on server-side - well, at least optimization - but client could parse the .xq file to check if there are imports, and either push them to server, or throw an error without accessing the server. Is this an issue ? Is there an utility-tool which allows to generates a single script file from a .xq and included .xqm, that I could use before running basexclient ? Best regards, Christophe

2 2

Union of maps?
by Graydon Saunders 20 Jul '15

20 Jul '15

Hi -- In BaseX 8.2.1, I have a bunch of maps; the maps may have some overlap of key values. I would like to merge/find the union of all of these maps while retaining all the values associated with each key in the resulting map-of-all-maps. (Combined map? Any word can be wrong, here! :) map:merge() doesn't do this; http://docs.basex.org/wiki/Map_Module#map:merge says "The associated value for each such key is taken from the last map in the input sequence $input that contains an entry with this key." and testing confirms this. Is there a straightforward way to do this that I'm missing? Thanks! Graydon

4 12

BaseX Pegging Java Process: How To Diagnose?
by Eliot Kimber 20 Jul '15

20 Jul '15

Using BaseX 8.2.1 HTTP server, not actively performing any queries (but having performed some after restarting the server), BaseX is pegging one of my processors. What can I do to determine what BaseX is doing when it's in this state? Thanks, E. ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

2 1

Re: [basex-talk] More Array Troubles: Syntax Subtlety That I'm Missing
by Eliot Kimber 17 Jul '15

17 Jul '15

Please ignore my question: apparently I hadn't saved the module that corrected my bug. So sorry for the noise. Cheers, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com On 7/17/15, 9:30 AM, "Eliot Kimber" <basex-talk-bounces(a)mailman.uni-konstanz.de on behalf of ekimber(a)contrext.com> wrote: >I have this recursive function that takes an array as its second >parameter: > > >declare function lmm:applyScopesToNames( > $keyNames as xs:string+, > $keyScopes as array(*), > $qualifiedNames as xs:string*) as xs:string* { > let $result := > if (array:size($keyScopes) = 0) > then $qualifiedNames > else > let $newNames := > for $name in $keyNames > return for $scopeName in $keyScopes(1) > return $scopeName || "." || $name > return lmm:applyScopesToNames( > $newNames, > array:tail($keyScopes), > ($qualifiedNames, $newNames) > ) > return $result >}; > > > >Testing with this input: > >let $keyName := "base" >$keyScopes := [("s3", "s4"), ("s1", "s2")] > >This call: > >let $qualifiedNames := > lmm:applyScopesToNames( > ($keyName), > $keyScopes, > ()) > > >Results in the message "Item expected, sequence found: [("s3", "s4"), >("s1", "s2")]." > >Unfortunately, the BaseX interactive query tool doesn't report the line >that produces the message, but the only place I'm passing the full array >is in the initial call to the function from my test query. > >I've also verified that if I pass in [] as the keyScopes parameter then I >get the expected result (that is, the value of the 3rd parameter is >returned). > >I've verified that $keyScopes is an array of two sequences and as far as I >can tell I'm passing arrays where arrays are expected so I'm not sure what >my error is, but there must be one. > >Thanks, > >Eliot > >---- >Eliot Kimber, Owner >Contrext, LLC >http://contrext.com > > > >

1 0

More Array Troubles: Syntax Subtlety That I'm Missing
by Eliot Kimber 17 Jul '15

17 Jul '15

I have this recursive function that takes an array as its second parameter: declare function lmm:applyScopesToNames( $keyNames as xs:string+, $keyScopes as array(*), $qualifiedNames as xs:string*) as xs:string* { let $result := if (array:size($keyScopes) = 0) then $qualifiedNames else let $newNames := for $name in $keyNames return for $scopeName in $keyScopes(1) return $scopeName || "." || $name return lmm:applyScopesToNames( $newNames, array:tail($keyScopes), ($qualifiedNames, $newNames) ) return $result }; Testing with this input: let $keyName := "base" $keyScopes := [("s3", "s4"), ("s1", "s2")] This call: let $qualifiedNames := lmm:applyScopesToNames( ($keyName), $keyScopes, ()) Results in the message "Item expected, sequence found: [("s3", "s4"), ("s1", "s2")]." Unfortunately, the BaseX interactive query tool doesn't report the line that produces the message, but the only place I'm passing the full array is in the initial call to the function from my test query. I've also verified that if I pass in [] as the keyScopes parameter then I get the expected result (that is, the value of the 3rd parameter is returned). I've verified that $keyScopes is an array of two sequences and as far as I can tell I'm passing arrays where arrays are expected so I'm not sure what my error is, but there must be one. Thanks, Eliot ---- Eliot Kimber, Owner Contrext, LLC http://contrext.com

1 0

debian release for BaseX 8.2.3
by Stefan Koch 16 Jul '15

16 Jul '15

2 1

Full memory database
by cmarchand＠oxiane.com 16 Jul '15

16 Jul '15

Hello, is there a way to put all the databases in memory ? We have a 30Gb database, serving as repository for XInclude-like resolution, and I want to avoid disk access (I work with Marc Messeant...) Using special JVM, I can allocate many memory, and so want to work only in memory. Is this possible ? Best regards, Christophe

3 4

Jump to page:

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

BaseX-Talk