July 2014 - BaseX-Talk - mailman.uni-konstanz.de

Cannot instantiate java.net.URLEncoder
by Marc van Grootel 30 Jul '14

30 Jul '14

Hi, What could be the reason that importing java.net.URLDecoder works as expected but doing the same with java.net.URLEncoder doesn't. The following works: import module namespace decoder = "java.net.URLDecoder"; decoder:decode('foo/bar%20baz') => 'foo/bar baz' This gives a "Could not instantiate module 'java.net.URLEncoder' import module namespace encoder = "java.net.URLEncoder"; encoder:encode('foo/bar baz') --Marc

2 3

Re: [basex-talk] How to create xml file dynamically and store into database directly without storing into my disk?
by Dirk Kirsten 30 Jul '14

30 Jul '14

Hello Manish, please always reply to the list, so others can also benefit from questions and answers. String query = "db:add("db","xmlFile")"; will certainly not work, this will throw a java error due to the ". This should work: String query = "db:add('db','xmlFile')"; As I already suggested (multiple times) on StackOverflow, you will have to build and modify the document within BaseX using XQuery Update. This way, the XML file can be kept in main memory and later be added to the database. Please read up in our documentation about XQuery Updates. Cheers, Dirk On 30/07/14 11:37, manish payasi wrote: > Thanks Dirk, > > I am trying to write like > String query = "db:add("db","xmlFile")"; where xmlFile is string > variable which has xml file name, > but it is throwing some syntax error (like Syntax error on tokens, delete > these tokens for both the arguments) . > > Another thing is that in second argument we are passing the xml file which > is still coming from disk which we don't want it rather than i want create > the xml file dynamically in java and store this file directly into database. > > Thanks and Regards > manish payasi. > > > > On Tue, Jul 29, 2014 at 6:29 PM, Dirk Kirsten <dk(a)basex.org> wrote: > >> Hi Manish, >> >> You might want to take a look at our java examples here : >> https://docs.basex.org/wiki/Java_Examples >> >> So to simply execute an XQuery and using db:add() (see >> https://docs.basex.org/wiki/Database_Module#db:add) to add to the >> database would look something like that: >> >> Context context = new Context(); >> String query = "db:add("your-database", <xml>here goes your >> xml</xml>, "myfile.xml") >> QueryProcessor proc = new QueryProcessor(query, context); >> proc.execute(); >> proc.close(); >> context.close(); >> >> the second argument of db:add() is an item(), so you can also >> dynamically generate an XML element here. >> >> Cheers, >> Dirk >> >> On 29/07/14 14:46, manish payasi wrote: >>> How to create xml file dynamically in java and store into BaseX database >>> 'db'. That means it shouldn't not be created into my disk(my system) but >> it >>> should be directly created(store) into database 'db' ????? >>> >>> Please give me some better solution. >>> >> >> -- >> Dirk Kirsten, BaseX GmbH, http://basex.org >> |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz >> |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: >> | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle >> `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22 >> > -- Dirk Kirsten, BaseX GmbH, http://basex.org |-- Firmensitz: Blarerstrasse 56, 78462 Konstanz |-- Registergericht Freiburg, HRB: 708285, Geschäftsführer: | Dr. Christian Grün, Dr. Alexander Holupirek, Michael Seiferle `-- Phone: 0049 7531 28 28 676, Fax: 0049 7531 20 05 22

1 0

How to create xml file dynamically and store into database directly without storing into my disk?
by manish payasi 29 Jul '14

29 Jul '14

How to create xml file dynamically in java and store into BaseX database 'db'. That means it shouldn't not be created into my disk(my system) but it should be directly created(store) into database 'db' ????? Please give me some better solution.

2 1

How to store dynamically created xml file in basex through java
by manish payasi 25 Jul '14

25 Jul '14

Hi guys, I am new in base x and i got some problem so i would like to ask some questions because i didn't get the solution from anywhere and someone recommended me to raise the questions here. I know the way to create the xml file and store into disk after that we can store these xml files into basex database 'db' after went through official BaseX tutorial . I have attached my two class file through which i am creating and storing xml file into BaseX database,but it's not a feasible solution. So my question is: *How to create xml file dynamically and store into database directly rather than storing into my disk?????* Please revert back to me as soon as possible. Second question i'll ask in another mail. Thanks and Regards manish payasi

2 1

How to optimize "insertion intensive" usage patterns
by Marco Lettere 25 Jul '14

25 Jul '14

Hello all, for the first time I encountered a scenario which runs according to an "insertion intensive" pattern. A lot of documents are stored into a database at a rather fast pace. With the computing resources I currently have, the process slows down rather quickly since indexes (created with the "create index" command) got invalidated immediately. I moved to the UPDINDEX option and this alleviated the slowing down but made my "small" system run quickly into disk space issues since the data files grow at a much higher rate (5.8 GB after one day of continuous work). I can fix this by running the optimize all command. I was not very comfortable with this command so I stopped everything and made a cold run. The result was surprisingly good. The amount of disk space got reduced to 1% of the size it had before the optimize and it also took a small amount of time compared to the dimension of the input data. My first question is whether running optimize command regularly (maybe every hour or so) without stopping the flow of incoming documents is a safe way to go or whether it will impede somehow the workload or introduce any risks on data integrity. Secondly, to improve the workload on a single database (thus reducing the frequency of optimize calls), I was planning to split my data moving less important data to a different database (but same server). Will this be an effective solution in this scenario? Sorry for the possibly naive questions but I'm really not a very expert in this quantitative aspects. Thanks and regards, Marco.

2 4

RESTXQ / xml-stylesheet
by Fabrice Etanchaud 23 Jul '14

23 Jul '14

Dear all, Could you please telle me how I could add a xml-stylesheet processing instruction to a restxq function ? Best regards, Fabrice Questel/Orbit

2 1

flush the pending list
by Marc 23 Jul '14

23 Jul '14

Hi, I have a XQuery who does a lot of insertion in documents in the same collection, but on by one. In an other point of vue, I have a collection that I modify and others collections that I read. We the pending update list, all the modifications stays in memory before to be write and in my case that's a lot of memory. Is there a way to flush the pending update list because I know that there is no reverse action on it. Without this I do one query for each updated collection documents. Marc

2 2

client module
by Fabrice Etanchaud 22 Jul '14

22 Jul '14

Dear all, The client:query function seems to systematically trim text nodes For example, xml ingested with chop = false will be chopped when retrieved with client:query(). The client:execute function is ok. Best regards, Fabrice Questel/Orbit

2 3

Optimize Exception
by Marco Lettere 22 Jul '14

22 Jul '14

Hi all, unfortunately during a nightly backup + optimize procedure the VM on which we run an "older" 7.7.2 basex server went out of disk space. This morning I've been able to recover partially. I've been able to take a backup and to recreate the indexes with the "create index *" command. Now the system is operating again and clients are inserting data. The automated procedure is based however on the use of the optimize command which is the only thing that has not restarted to work yielding ArrayIndexOutOfBound Exception. Will it be necessary (sufficient?) to reinstall a fresh version and reimport the backup or is there another way out? Thanks a lot for any hints. M.

2 5

Re: [basex-talk] update expression
by Ioannis Kavvouras 22 Jul '14

22 Jul '14

Hello, I've tried to use the update expression (http://docs.basex.org/wiki/Updates#update) in basex releases after 7.8, but it always throws the exception: --- code --- - XQJQS001 - Invalid XQuery syntax, syntax does not pass static validation. - Root Cause: - net.xqj.basex.bin.bx: Encountered " <QNameToken> "update "" -------------- I try to run the simple xquery: for $ft in /server return $ft update delete node $ft/formal Regards Yannis PS: the copy expression cannot be used inside a for loop , is it?

2 1