Hello dear BaseX Team,
I would like to load a big number of small documents in Basex. What I do is to use a little Java program:
Context ctx = new Context(); new CreateDB("basex1").execute(ctx); new CreateIndex("fulltext").execute(ctx); System.err.println("\n* Show database information:"); System.err.print(new InfoDB().execute(ctx));
for( ... ) { new Add(somedata, miname, collection).execute(ctx); }
I dont know if it is correct , efficient ? Do you have a notion of transaction, like begin/commit ? ( I did not see something like that)
My concern is that it seems not to behave well when the number of documents goes big: (each doc is about 2500 bytes)
10000 => 54 seconds ; 5.4 millis / document 20000 => 202 s ; 10 ms 50000 => 862 s ; 17.2 ms
And in fact I want to store more than 1 million!
Actually is there a limit in size ? Is 1 million x 2.5Kb OK?
Thank you very much Tomaso