Having indexes is a must, so, without disabling it, will the memory requirements grow liniar with the data size? Or does it work in batches, as I can understand from "will write to disk if memory is too low"? This would qualify for constant memory for my purpose :) The idea is, if files get 10x bigger, will I need to put in -Xmx10G? Or will the 1G still be enough?

On Nov 4, 2017 19:50, "Christian Grün" <christian.gruen@gmail.com> wrote:

Hi Dinu,

> So, to make an architectural decision, can you tell me if CREATE DB is
> running in quasi-constant space?

If you create new databases, it’s mostly the indexing of texts and
attributes that requires additional memory. Memory usage is not
constant, but the standard value indexes will automatically write
temporary data structures to disk if your memory gets low. If you
disable the text and attribute index, you can build initial databases
from input up to 500 GB [1].

Cheers,
Christian

[1] http://docs.basex.org/wiki/Statistics