If you have indexing enabled, more temporary files will be written to disk. Memory usage won't be completely constant, but surely better than linear.
Am 04.11.2017 7:17 nachm. schrieb "Dinu Marina" dinumarina@gmail.com:
Having indexes is a must, so, without disabling it, will the memory requirements grow liniar with the data size? Or does it work in batches, as I can understand from "will write to disk if memory is too low"? This would qualify for constant memory for my purpose :) The idea is, if files get 10x bigger, will I need to put in -Xmx10G? Or will the 1G still be enough?
On Nov 4, 2017 19:50, "Christian Grün" christian.gruen@gmail.com wrote:
Hi Dinu,
So, to make an architectural decision, can you tell me if CREATE DB is running in quasi-constant space?
If you create new databases, it’s mostly the indexing of texts and attributes that requires additional memory. Memory usage is not constant, but the standard value indexes will automatically write temporary data structures to disk if your memory gets low. If you disable the text and attribute index, you can build initial databases from input up to 500 GB [1].
Cheers, Christian