Hi Christopher,
Am I correct in assuming I have hit a dreaded limit of BaseX when I see the output below? Which I presume may be the node limit (2,147,483,648) . . ?
true, it looks as if you have just reached the node limit. Usually, it won’t be reached that early, but as the maximum size always depends on the structure of the input documents, it’s difficult to say what’s a "common" file size limit.
I am dealing with 689,701 Files in 814,855 Folders which amounts to 5.32 GB on disk. (I am running BaseX 7.7)
Did you really have less files than directories? However, it doesn’t really matter, because empty directories are ignored anyway.
If so, then are then any automated ways of having BaseX automatically start feeding to a second instance?
If the structures of your input data are rather homogeneous, I would recommend to work with a maximum number of files, and create the next db if the limit is reached.
Regarding the possible chance to distribute things, I’ll give you a second answer in private!
Christian