When trying to create a database from a folder of approximately 5000 collections (each containing between 200 and 500 files) the processed stopped after two hours with an error something like this:
Line too long for a single database {filename} and {line number}.
The file itself looks ok, with a single tag in the referenced position. What is the recommended procedure from here?
All the best Lars G Johnsen National Library of Norway
Hi Lars,
Line too long for a single database {filename} and {line number}.
I guess it was "Input is too large for a single database"?
In this case, the recommended procedure is to create multiple databases for your collections, which can then be queried by a single XQuery expression. You could even think about creating an own database for each collection, but the optimal trade off in your scenario is probably 5-10 databases. It could also be up to 100, depending on the size of your input data. – How big (gb/tb) is your total XML input?
Best, Christian ____________________________________
The file itself looks ok, with a single tag in the referenced position. What is the recommended procedure from here?
All the best Lars G Johnsen National Library of Norway
BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
basex-talk@mailman.uni-konstanz.de
-
Christian Grün -
Lars Johnsen