I am running BaseX 8.1 on a Win7 machine with 8GB memory. I have a query that loads data from several CSV files, then generates a RDF/XML dump into a single, very large file (1370000 lines). When I run the query using the BaseX GUI, I get an "Out of Main Memory" error. I am able to get the query to complete via the command line, which is fine for the moment, but if the database gets larger, I'm anticipating that I won't be able to use it. An obvious solution would be to generate several smaller files, but the real problem is that BaseX doesn't seem to be utilizing all of the available memory. When I monitored memory utilization, it was only utilizing a small fraction of the available memory. I tried increasing the allocated memory by changing the BASEX_JVM=-Xmx512m to BASEX_JVM=-Xmx1024m line in the basex.bat and basexgui.bat files, but that didn't seem to have any effect - I still run out of memory and there is plenty of unused memory in the system. I must be missing something. Is there a simple change that I can make to make more memory available to BaseX?
For reference purposes, the query I'm running is at https://github.com/baskaufs/test/blob/master/image-all-hack.xq
Steve Baskauf