Hello,
We encountered Out Of Main Memory when trying to create archive of a 4GB XML file. I'm using version BaseX922.war. We allocated 20GB with -Xmx flag for tomcat. Please let me know if there is a way to overcome this issue.
let $files := file:list('/tmp', false(), '4gb.xml') let $zip := archive:create($files ! element archive:entry { . }, file:read-binary('/tmp/4gb.xml')) return file:write-binary('4gb.xml.zip', $zip)
Thanks, Paul
Hi Paul,
In the current version of BaseX, new archives cannot be streamed to files.
I think we could propagate the file output stream to archive:create and other functions. This could potentially be financed as sponsored feature. Does Boeing support open source projects?
Best, Christian
Han (US), Paul P Paul.P.Han@boeing.com schrieb am Sa., 25. Mai 2019, 00:10:
Hello,
We encountered Out Of Main Memory when trying to create archive of a 4GB XML file. I’m using version BaseX922.war. We allocated 20GB with –Xmx flag for tomcat. Please let me know if there is a way to overcome this issue.
let $files := file:list('/tmp', false(), '4gb.xml') let $zip := archive:create($files ! element archive:entry { .
}, file:read-binary('/tmp/4gb.xml'))
return file:write-binary('4gb.xml.zip', $zip)
Thanks,
Paul
Hello Christian,
I have raised your inquiry to management. They would like to get a sample agreement to sponsor a solution.
Fortunately we are able to use zip:zip-file function to overcome the current limitation of the archive:create function.
Regards, Paul
From: Christian Grün [mailto:christian.gruen@gmail.com] Sent: Monday, May 27, 2019 10:25 AM To: Han (US), Paul P Paul.P.Han@boeing.com Cc: BaseX basex-talk@mailman.uni-konstanz.de Subject: Re: [basex-talk] archive:create - Out Of Main Memory
Hi Paul,
In the current version of BaseX, new archives cannot be streamed to files.
I think we could propagate the file output stream to archive:create and other functions. This could potentially be financed as sponsored feature. Does Boeing support open source projects?
Best, Christian
Han (US), Paul P <Paul.P.Han@boeing.commailto:Paul.P.Han@boeing.com> schrieb am Sa., 25. Mai 2019, 00:10: Hello,
We encountered Out Of Main Memory when trying to create archive of a 4GB XML file. I’m using version BaseX922.war. We allocated 20GB with –Xmx flag for tomcat. Please let me know if there is a way to overcome this issue.
let $files := file:list('/tmp', false(), '4gb.xml') let $zip := archive:create($files ! element archive:entry { . }, file:read-binary('/tmp/4gb.xml')) return file:write-binary('4gb.xml.zip', $zip)
Thanks, Paul
basex-talk@mailman.uni-konstanz.de