Re: [basex-talk] file:read-text-lines performance

Wow, thanks for your fast response! I will give it a try tonight,

George.

On 1/15/19 1:48 PM, Christian Grün wrote:

Hi George,

I’m glad to announce that files are now processed in an iterative manner [1,2]. That’s something I wanted to try a while ago, and your mail was another motivation to get it done.

It works pretty fine: I reduced the JVM memory to a tiny maximum of 4mb, and I managed to count the line numbers of a file with several gigabytes:

count(file:read-text-lines('huge.txt'))

I’d be interested to hear if your code runs faster with the latest snapshot. Christian

[1] http://files.basex.org/releases/latest/ [2] https://github.com/BaseXdb/basex/commit/cfb7a7965de85139ec9595a6e79a45d873da...