Hi<div>This topic was mentioned few times before, but it is key aspect of my application, so I will try anyway.</div><div><br></div><div><b>Question</b>: </div><div>What is recommended approach for application, where exists multiple document producers which shall store/modify documents in one, share collection.</div>
<div><br></div><div><b>Background</b></div><div><ul><li>Having <b>feeds</b>, which might deliver some new messages.</li><li><b>Multiple preprocessing processes</b> - preprocessing the messages before storing them in collection (Python, celery and RabbitMQ to be ready for processing bigger amount of incoming messages in parallel)</li>
<li>Having <b>single process for write access to my BaseX collection</b> (arranging this is not very easy for me so far)</li><li>There are some read only queries for stored messages, there are no problems with this as it shall be easy to run multiple read-only queries concurrently.</li>
</ul></div><div><b>Assumptions</b></div><div>If I am wrong here, please, correct me.</div><div><ul><li>one collection can be written/modified only by one process at given moment, other attempts to write are rejected and these attempts will fail.<br>
In other words - one collection can be opened only by one process (or are multiple opening clients allowed as long as the do not modify database concurrently?)</li><li>read only queries are easy as they can be run concurrently without blocking/rejecting</li>
</ul><div><b>Current approach</b></div><div><ol><li>Multiple preprocessing processes are concurrently sending documents into single basex-storage queue in RabbitMQ</li><li>There is single one-process worker, consuming documents from queue basex-storage which does all the work with adding documents for given collection.</li>
</ol><div><br></div><div><b>Wishes</b></div></div><div><div>Managing single write process adds quite complexity to whole solution.</div></div><div>It would be nice, if I can write to single collection by multiple processes at once and could expect success.</div>
<div><br></div><div>Any comments are welcome</div><div><br></div><div>Best regards</div><div><br></div><div>Jan</div>
</div>