Export of stats don't work when too big results

[pierrehenri-dauvergne]

Ofsep found another issue when requesting an export of statistics with lots of data, for instance with field :
Study to include : Cohorte Principale.|CISCO.|Cohorte VHD.*

Tested it on ofsep-prod, had the same result.
Tested with one specific study to include and it worked well.
Tested directly on ofsep-prod database and I received more than a million lines, >1Go in a file.

Is there a limit of the maximum size that we can request or write in a file for download (or maximum size of folder where the stats are stored) ? Do you know something about this @michaelkain ?

[michaelkain]

Hi @pierrehenri-dauvergne, I think it is important to fix this issue and it would be great if we could do so.
I wonder, why we have not tested it with ofsep data, as only they use this feature.
MS Dataset microservice triggers a stored procedure on the database via query.execute and the result list
is written into a buffer and stored as file on the disk. So, what is the exception, where is the problem? during the creation of the zip file? during the download? is it a memory issue? Looking forward to your solution and with kind regards, Michael