Resources needed for training

[pjox]

Hello,

Could you give some information about the resources needed for training? For example in terms of number of GPUs and the amount of memory needed (VRAM and RAM).

I'd like to reproduce your work and specially train a new French model, so I'd like to have an idea of the resources I'll need.

Thank you for open-sourcing the code, and thank you in advance for your help!

Pedro.