Revisit Launcher
for starting multiple experiments
#1121
Labels
enhancement
Feature that is not a new algorithm or an algorithm enhancement
experiment-eval
Issues about evaluation: plots, stats, multiprocessing etc.
minor
Requires small changes to be fixed
I couldn't make it work on ubuntu (loky fails with pickling error, multiprocessing fails with
daemonic process can't have children
), and it generally is of limited use to start experiments in parallel on a single machine, unless there are a lot of CPUs.The one thing that might work and actually make sense is a ray launcher. We could also borrow a launcher from hydra, though it might be cumbersome.
An LLM with coding abilities can likely implement a ray based launcher almost out of the box
The text was updated successfully, but these errors were encountered: