You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With buffered streams, when running python scripts users won't be seeing realtime logs in neuro logs. Starting python interpreter as python -u or setting PYTHONUNBUFFERED=1 will make log streams nearly realtime.
I suggest setting PYTHONUNBUFFERED=1 in Dockerfile to make it a default for every python interpreter run assuming that the users are not gonna pay attention and run their training scripts with python -u
The text was updated successfully, but these errors were encountered:
the users are not gonna pay attention and run their training scripts with python -u
We have a problem with non-real-time logs right now, which this change gonna fix. It might slow down the train process, but we'll see and solve this problem later.
With buffered streams, when running python scripts users won't be seeing realtime logs in
neuro logs
. Starting python interpreter aspython -u
or settingPYTHONUNBUFFERED=1
will make log streams nearly realtime.I suggest setting
PYTHONUNBUFFERED=1
in Dockerfile to make it a default for every python interpreter run assuming that the users are not gonna pay attention and run their training scripts withpython -u
The text was updated successfully, but these errors were encountered: