Fixes for training models with bf16 + freshly initialized optimizer via load_module_only#4141
Merged
loadams merged 8 commits intodeepspeedai:masterfrom haileyschoelkopf:new-fixJan 18, 2024
+6-4
Commits
Commits on Aug 9, 2023
- committed
- committed
Commits on Aug 13, 2023
- committed
haileyschoelkopf
