enable FSDP2 + fp8 all-gather and fix TP fp8 all-gather#413
Merged
weifengpy merged 24 commits intopytorch:mainfrom weifengpy:fsdp2Jul 16, 2024
+114-20
Commits
Commits on Jun 12, 2024
- committed
Commits on Jun 19, 2024
Commits on Jun 20, 2024
- committed
- committed
Commits on Jul 3, 2024
Commits on Jul 11, 2024
Commits on Jul 12, 2024
- committed
- committed
- committed
- committed
Commits on Jul 15, 2024
Commits on Jul 16, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed