Skip to content

Improve communication overlapping in FP8 distributed optimizer#8221

Merged
timmoon10 merged 14 commits intoNVIDIA:mainfrom timmoon10:distopt-fp8-perf-optimFeb 8, 2024

Commits

Commits on Jan 18, 2024

Commits on Jan 19, 2024

Commits on Jan 22, 2024

Commits on Feb 8, 2024