[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage#685

Merged

XilunWu merged 22 commits intomainfrom gh/XilunWu/12/head

Dec 11, 2024

+23-40

Commits on Dec 4, 2024

Update base for Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update base for Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update base for Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update base for Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed
Update on "[cp] apply fsdp to model when CP is enabled without DP for correct loss and lower mem usage"
XilunWu
committed

Commits on Dec 5, 2024