[sharding optim] Optim check finite#55766

Merged

FeixLiu merged 1 commit intoPaddlePaddle:developfrom FeixLiu:optim_check_finite

Aug 1, 2023

+164-17

Commits on Jul 31, 2023

Fix sharding comm overlap with check finite bug.
FeixLiu
committed