Fix input validation to support passing device_mesh to FSDP
#9698
| Job | Run time |
|---|---|
| 5m 17s | |
| 5m 17s | |
| 5m 49s | |
| 5m 49s | |
| 4m 57s | |
| 4m 57s | |
| 5m 58s | |
| 5m 58s | |
| 1s | |
| 4m 41s | |
| 4m 36s | |
| 4m 36s | |
| 9m 0s | |
| 9m 0s | |
| 6m 35s | |
| 6m 35s | |
| 8m 51s | |
| 8m 51s | |
| 0s | |
| 0s | |
| 1h 46m 48s |