Skip to content

redco-v0.4.21

Compare
Choose a tag to compare
@tanyuqian tanyuqian released this 19 Aug 16:37
· 21 commits to master since this release
  • Accelerated Inference for multi-host, purely data parallel case
  • Added optional argument train_step_fn in Trainer for fully customizing every training step, e.g., per-sample gradient noising for data-private training.
  • Slight argument name change in Deployer.get_lr_schedule_fn(): warmup_rate -> warmup_ratio