Skip to content

Commit

Permalink
Fix the typos of FusedRMSNorm doc
Browse files Browse the repository at this point in the history
  • Loading branch information
root authored and cqulilujia committed Dec 30, 2024
1 parent 73375b3 commit 17ca484
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions apex/normalization/fused_layer_norm.py
Original file line number Diff line number Diff line change
Expand Up @@ -745,8 +745,7 @@ class FusedLayerNorm(torch.nn.Module):
normalize over the last dimension which is expected to be of that specific size.
eps: a value added to the denominator for numerical stability. Default: 1e-5
elementwise_affine: a boolean value that when set to ``True``, this module
has learnable per-element affine parameters initialized to ones (for weights)
and zeros (for biases). Default: ``True``.
has learnable per-element affine parameters initialized to ones for weights. Default: ``True``.
Shape:
- Input: :math:`(N, *)`
Expand Down

0 comments on commit 17ca484

Please sign in to comment.