zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-08-21 12:06:42 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update normalization.py

Browse Source
This commit is contained in:
__mo_san__ 2023-12-18 23:49:52 +01:00 committed by m0saan
parent 2b617b63bd
commit ad53687ae7
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
python/mlx/nn/layers/normalization.py
View File

@ -99,7 +99,7 @@ class GroupNorm(Module):
where :math:`\gamma` and :math:`\beta` are learned per feature dimension where :math:`\gamma` and :math:`\beta` are learned per feature dimension
parameters initialized at 1 and 0 respectively. However, the mean and parameters initialized at 1 and 0 respectively. However, the mean and
variance are computed over the spatial dimensions and each group of variance are computed over the spatial dimensions and each group of
features. In particular, the input is split into num_groups accross the features. In particular, the input is split into num_groups across the
feature dimension. feature dimension.
The feature dimension is assumed to be the last dimension and the dimensions The feature dimension is assumed to be the last dimension and the dimensions