zhangyiss/mlx
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx.git synced 2025-08-22 13:07:51 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Added 'i' to bilinear formula

Browse Source
This commit is contained in:
zorea 2023-12-31 20:50:41 +02:00
parent e1c12343b6
commit a951283561
1 changed files with 2 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
python/mlx/nn/layers/linear.py
View File

@ -77,11 +77,12 @@ class Bilinear(Module):
.. math:: .. math::
y = x_1^\top W x_2 + b y_i = x_1^\top W_i x_2 + b_i
where where
:math:`W` has shape ``[output_dims, input1_dims, input2_dims]``. :math:`W` has shape ``[output_dims, input1_dims, input2_dims]``.
:math:`b` has shape ``[output_dims, ]``. :math:`b` has shape ``[output_dims, ]``.
:math:`i` is the index for output dimensions.
The values are initialized from :math:`\mathcal{U}(-{k}, {k})`, where The values are initialized from :math:`\mathcal{U}(-{k}, {k})`, where
:math:`k = \frac{1}{\sqrt{input1\_dims}}`. :math:`k = \frac{1}{\sqrt{input1\_dims}}`.