mlx/python/mlx
Asaf Zorea 295ce9db09
Feature expand nn linear (#315)
* Added an identity and bilinear layers
Added a reset_parameters option
Added normal init for bias

* pre-commit run

* add type hints for parameters and the return type
change Bilinear math to x_1 and x_2
change __call__ arguments to x and y instead of input and output
add explanation to the Initialization

* Remove unnecessary reshape

* Added 'i' to bilinear formula

* Changed bilinear computation to two matrix multiplications

* avoid saving intermediate results, kept y in bilinear for better clarity (can be replaced with x1)

* Changed math formula in Linear
Added more explanation to math formulas
Changed x1, x2 reshape to support all inputs sizes
2024-01-02 06:08:53 -08:00
..
nn Feature expand nn linear (#315) 2024-01-02 06:08:53 -08:00
_reprlib_fix.py copyright + ack 2023-11-30 11:12:53 -08:00
extension.py Add isort pre-commit and run (#68) 2023-12-08 11:31:47 -08:00
optimizers.py Spelling (#342) 2024-01-01 21:08:17 -08:00
utils.py Minor refactor for tree_map and tree_unflatten (#311) 2023-12-28 20:55:10 -08:00