Commit Graph

147 Commits

Author SHA1 Message Date
Gabrijel Boduljak
b5c2630104 resolved conflicts 2024-01-03 00:52:16 +01:00
Awni Hannun
673af67c92 complex for vector too 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
e87c2d4af3 fixed a bug with frobenius norm of a complex-valued matrix 2023-12-26 19:40:34 -08:00
Awni Hannun
67e319488c fix python tests 2023-12-26 19:40:34 -08:00
Awni Hannun
49e3e99da3 remove unused includes 2023-12-26 19:40:34 -08:00
Awni Hannun
f7cea9563d some style and API consistency updates to linalg norm 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
4bae4a8239 removed unused imports 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
bbfe042a2b fixed a bug with no ord and axis provided 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
5a184d5b5d more tests 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
f82ab0eec9 reused existing util for implementation of linalg.norm 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
145a4d143d refactored mlx.linalg.norm bindings 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
2831c77b33 added better docs and examples 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
49c48de53b handling inf, -inf as numpy does, more extensive tests of compatibility with numpy 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
26bb16e768 added some tests for python bindings 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
fa096d64a2 updated python bindings 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
b996d682d9 removed unused import in linalg.cpp 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
5d7a06717c added tests 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
8c43d820d9 completed the implementation of the norm 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
05203ecd78 renamed vector_norm to norm, implemented norm without provided ord 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
24da85025f implemented vector_norm python binding 2023-12-26 19:40:34 -08:00
Gabrijel Boduljak
cc9b2dc3c2 implemented vector_norm in cpp
added linalg to mlx
2023-12-26 19:40:34 -08:00
Angelos Katharopoulos
447bc089b9
Fix tolerance in de-/quantization test (#295) 2023-12-26 19:21:05 -08:00
Yutaka Kondo
fc4e5b476b
Fix llama link in README.md (#289) 2023-12-25 20:53:20 -08:00
Daniel Strobusch
d58ac083f3
expose itemsize and nbytes as for numpy arrays (#284)
see:
  * https://numpy.org/doc/stable/reference/generated/numpy.ndarray.nbytes.html
  * https://numpy.org/doc/stable/reference/generated/numpy.ndarray.itemsize.html

relates to https://github.com/ml-explore/mlx-examples/pull/174
2023-12-25 10:34:28 -08:00
__mo_san__
a123c3c7d2
implement-batch-norm-layer (#217)
- Add batch normalization layer

---------

Co-authored-by: Robert McCraith <mccraithrobert@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-25 07:32:53 -08:00
Angelos Katharopoulos
9e6b8c9f48
Refactor the reduction kernels (#277) 2023-12-24 14:47:57 -08:00
Zach Schillaci
22fee5a383
Remove redundant assert in losses.py (#281) 2023-12-24 08:39:08 -08:00
Daniel Strobusch
7365d142a3
random.uniform must respect dtype, even if lower precision than "low" (#280)
Fix an edge case where random uniform returns a float32 array, even if a lower precision dtype is wanted due to adding the float32 "low" array.
2023-12-24 07:04:43 -08:00
Awni Hannun
8b227fa9af
fix no metal build (#276) 2023-12-23 19:18:10 -08:00
Vidit Agarwal
8c3da54c7d
Fix failing test for log cosh loss (#275)
* fix assert statement in log_cosh_loss

* reformatted by pre-commit black
2023-12-23 16:26:46 -08:00
Vidit Agarwal
acf1721b98
Corrected the example of value_and_grad (#274)
* Corrected the example for mx.value_and_grad

* Reformat through pre-commit/black
2023-12-23 11:06:38 -08:00
Finn Voorhees
f91f450141
Fix argmax returns documentation (#263) 2023-12-22 20:33:17 -08:00
Ronan Collobert
cd3616a463
Revisit autorelease memory pools (#260)
* make general autorelease pool part of metal device

* make things simpler

* no metal backend support

* new_memory_pool -> new_scoped_memory_pool
2023-12-22 11:01:26 -08:00
Nicholas Santavas
d35fa1db41
Add Hinge, Huber and LogCosh losses (#199) 2023-12-22 10:28:10 -08:00
Justin Deschenaux
e8deca84e0
Add dropout2d (#250) 2023-12-22 08:02:29 -08:00
Angelos Katharopoulos
8385f93cea
Bumping the version (#256) 2023-12-21 18:33:14 -08:00
Awni Hannun
2118c3dbfa
fix (#255) 2023-12-21 18:18:41 -08:00
Awni Hannun
a002797d52
A temporary fix (#254) 2023-12-21 17:59:15 -08:00
Gabrijel Boduljak
a7447dfbc4
Merge branch 'main' into gboduljak-implement-instance-norm 2023-12-22 01:08:20 +01:00
Angelos Katharopoulos
1d053e0d1d
Fix the alibi test that was left unchanged (#252) 2023-12-21 14:59:25 -08:00
Hazem Essam
0aa65c7a6b
Added ALiBi implementation (#232) 2023-12-21 14:36:38 -08:00
Daniel Strobusch
794feb83df
support arange for bfloat16 (#245) 2023-12-21 14:33:43 -08:00
Angelos Katharopoulos
2c7df6795e
Make sure that arrays are freed when saving (#247) 2023-12-21 14:08:24 -08:00
Gabrijel Boduljak
6c7bebf428 implemented instancenorm 2023-12-21 19:29:08 +01:00
Angelos Katharopoulos
b3916cbf2b
Improve names of quantization arguments (#235)
* Change the default quantization group_size to 64
* Rename groups to group_size and width to bits
2023-12-20 16:53:53 -08:00
Angelos Katharopoulos
57fe918cf8
Adds C++ and nn quantization utilities (#230)
* Add C++ de-/quantize ops
* Add quantize functions to the docs and tests
* Add a QuantizedLinear module
2023-12-20 14:17:38 -08:00
Justin Deschenaux
4912ff3ec2
Add Lion optimizer (#209)
* Add Lion optimizer
* Update acknowledgements also with past contributions
2023-12-20 13:54:58 -08:00
Awni Hannun
f40d17047d
Indexing bug (#233)
* fix

* test
2023-12-20 10:44:01 -08:00
Angelos Katharopoulos
2807c6aff0
Implements divide for integer types and adds floor_divide op (#228)
* Add floor_divide
* Add floor_divide to the tests
* Add floor_divide to the docs
2023-12-19 20:12:19 -08:00
davidkoski
de892cb66c
fix for non-macos build issue on cblas.h (#227) 2023-12-19 17:01:59 -08:00