556 Commits

Author	SHA1	Message	Date
Franck Verrot	7df3f792a2	Ensure Conv2D and Conv3D's kernel sizes aren't trimmed (#1852) ... Before the change, this snippet: ``` print(nn.Conv1d(1, 32, 3, padding=1)) print(nn.Conv2d(1, 32, (3, 3), padding=1)) print(nn.Conv3d(1, 32, (3, 3, 3), padding=1)) ``` would output: ``` Conv1d(1, 32, kernel_size=3, stride=1, padding=1, dilation=1, groups=1, bias=True) Conv2d(1, 32, kernel_size=(3,), stride=(1, 1), padding=(1, 1), dilation=1, groups=1, bias=True) Conv3d(1, 32, kernel_size=(3, 3), stride=(1, 1, 1), padding=(1, 1, 1), dilation=1, bias=True) ``` After the change, the output will be: ``` Conv1d(1, 32, kernel_size=3, stride=1, padding=1, dilation=1, groups=1, bias=True) Conv2d(1, 32, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1), dilation=1, groups=1, bias=True) Conv3d(1, 32, kernel_size=(3, 3, 3), stride=(1, 1, 1), padding=(1, 1, 1), dilation=1, bias=True) ```	2025-02-10 06:27:01 -08:00
Angelos Katharopoulos	9eb7d7362f	Fix Split::vmap (#1845)	2025-02-08 09:22:13 -08:00
Awni Hannun	1c0c118f7c	Fp64 on the CPU (#1843) ... * add fp64 data type * clean build * update docs * fix bug	2025-02-07 15:52:22 -08:00
Awni Hannun	83a0340fa7	allow command (#1836)	2025-02-06 10:32:24 -08:00
Awni Hannun	af1b725fda	Fix a couple of slicing bugs (#1827) ... * fix a few bugs * fix conv grad * speedup test * comment	2025-02-05 19:50:08 -08:00
Awni Hannun	9174606d4c	fix sort (#1835)	2025-02-05 17:16:27 -08:00
Awni Hannun	ca305afdbe	loading empty list is ok when strict = false (#1834)	2025-02-05 16:19:27 -08:00
Awni Hannun	ec7c7def40	no line buffer for mpi jobs (#1825)	2025-02-03 12:02:15 -08:00
Angelos Katharopoulos	f5cc1eea72	Allow different value dimensions in sdpa_vector (#1811)	2025-01-31 20:58:59 -08:00
Awni Hannun	b7c9f1d38f	scatter axis + gather axis primitives (#1813) ... * scatter axis + gather axis primitives * add transforms * comment	2025-01-31 20:48:08 -08:00
Angelos Katharopoulos	ded914f442	Small distributed launch helper (#1810)	2025-01-29 17:55:04 -08:00
Awni Hannun	4758c8baa1	Start to cleanup/unify accelerate and common back-ends (Part 1/N) (#1777) ... * start to cleanup/unify accelerate and common back-ends * more progress * simplify * add half type and allow infs in simd exp * unify softmax + quantized, more dispatches to simd quantized mm * add sin/cos, use simd in vector-scalar ops * faster CPU vectorize quant * faster erf/erfinv	2025-01-29 14:34:49 -08:00
Awni Hannun	1017ac4a9e	add dilation for conv 3d layers + test for 3d conv w/ dilation (#1802)	2025-01-28 06:17:07 -08:00
Angelos Katharopoulos	ccb61d7aae	Ring distributed backend (#1784)	2025-01-27 22:15:01 -08:00
Awni Hannun	2235dee906	catch stream errors earlier to avoid aborts (#1801)	2025-01-27 14:05:43 -08:00
Awni Hannun	28091aa1ff	allow build python lib without specifying path (#1799)	2025-01-27 11:22:35 -08:00
Awni Hannun	121d9a0702	Fix rope fallback to not upcast (#1797) ... * fix rope fallback to not upcast * Update mlx/fast.cpp Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com> --------- Co-authored-by: Angelos Katharopoulos <a_katharopoulos@apple.com>	2025-01-26 19:07:21 -08:00
Nick	0cea88bcc5	Use @ matrix multiplication syntax to document matrix-matrix multiplication (#1793) ... Co-authored-by: Nick Thompson <nicholas_a_thompson@apple.com>	2025-01-25 16:02:36 -08:00
Angelos Katharopoulos	72146fc4cd	Einsum ellipsis (#1788)	2025-01-25 01:28:03 -08:00
Awni Hannun	e6a7ab9675	non square qr (#1783)	2025-01-21 14:07:47 -08:00
Awni Hannun	90532b1f37	recompile when shapeless is different (#1776)	2025-01-20 21:07:10 -08:00
Awni Hannun	0c259961ac	matmul jvps (#1772)	2025-01-17 10:36:26 -08:00
Awni Hannun	33421c1dd3	Limit grad recursion depth by not recursing through non-grad inputs (#1764) ... * limit grad recursion depth * add grad of module test	2025-01-14 14:33:18 -08:00
Nripesh Niketan	5cc5201914	feat: Add orthogonal initializer and corresponding tests (#1651) ... * feat: Add orthogonal initializer and corresponding tests * lint * Add acknowledgements * nits --------- Co-authored-by: Awni Hannun <awni@apple.com>	2025-01-13 07:29:20 -08:00
wrmsr	a4a2764a52	Fix broadcast_arrays python sig (#1763)	2025-01-10 12:33:26 -08:00
Awni Hannun	657f466402	use sdpa and exportable functions in transformer multi head attention (#1760)	2025-01-09 13:11:55 -08:00
Alex Barron	c7b0300af5	Fix batched qmv bug (#1758)	2025-01-09 11:45:57 -08:00
Awni Hannun	1ccaf80575	Dynamic broadcasting for shapeless compile/export (#1722) ... * working towards dynamic broadcast * shapeless broadcast * fix build + nits * use broadcast arrays in quantize matmul * some cleanup / consistency * mend * some comments * add vjp, jvp for broadcast axes	2025-01-09 11:04:24 -08:00
Awni Hannun	d1766f2c70	Add boolean mask support in vector SDPA (#1757)	2025-01-07 20:24:53 -08:00
Awni Hannun	516ded618b	Dynamic slicing (#1741) ... * dynamic slice and slice update * python bindings + tests + fix set item * fix compile issue * comment * fix jit	2025-01-07 14:02:16 -08:00
Awni Hannun	d5ec172c95	Allow boolean mask in sdpa (#1753) ... * allow boolean mask in sdpa * more permissive donation in ternary	2025-01-06 16:57:07 -08:00
Angelos Katharopoulos	25b3a3e541	Optionally specify names for arrays when exporting (#1749)	2025-01-06 13:07:46 -08:00
Awni Hannun	058d6ce683	mpi send use input as output (#1750) ... * mpi send use input as output * move earlier	2025-01-06 06:08:43 -08:00
Angelos Katharopoulos	eab93985b8	Update custom function docs (#1748)	2025-01-03 16:35:25 -08:00
Awni Hannun	259025100e	Fix nd ternary on GPU (#1746)	2025-01-03 11:52:17 -08:00
Awni Hannun	c9d30aa6ac	MLX in C++ example (#1736) ... * MLX in C++ example * nits * fix docs	2025-01-02 19:09:04 -08:00
Angelos Katharopoulos	8544b42007	Add namespace (#1745)	2025-01-02 16:49:23 -08:00
Awni Hannun	6fa0501387	Fix concatenate/slice_update vjp + reduce binary size (#1735) ... * fix concatenate vjp + reduce binary size * also cast in slice update	2025-01-02 16:36:33 -08:00
Awni Hannun	ae69cb15e9	shapeless compile in docs and partially shapeless reshape (#1742)	2025-01-02 16:24:42 -08:00
Venkata Naga Aditya Datta Chivukula	491fa95b1f	Added Kronecker Product (#1728)	2025-01-02 16:00:34 -08:00
Awni Hannun	4ba0c24a8f	Export / import functions to / from a file (#1642) ... * export and import functions * refactor + works for few primitives * nit * allow primitives with state * nit * nit * simplify serialize / deserialize * fix for constants * python bindings * maybe fix serialize failure case * add example * more primitives, training kind of works * same result for python and c++ * some fixes * fix export * template it up * some simplificatoin * rebase * allow kwargs and multiple functions * exporter * more primitives for exporting * deal with endianness * handle invalid stream * add docstring	2024-12-24 11:19:13 -08:00
Awni Hannun	ebfe64b92d	shapeless slice update and broadcast when possible (#1727)	2024-12-23 11:25:15 -08:00
Awni Hannun	0308e9af71	Allow offset to be an mx.array for mx.fast.rope (#1724) ... * allow offset for rope * comment	2024-12-19 15:51:44 -08:00
Awni Hannun	c3628eea49	Add mx.finfo and use it when making causal mask (#1726) ... * finfo * fixes * docs	2024-12-19 14:52:41 -08:00
Awni Hannun	e03f0372b1	More shape type (#1705) ... * more shape type * fix	2024-12-19 08:08:20 -08:00
Awni Hannun	7480059306	track resource limit and throw if exceeded (#1718)	2024-12-18 18:45:58 -08:00
Awni Hannun	f110357aaa	Bump nanobind to 2.4 + fix (#1710) ... * bump nanobind to 2.4 + fix * fix	2024-12-17 10:57:54 -08:00
Tomohiro Oga	a6b426422e	add cubic to type hinting for upsample (#1709)	2024-12-17 07:30:23 -08:00
Awni Hannun	d03c01dfbc	fix unflatten vjp (#1708)	2024-12-16 18:37:57 -08:00
Cheng	af5a614aad	Eval before cleanup so model file is unlocked (#1702)	2024-12-14 21:41:49 -08:00