11 Commits

Author	SHA1	Message	Date
Awni Hannun	21623156a3	Reset peak memory (#1074) ... * reset peak memory * fix linux * nits in docs	2024-05-03 17:12:51 -07:00
Awni Hannun	b00ac960b4	change initial memory limits and add memory size to device info (#1064)	2024-05-03 06:50:15 -07:00
Awni Hannun	19bef39f5c	Add a mx.metal.device_info (#1060) ... * device inof * add variant * fix linux * fix doc	2024-04-30 15:47:27 -07:00
Awni Hannun	771575d27b	Expose function to clear memory cache (#1032) ... * expose function to clear memory cache * fix linux build * fix metal tests	2024-04-24 16:48:51 -07:00
Awni Hannun	3d405fb3b1	Add synchronize function (#1006) ... * add synchronize function * fix linux * fix linux * fix and fix docs * fix test * try synchronize in stream destroy * synchronize works for both cpu and gpu	2024-04-22 08:25:46 -07:00
Awni Hannun	aac2f9fb61	Improve profiling with gpu tracing (#969) ... * improve profiling with gpu tracing * fix for linux * nit * doc fix * fix example	2024-04-07 21:47:43 -07:00
Awni Hannun	9a8ee00246	Switch to nanobind (#839) ... * mostly builds * most tests pass * fix circle build * add back buffer protocol * includes * fix for py38 * limit to cpu device * include * fix stubs * move signatures for docs * stubgen + docs fix * doc for compiled function, comments	2024-03-18 20:12:25 -07:00
Awni Hannun	d5964a2710	bindings for memory info (#761) ... * bindings for memory info * update api * keep cache low if requested * fix default * nit in ops error	2024-03-01 19:51:58 -08:00
Ethan	a749a91c75	Support disable metal buffer cache to prevent performance degradation caused by large memory caching (#390) ... * support disable metal buffer cache, due to large unused memory buffered when llm generated long context tokens * Run format and add "cache_enabled" feature tests	2024-01-18 08:33:34 -08:00
Awni Hannun	46a39e5b1f	copyright + ack	2023-11-30 11:12:53 -08:00
Angelos Katharopoulos	d1f86272a2	angelos's commit files	2023-11-29 10:42:59 -08:00