3 Commits

Author	SHA1	Message	Date
Ethan	a749a91c75	Support disable metal buffer cache to prevent performance degradation caused by large memory caching (#390) ... * support disable metal buffer cache, due to large unused memory buffered when llm generated long context tokens * Run format and add "cache_enabled" feature tests	2024-01-18 08:33:34 -08:00
Awni Hannun	46a39e5b1f	copyright + ack	2023-11-30 11:12:53 -08:00
Angelos Katharopoulos	d1f86272a2	angelos's commit files	2023-11-29 10:42:59 -08:00