Ethan a749a91c75 Support disable metal buffer cache to prevent performance degradation caused by large memory caching (#390) ...

* support disable metal buffer cache, due to large unused memory buffered when llm generated long context tokens

* Run format and add "cache_enabled" feature tests

2024-01-18 08:33:34 -08:00

..

mlx

Add Gaussian NLL loss function (#477)

2024-01-18 06:44:44 -08:00

src

Support disable metal buffer cache to prevent performance degradation caused by large memory caching (#390)

2024-01-18 08:33:34 -08:00

tests

Added formatter structure and a boolean value formatter (#354)

2024-01-18 07:49:41 -08:00