zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-19 11:28:07 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
524 Commits 10 Branches 0 Tags
782f5a71b787381a843b91375a67c286ced6013a
Commit Graph

4 Commits

Author SHA1 Message Date
Awni Hannun
782f5a71b7 reorg + fixes to caching, unify prompt caching across types and use cases for e.g. caching during a chat 2024-10-05 14:49:39 -07:00
Angelos Katharopoulos
324184d670 Fix the cache_prompt (#979) 2024-09-06 20:19:27 -07:00
Awni Hannun
b1186e2a81 Docs on prompt scaling (#963) 
* docs on prompt scaling

* remove unused var

* nits
 2024-08-29 15:05:17 -07:00
Angelos Katharopoulos
1003a8b2dd Add the ability to load the KV cache from a file (#956) 2024-08-28 22:11:45 -07:00