mirror of
https://github.com/ml-explore/mlx-examples.git
synced 2025-09-01 04:14:38 +08:00
Update README.md
This commit is contained in:
@@ -1,11 +1,3 @@
|
||||
# This repo features changes to MLX_LM.
|
||||
Specfically main changes are from line 318 in utils.py; I kind of shoe-horned in the same kv-cache saving system as cache_prompt.py.
|
||||
|
||||
Then had to change generate.py to take --save-kv-cache as an argument which was just a matter of changing the response handling on line 232 of generate.py.
|
||||
|
||||
Messy, but seems to work!
|
||||
|
||||
|
||||
# MLX Examples
|
||||
|
||||
This repo contains a variety of standalone examples using the [MLX
|
||||
|
Reference in New Issue
Block a user