zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-12-16 02:08:55 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
9960d47d1015bbd1587129bda26f4dd42398ccf1
mlx-examples/llms/tests/test_server.py
Awni Hannun 605c4854f1 Prompt caching in mlx_lm.server (#1026) 
* caching in server

* nits

* fix tests

* don't throw if no metal

* comments
2024-10-14 10:57:22 -07:00

3.5 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink