zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-26 00:58:11 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
21aa8038fb8048c7981a27f7c1aea2800e34132c
mlx-examples/llms/speculative_decoding/requirements.txt

4 lines
30 B
Plaintext
Raw Normal View History

add speculative decoding example for llama (#149) * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-28 17:20:43 -06:00
mlx>=0.0.6
transformers
numpy
Reference in New Issue Copy Permalink