zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-12-16 02:08:55 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
e74889d0fa0fb49d95bfdf6a1dcad907713eb50e
mlx-examples/llms/speculative_decoding/requirements.txt

4 lines
30 B
Plaintext
Raw Normal View History

add speculative decoding example for llama (#149) * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-28 17:20:43 -06:00
mlx>=0.0.6
transformers
numpy
Reference in New Issue Copy Permalink