zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 12:49:50 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
Files
a8da484c8b7dc73a17ba9598355c220d6d3611b8
mlx-examples/llms/speculative_decoding/requirements.txt

4 lines
30 B
Plaintext
Raw Normal View History

Switch to fast RMS/LN Norm (#603) * use nn.RMSNorm, use sdpa, cleanup * bump mlx versions * minor update * use fast layer norm * version bump * update requirement for whisper * update requirement for gguf
2024-03-23 07:13:51 -07:00
mlx>=0.8.0
add speculative decoding example for llama (#149) * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-28 17:20:43 -06:00
transformers
numpy
Reference in New Issue Copy Permalink