zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-24 09:21:18 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
b8a348c1b8
mlx-examples/llms/speculative_decoding/requirements.txt

4 lines
30 B
Plaintext
Raw Normal View History

Switch to fast RMS/LN Norm (#603) * use nn.RMSNorm, use sdpa, cleanup * bump mlx versions * minor update * use fast layer norm * version bump * update requirement for whisper * update requirement for gguf
2024-03-23 22:13:51 +08:00
mlx>=0.8.0
add speculative decoding example for llama (#149) * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>
2023-12-29 07:20:43 +08:00
transformers
numpy
Reference in New Issue Copy Permalink