4 Commits

Author	SHA1	Message	Date
Awni Hannun	9b83004631	Faster sampling with mx.compile (#937) ... * faster sampling with compile * fix test	2024-08-15 11:29:09 -07:00
Awni Hannun	9c5554d8ee	Use async eval (#670) ... * Use async eval * bump * bump * remove workaround for bfloat cumsum	2024-04-11 13:18:23 -07:00
Anchen	0ab01b4626	fix(mlx-lm): sorted probs in top_p implementation. (#610) ... * fix(mlx-lm): the top p imp * chore: address comment	2024-03-25 15:07:55 -07:00
Anchen	fbed720d6f	chore(mlx-lm): fix the top_p implementation. (#602) ... * chore(mlx-lm): clean up the top p imp * chore: clean up * chore: add test * chore: address comments * chore: clean up docs string * chore: clean up test	2024-03-21 12:18:23 -07:00