2 Commits

Author	SHA1	Message	Date
Awni Hannun	a5d6d0436c	Support Hugging Face models (#215) ... * support hf direct models	2024-01-03 15:13:26 -08:00
Benjamin Anderson	09566c7257	add speculative decoding example for llama (#149) ... * speculative decoding * add sample 0 * spec decode gives same results as regular decode * rebase * use accept reject criteria * switch to t5 * update readme * readme nit * nits * nits * nits --------- Co-authored-by: Benjamin Anderson <benjamin@Benjamins-MBP.lan> Co-authored-by: Awni Hannun <awni@apple.com>	2023-12-28 15:20:43 -08:00