7 Commits

Author	SHA1	Message	Date
Awni Hannun	6ae68777aa	Rope theta to support Coda Llama (#121) ... * rope theta for llama model * llama chat/code * nit	2023-12-15 19:51:51 -08:00
Sam Coward	a5bacfd04f	Pass along temp argument to generate()	2023-12-15 15:16:41 -05:00
devonthomas35	f6ac70c736	Refactor EOS check	2023-12-14 21:11:23 -08:00
devonthomas35	7f992db5bc	Remove unnecessary return	2023-12-14 15:52:22 -08:00
devonthomas35	8d496ba61a	Stop generating at eos token	2023-12-14 15:50:59 -08:00
Awni Hannun	fa9e34b041	cleanup conversion to use single qkv matrix	2023-12-14 09:19:44 -08:00
Awni Hannun	c2eb435697	change file name for consistency, update readme.	2023-12-14 08:34:24 -08:00