10 Commits

Author	SHA1	Message	Date
devonthomas35	4549dcbbd0	Stop generating at eos token	2023-12-14 15:50:59 -08:00
Fahad Nadeem	9b887cef08	minor dep fix in phi	2023-12-15 03:09:33 +05:00
Awni Hannun	8f60d60814	cleanup conversion to use single qkv matrix	2023-12-14 09:19:44 -08:00
Awni Hannun	0c1c500714	update readme	2023-12-14 08:37:34 -08:00
Awni Hannun	3d2a23184a	change file name for consistency, update readme.	2023-12-14 08:34:24 -08:00
Awni Hannun	840c0c36c2	don't drop last tokens	2023-12-14 08:27:44 -08:00
Awni Hannun	1613e608a9	fix args, update README, remove extra files	2023-12-14 08:18:01 -08:00
Awni Hannun	a8d4149147	fix fp16 + nits	2023-12-14 08:08:28 -08:00
Awni Hannun	88d7b67e6e	add cache + generation, clean up some stuff	2023-12-13 22:26:33 -08:00
Joe Barrow	a466cc5191	phi-2 draft	2023-12-13 22:23:38 -05:00