Commit Graph

7 Commits

Author SHA1 Message Date
Awni Hannun
08e862336a
Rope theta to support Coda Llama (#121)
* rope theta for llama model

* llama chat/code

* nit
2023-12-15 19:51:51 -08:00
Sam Coward
877f88dfea Pass along temp argument to generate() 2023-12-15 15:16:41 -05:00
devonthomas35
d74d9453dd
Refactor EOS check 2023-12-14 21:11:23 -08:00
devonthomas35
d7d7aabded
Remove unnecessary return 2023-12-14 15:52:22 -08:00
devonthomas35
4549dcbbd0
Stop generating at eos token 2023-12-14 15:50:59 -08:00
Awni Hannun
8f60d60814 cleanup conversion to use single qkv matrix 2023-12-14 09:19:44 -08:00
Awni Hannun
3d2a23184a change file name for consistency, update readme. 2023-12-14 08:34:24 -08:00