Commit Graph

5 Commits

Author SHA1 Message Date
Vaibhav Srivastav
aed14618ca
Add config.json to Mixtral. (#158)
* Add config.json to Mixtral.

* Update mixtral/mixtral.py

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
2023-12-20 09:47:23 -08:00
Awni Hannun
ec11763527 fix RoPE bug + minor updates 2023-12-14 21:45:25 -08:00
Awni Hannun
078fed3d8d use official HF for mixtral 2023-12-14 15:30:32 -08:00
Awni Hannun
2ffd0da009 mixtral runs a bit faster 2023-12-12 08:36:40 -08:00
Awni Hannun
e42682dced initial mixtral 2023-12-12 07:44:23 -08:00