Commit Graph

5 Commits

Author SHA1 Message Date
Vaibhav Srivastav
3c64f1a1dc Add config.json to Mixtral. (#158)
* Add config.json to Mixtral.

* Update mixtral/mixtral.py

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>

---------

Co-authored-by: Pedro Cuenca <pedro@huggingface.co>
2023-12-20 09:47:23 -08:00
Awni Hannun
001b5803ce fix RoPE bug + minor updates 2023-12-14 21:45:25 -08:00
Awni Hannun
449f7a694b use official HF for mixtral 2023-12-14 15:30:32 -08:00
Awni Hannun
86b0c6d91d mixtral runs a bit faster 2023-12-12 08:36:40 -08:00
Awni Hannun
8fe8fb13f1 initial mixtral 2023-12-12 07:44:23 -08:00