4 Commits

Author	SHA1	Message	Date
Angelos Katharopoulos	796d5e40e4	Fix export to gguf (#993)	2024-09-20 13:33:45 -07:00
Awni Hannun	33905447f9	Whisper updates to allow HF models (#923) ... * simplify conversion and update convert for HF models * use npz for compat * fixes * fixes * fix gguf * allow user supplied path	2024-08-09 11:11:58 -07:00
Anchen	297a908e3d	fix(mlx-lm): type hints in gguf.py (#621)	2024-03-26 07:56:01 -07:00
Anchen	fe96ef342f	feat(mlx-lm): export the GGUF (fp16) format model weights from fuse.py (#555) ... * wip * wip * feat: convert mlx model to gguf f16 * chore: conver norm layer to float32 to avoid overflow issue * chore: add support for mixtral * chore: clean up * chore: remove unused import statement * chore: clean up weight name mapping * version and readme * actual version bump --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-03-21 10:34:11 -07:00