5 Commits

Author	SHA1	Message	Date
Awni Hannun	b8a348c1b8	Switch to fast RMS/LN Norm (#603) ... * use nn.RMSNorm, use sdpa, cleanup * bump mlx versions * minor update * use fast layer norm * version bump * update requirement for whisper * update requirement for gguf	2024-03-23 07:13:51 -07:00
Awni Hannun	7cdd1b69ac	Enable unit testing in Circle and start some MLX LM tests (#545) ... * add a few tests for mlx lm * add a few tests for mlx lm * add a few tests for mlx lm * more tests / cleanup	2024-03-07 09:31:57 -08:00
Awni Hannun	f24edfa9dc	[mlx-lm] Add precompiled normalizations (#451) ... * add precompiled normalizations * nits	2024-02-22 12:40:55 -08:00
Awni Hannun	d4666615bb	Lazy import + refactor Lora layer addition (#426) ... * lazy model import in mlx_lm * change lora loading * fix olmo lora * remove a bunch of unused stuff from plamo * move phixtral to mlx-lm and out of llms/	2024-02-12 10:51:02 -08:00
Anchen	30be4c4734	refactor(qwen): moving qwen into mlx-lm (#312) ... * refactor(qwen): moving qwen into mlx-lm * chore: update doc * chore: fix type hint * add qwen model support in convert * chore: fix doc * chore: only load model in quantize_model * chore: make the convert script only copy tokenizer files instead of load it and save * chore: update docstring * chore: remove unnecessary try catch * chore: clean up for tokenizer and update transformers 4.37 * nits in README --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-22 15:00:07 -08:00