6 Commits

Author	SHA1	Message	Date
Awni Hannun	b8a348c1b8	Switch to fast RMS/LN Norm (#603) ... * use nn.RMSNorm, use sdpa, cleanup * bump mlx versions * minor update * use fast layer norm * version bump * update requirement for whisper * update requirement for gguf	2024-03-23 07:13:51 -07:00
Awni Hannun	7b258f33ac	Move lora example to use the same model format / conversion as hf_llm (#252) ... * huffing face the lora example to allow more models * fixes * comments * more readme nits * fusion + works better for qlora * nits' * comments	2024-01-09 11:14:52 -08:00
Lawrence Wu	37856f70a8	add numpy as a requirement to run lora.py (#238) ... * add numpy as a requirement to run lora.py * removed unused imports	2024-01-05 16:16:28 -08:00
Awni Hannun	37b41cec60	Qlora (#219) ... qlora	2024-01-04 21:05:59 -08:00
Awni Hannun	036090f508	few more nits	2023-12-09 14:20:19 -08:00
Awni Hannun	5d6353aab7	lora	2023-11-29 14:14:11 -08:00