15 Commits

Author	SHA1	Message	Date
Anchen	1415595409	chore(lora): support mixtral in lora example (#343)	2024-01-20 06:07:45 -08:00
Yousif	7575125d5d	Added lora support for Phi-2 (#302) ... * Added lora support for Phi-2 * Added Phi-2 support in fuse and convert * format + readme --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-01-12 13:45:30 -08:00
Awni Hannun	7b258f33ac	Move lora example to use the same model format / conversion as hf_llm (#252) ... * huffing face the lora example to allow more models * fixes * comments * more readme nits * fusion + works better for qlora * nits' * comments	2024-01-09 11:14:52 -08:00
Awni Hannun	485fb9ac0f	quantize linear (#250)	2024-01-07 18:48:59 -08:00
mc0ps	25ebd36112	Fix typo in lora convert.py (#245)	2024-01-07 03:30:30 -08:00
Awni Hannun	37b41cec60	Qlora (#219) ... qlora	2024-01-04 21:05:59 -08:00
Awni Hannun	27c0a8c002	Add llms subdir + update README (#145) ... * add llms subdir + update README * nits * use same pre-commit as mlx * update readmes a bit * format	2023-12-20 10:22:25 -08:00
Awni Hannun	1e7f4a5921	fix use for llama 2 from meta (#144)	2023-12-18 19:33:17 -08:00
Awni Hannun	d108c558fc	more nits	2023-12-15 10:06:14 -08:00
Awni Hannun	a4d932bf26	fix conversion	2023-12-10 16:56:41 -08:00
Awni Hannun	98f4346c81	black format	2023-12-09 14:15:25 -08:00
Awni Hannun	b8332a1e66	generalize lora finetuning for llama and mistral	2023-12-09 14:13:55 -08:00
张嘉豪	4018aed335	fix: Unsupported BFloat16 Data Type Issue with MPS Backend	2023-12-08 16:19:35 +08:00
Awni Hannun	31bc57c4ff	add copyright in source	2023-11-30 11:08:53 -08:00
Awni Hannun	5d6353aab7	lora	2023-11-29 14:14:11 -08:00