Nripesh Niketan
f1ef378a58
Feat: update pre-commit rev ( #432 )
2024-02-11 07:23:27 -08:00
Anchen
0a49ba0697
fix(mlx-lm): apply lora layer doesn't update the lora weights ( #396 )
2024-01-31 11:51:26 -08:00
Anchen
614de6652f
chore(mlx-lm): add reset lora layers helper ( #377 )
...
* chore(mlx-lm): add reset lora layers helper
* chore: rename the func
* chore: update docstring
* Update llms/mlx_lm/tuner/utils.py
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
---------
Co-authored-by: Awni Hannun <awni.hannun@gmail.com >
2024-01-29 20:54:49 -08:00
Anchen
854ad8747a
feat(mlx-lm): add de-quant for fuse.py ( #365 )
...
* feat(mlx-lm): add de-quant for fuse
* chore: disable quant in to linear when de-quant enabled
* chore: add better error handling for adapter file not found
2024-01-25 18:59:32 -08:00
Anchen
f51e98fcf1
chore(mlx-lm): truncate the input sentence to max seq len in lora iterate_batches ( #373 )
...
* chore(mlx-lm): pass max seq len to evaluate in training loop
* chore: make sure the batch seq not exceed max len
* chore: update comment
* chore: add warning before truncate input
2024-01-25 12:38:04 -08:00
Anchen
b1dec281b3
feat(mlx-lm): add lora hypeparameters in lora layer ( #366 )
...
* feat(mlx-lm): add lora hypeparameters in lora layer
* chore: address comments
2024-01-24 08:11:25 -08:00
Anchen
ab91ac1075
chore(mlx-lm): add load model with adapter and fix bug in sample ( #360 )
...
* chore: add load model with adapter support and fix bug in sample
* chore: ignore temp during calculating prob in sample
2024-01-23 19:47:39 -08:00
Anchen
362e88a744
feat: move lora into mlx-lm ( #337 )
...
* feat: Add lora and qlora training to mlx-lm
---------
Co-authored-by: Awni Hannun <awni@apple.com >
2024-01-23 08:44:37 -08:00
