mlx-examples/llms/mlx_lm/tuner
Prince Canuma c012eb173f
Add support for OpenELM (#719)
* add openELM

* update splitting logic

* update qkv logic and, transformer and MLP block

* code formatting and fix args

* fix array slicing and remove unused var :)

* add to tuner

* use mx.split for slicing qkv

* merge with phi3

* remove rope scaling logic

* code formatting
2024-04-25 16:49:28 -07:00
..
__init__.py feat: move lora into mlx-lm (#337) 2024-01-23 08:44:37 -08:00
datasets.py Support for OpenAI’s fine-tuning dataset format (#548) 2024-03-19 16:45:46 -07:00
lora.py cast around lora adapters (#613) 2024-03-24 19:34:51 -07:00
trainer.py Quantize embedding / Update quantize API (#680) 2024-04-18 18:16:10 -07:00
utils.py Add support for OpenELM (#719) 2024-04-25 16:49:28 -07:00