mlx-examples/llms/mlx_lm/models
Chime Ogbuji f6283ef7ce
Configurable LR schedulers (#604)
* Initial config handler and test

* Added means to run from CLI

* Update lora config loading and tests

* Constrain scheduler config (warmup and minimum LR) for each kind

* Update reference to moved schedule_config module

* Minor fix

* Fix typos

* Moved build_schedule and tests

* nits in schedule config

* flake

* fix path

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2024-03-29 13:41:10 -07:00
..
__init__.py Mlx llm package (#301) 2024-01-12 10:25:56 -08:00
base.py Mlx llm package (#301) 2024-01-12 10:25:56 -08:00
cohere.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
dbrx.py DBRX (#628) 2024-03-28 21:03:53 -07:00
gemma.py Configurable LR schedulers (#604) 2024-03-29 13:41:10 -07:00
llama.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
mixtral.py DBRX (#628) 2024-03-28 21:03:53 -07:00
olmo.py Configurable LR schedulers (#604) 2024-03-29 13:41:10 -07:00
phi.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
phixtral.py DBRX (#628) 2024-03-28 21:03:53 -07:00
plamo.py Configurable LR schedulers (#604) 2024-03-29 13:41:10 -07:00
qwen2.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
qwen.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
stablelm.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00
starcoder2.py Switch to fast RMS/LN Norm (#603) 2024-03-23 07:13:51 -07:00