Prince Canuma dfa4dd6c93 Add support for cohere2 (#1157) ... * add support for cohere2 * revert to act_fn to silu * fix tests and sliding window attention * add tests * add to tuner * fix sliding window * add coauthor :) Co-authored-by: n8programs <43304488+N8python@users.noreply.github.com> * Add rotating kvcache to save space * some nits * style * nits --------- Co-authored-by: n8programs <43304488+N8python@users.noreply.github.com> Co-authored-by: N8 <n8@n8programs.com> Co-authored-by: Awni Hannun <awni@apple.com>		2024-12-16 08:01:03 -08:00
..
__init__.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
datasets.py	LoRA: Support HuggingFace dataset via data parameter (#996)	2024-09-30 07:36:21 -07:00
dora.py	Feature: QDoRA (#891)	2024-09-30 08:01:11 -07:00
lora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
trainer.py	[MLX LM] Sampler refactor + a few improvements (#1094)	2024-11-07 16:15:24 -08:00
utils.py	Add support for cohere2 (#1157)	2024-12-16 08:01:03 -08:00