Gökdeniz Gülmez 56d2db23e1 adding OLMoE architecture (#1321) ...

* initial commit

* udpate ACKNOWLEDGMENTS.md

* adding olmoe to training

* clean up

* faster generation

* remove sanitize method

* more clean ups

* adding SwitchGLU

* clean up

* a little faster and adding norm_topk_prob

* formated

2025-03-05 13:46:06 -08:00

..

__init__.py

LoRA: Extract small function (#614)

2024-06-02 06:38:42 -07:00

datasets.py

Completion only fine-tuning of instruction models with collections of HF datasets (#1103)

2025-02-09 20:12:34 -08:00

dora.py

Feature: QDoRA (#891)

2024-09-30 08:01:11 -07:00

lora.py

Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)

2024-08-16 07:38:36 -07:00

trainer.py

fix lora timings after validation (#1278)

2025-02-11 16:48:55 -08:00

utils.py

adding OLMoE architecture (#1321)

2025-03-05 13:46:06 -08:00