Gökdeniz Gülmez 56d2db23e1 adding OLMoE architecture (#1321) ... * initial commit * udpate ACKNOWLEDGMENTS.md * adding olmoe to training * clean up * faster generation * remove sanitize method * more clean ups * adding SwitchGLU * clean up * a little faster and adding norm_topk_prob * formated		2025-03-05 13:46:06 -08:00
..
__init__.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
datasets.py	Completion only fine-tuning of instruction models with collections of HF datasets (#1103)	2025-02-09 20:12:34 -08:00
dora.py	Feature: QDoRA (#891)	2024-09-30 08:01:11 -07:00
lora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
trainer.py	fix lora timings after validation (#1278)	2025-02-11 16:48:55 -08:00
utils.py	adding OLMoE architecture (#1321)	2025-03-05 13:46:06 -08:00