Gökdeniz Gülmez 50e5ca81a8 Adding full finetuning (#903) ... * Adding full model weights finetuning * Updating the LORA.md and ACKNOWLEDGMENTS.md files. * removing --use-dora and --fulll-training and adding --fine-tune-type * some clean up * reformating and fixing dora training * updated CONFIG_DEFAULTS * update config example * update in the config example fie * Update LORA.md * merge and commit * adding argument for dora linear layer * clean up * clean up in the example yaml file * fix * final fix before sending * small addition to re md file * fix for loading the fully trained model by saving all the files and configs correctly * clean up * removing the unnesesairy files * changing lora layers back to 16 * removed max file size * nits * resolve merge * some consistency changes --------- Co-authored-by: Awni Hannun <awni@apple.com>		2024-09-29 17:12:47 -07:00
..
__init__.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
datasets.py	LoRA: support tools(function calling) format datasets (#995)	2024-09-28 10:41:36 -07:00
dora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
lora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
trainer.py	Adding full finetuning (#903)	2024-09-29 17:12:47 -07:00
utils.py	Adding full finetuning (#903)	2024-09-29 17:12:47 -07:00