Zai Thottakath 4e01700816 Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914) ... * feature: LoRA adapter for Embeddings * feature: wire in LoRAEmbedding into the tuner. Allow the embedding and non model.layers Linear layers to be targeted for fine tuning * feature: DoRA adapter for Embeddings * feature: wire in DoRAEmbedding * bugfix: ensure self.m is recalculated when the linear layer is changed in DoRALinear.from_linear * refactor: prefer from_base over from_linear or from_embedding. prefer fuse over to_linear or to_embedding * cleanup: remove unused imports in test_dora.py * refactor: remove unnecessary non_layer_modules * cleanup: remove wrong comments for lora embedding dropout. remove uncessary parens in dora embedding dropout * nits --------- Co-authored-by: Awni Hannun <awni@apple.com>		2024-08-16 07:38:36 -07:00
..
__init__.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
datasets.py	Configuration-based use of HF hub-hosted datasets for training (#701)	2024-06-26 10:20:50 -07:00
dora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
lora.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00
trainer.py	Add eos token to lora fine-tunes (#818)	2024-06-12 07:44:21 -07:00
utils.py	Allow the entire model to be targed for LoRA and DoRA fine tuning: LoRA and DoRA embeddings with small DoRALinear bug fix (#914)	2024-08-16 07:38:36 -07:00