support internlm2 (#797)

* support internlm2

* only attention projections

---------

Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
Chen Xin
2024-05-27 21:22:21 +08:00
committed by GitHub
parent ca7ce60c91
commit aac98ca6f4
5 changed files with 219 additions and 0 deletions

View File

@@ -12,6 +12,7 @@ LoRA (QLoRA).[^qlora] LoRA fine-tuning works with the following model families:
- Gemma
- OLMo
- MiniCPM
- InternLM2
## Contents