support internlm2 (#797)

* support internlm2

* only attention projections

---------

Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
Chen Xin
2024-05-27 21:22:21 +08:00
committed by GitHub
parent ca7ce60c91
commit aac98ca6f4
5 changed files with 219 additions and 0 deletions

View File

@@ -120,6 +120,7 @@ Here are a few examples of Hugging Face models that work with this example:
- [pfnet/plamo-13b](https://huggingface.co/pfnet/plamo-13b)
- [pfnet/plamo-13b-instruct](https://huggingface.co/pfnet/plamo-13b-instruct)
- [stabilityai/stablelm-2-zephyr-1_6b](https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b)
- [internlm/internlm2-7b](https://huggingface.co/internlm/internlm2-7b)
Most
[Mistral](https://huggingface.co/models?library=transformers,safetensors&other=mistral&sort=trending),