chore(clip): update the clip example to make it compatible with HF format (#472)

* chore(clip): update the clip model to be HF format

* Update clip/convert.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* chore: address comments

* chore: rename ClipVisionModel and ClipTextModel

* chore: add output hidden_states support

* chore: remove custom conv2d and apply weight transpose during weight sanitizing

* Update clip/model.py

* Update clip/model.py

---------

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>
This commit is contained in:
Anchen
2024-02-24 01:49:53 +11:00
committed by GitHub
parent f24edfa9dc
commit 47dd6bd17f
4 changed files with 267 additions and 104 deletions

View File

@@ -3,4 +3,4 @@ numpy
transformers
torch
huggingface_hub
Pillow
Pillow