cleanup conversion to use single qkv matrix

This commit is contained in:
Awni Hannun
2023-12-14 09:19:44 -08:00
parent 0c1c500714
commit 8f60d60814
5 changed files with 11 additions and 57 deletions

View File

@@ -1,7 +1,7 @@
# Phi-2
Phi-2 is a 2.7B parameter language model released by Microsoft[^1] with
performance that rivals much larger models. It was trained on a mixture of
Phi-2 is a 2.7B parameter language model released by Microsoft with
performance that rivals much larger models.[^1] It was trained on a mixture of
GPT-4 outputs and clean web text.
Phi-2 efficiently runs on Apple silicon devices with 8GB of memory in 16-bit