Rope theta to support Coda Llama (#121)

* rope theta for llama model

* llama chat/code

* nit
This commit is contained in:
Awni Hannun
2023-12-15 19:51:51 -08:00
committed by GitHub
parent 376b273b2f
commit 6ae68777aa
3 changed files with 32 additions and 4 deletions

View File

@@ -3,7 +3,8 @@
An example of generating text with Llama (1 or 2) using MLX.
Llama is a set of open source language models from Meta AI Research[^1][^2]
ranging from 7B to 70B parameters.
ranging from 7B to 70B parameters. This example also supports Llama Chat and
Code Llama.
### Setup