zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 12:49:50 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

nits

Browse Source
This commit is contained in:
Awni Hannun
2023-12-05 11:24:30 -08:00
parent 40d4a53550
commit b9e2f317a0
2 changed files with 12 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

10
mistral/README.md
View File

@@ -12,7 +12,7 @@ Install the dependencies:
pip install -r requirements.txt
```
Next, download the model and tokenizer.
Next, download the model and tokenizer:
```
curl -O https://files.mistral-7b-v0-1.mistral.ai/mistral-7B-v0.1.tar
@@ -22,16 +22,16 @@ tar -xf mistral-7B-v0.1.tar
Then, convert the weights with:
```
python convert.py <path_to_torch_weights> mlx_mistral_weights.npz
python convert.py
```
### Run
Once you've converted the weights to MLX format, you can interact with the
Mistral model:
Once you've converted the weights to MLX format, you can generate text with
the Mistral model:
```
python mistral.py mlx_mistral.npz tokenizer.model "hello"
python mistral.py --prompt "It is a truth universally acknowledged," --temp 0
```
Run `python mistral.py --help` for more details.