zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 04:14:38 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

mixtral runs a bit faster

Browse Source
This commit is contained in:
Awni Hannun
2023-12-12 08:36:40 -08:00
parent e42682dced
commit 2ffd0da009
5 changed files with 24 additions and 47 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
mixtral/README.md
View File

@@ -33,12 +33,12 @@ Now from `mlx-exmaples/mixtral` conver the weights to NumPy so MLX can read them
python convert.py --model_path mixtral-8x7b-32kseqlen/
```
The conversion script will save the new weights in the same location.
The conversion script will save the converted weights in the same location.
After that's done, if you want to clean some stuff up:
```
rm mixtral-8x7b-32kseqlen/*.pth
rm mixtral-8x7b-32kseqlen/*.pth*
```
### Generate