zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-10-31 10:58:07 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #82 from ml-explore/llamav2

Browse Source 
llama v2 with sharded weights
This commit is contained in:
Awni Hannun
2023-12-12 17:08:24 -08:00
committed by GitHub
parent d3bd2e5d68 a99e9d551e
commit a614e951c4
9 changed files with 201 additions and 133 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
mixtral/README.md
View File

@@ -14,7 +14,7 @@ For example with Homebrew:
brew install git-lfs
```
Download the models from HuggingFace:
Download the models from Hugging Face:
```
git clone https://huggingface.co/someone13574/mixtral-8x7b-32kseqlen
@@ -46,7 +46,7 @@ rm mixtral-8x7b-32kseqlen/*.pth*
As easy as:
```
python mixtral.py --model_path mixtral mixtral-8x7b-32kseqlen/
python mixtral.py --model_path mixtral-8x7b-32kseqlen/
```
[^mixtral]: Refer to Mistral's [blog post](https://mistral.ai/news/mixtral-of-experts/) for more details.