zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-27 03:05:20 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #10 from ricardo-larosa/fix-unsupported-scalartype

Browse Source 
Fix unsupported ScalarType BFloat16
This commit is contained in:
Awni Hannun 2023-12-07 08:05:44 -08:00 committed by GitHub
commit 62dcb3301f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
llama/README.md
View File

@ -32,7 +32,7 @@ Once you've converted the weights to MLX format, you can interact with the
LLaMA model:
```
python llama.py mlx_llama.npz tokenizer.model "hello"
python llama.py mlx_llama_weights.npz <path_to_tokenizer.model> "hello"
```
Run `python llama.py --help` for more details.

7
llama/convert.py
View File

@ -32,7 +32,12 @@ def map_torch_to_mlx(key, value):
elif "rope" in key:
return None, None
return key, value.numpy()
return (
key,
value.numpy()
if value.dtype != torch.bfloat16
else value.to(torch.float32).numpy(),
)
if __name__ == "__main__":