zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-27 11:21:32 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #10 from ricardo-larosa/fix-unsupported-scalartype

Browse Source 
Fix unsupported ScalarType BFloat16
This commit is contained in:
Awni Hannun 2023-12-07 08:05:44 -08:00 committed by GitHub
commit 62dcb3301f
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
2 changed files with 7 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
llama/README.md
View File

@ -32,7 +32,7 @@ Once you've converted the weights to MLX format, you can interact with the
LLaMA model: LLaMA model:
``` ```
python llama.py mlx_llama.npz tokenizer.model "hello" python llama.py mlx_llama_weights.npz <path_to_tokenizer.model> "hello"
``` ```
Run `python llama.py --help` for more details. Run `python llama.py --help` for more details.

7
llama/convert.py
View File

@ -32,7 +32,12 @@ def map_torch_to_mlx(key, value):
elif "rope" in key: elif "rope" in key:
return None, None return None, None
return key, value.numpy() return (
key,
value.numpy()
if value.dtype != torch.bfloat16
else value.to(torch.float32).numpy(),
)
if __name__ == "__main__": if __name__ == "__main__":