This commit is contained in:
Vaibhav Srivastav 2023-12-20 18:15:20 +05:30
parent b6e62caf2e
commit ec15108bbe
3 changed files with 8 additions and 4 deletions

View File

@ -20,10 +20,8 @@ weights you will need to request access from Meta:
- [Request Llama v1](https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform) - [Request Llama v1](https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform)
- [Request Llama v2](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) - [Request Llama v2](https://ai.meta.com/resources/models-and-libraries/llama-downloads/)
> [!TIP]
Alternatively, you can also download a select converted checkpoints from the > Alternatively, you can also download a select converted checkpoints from the [mlx-community](https://huggingface.co/mlx-community) community organisation on Hugging Face and skip the conversion step.
[mlx-llama](https://huggingface.co/mlx-llama) community organisation on Hugging
Face and skip the conversion step.
You can download the TinyLlama models directly from [Hugging You can download the TinyLlama models directly from [Hugging
Face](https://huggingface.co/TinyLlama). Face](https://huggingface.co/TinyLlama).

View File

@ -28,6 +28,9 @@ python convert.py
The conversion script will save the converted weights in the same location. The conversion script will save the converted weights in the same location.
> [!TIP]
> Alternatively, you can also download a select converted checkpoints from the [mlx-community](https://huggingface.co/mlx-community) community organisation on Hugging Face and skip the conversion step.
### Run ### Run
Once you've converted the weights to MLX format, you can generate text with Once you've converted the weights to MLX format, you can generate text with

View File

@ -17,6 +17,9 @@ python convert.py
This will make the `weights.npz` file which MLX can read. This will make the `weights.npz` file which MLX can read.
> [!TIP]
> Alternatively, you can also download a select converted checkpoints from the [mlx-community](https://huggingface.co/mlx-community) community organisation on Hugging Face and skip the conversion step.
## Generate ## Generate
To generate text with the default prompt: To generate text with the default prompt: