mlx-examples/llms/mlx_lm/README.md
2024-11-29 14:51:23 +01:00

12 lines
509 B
Markdown

## Generate Text with MLX and :hugs: Hugging Face
This an example of large language model text generation that can pull models from
the Hugging Face Hub.
For more information on this example, see the [README](../README.md) in the
parent directory.
This package also supports fine tuning with LoRA or QLoRA. For more information
see the [LoRA documentation](LORA.md).
🆕 You can directly convert models in Q4/ Q8 via the Hugging Face Space [here](https://huggingface.co/spaces/mlx-community/mlx-my-repo).