Files
mlx-examples/llms/mlx_lm
Chime Ogbuji f2619f507c Add support for fewshot and apply chat template lm_eval functionality (#1180)
* Add support for multiturn fewshot examples and chat templates

Added two new arguments to the evaluation script: `--fewshot-as-multiturn` and `--apply-chat-template` which correspond to lm_eval options of similar names and are very often used to ensure apples-to-apples comparisons of lm_evaluation results

* Add HF overrides for methods needed by added options

* don't add duplicate bos

---------

Co-authored-by: Awni Hannun <awni@apple.com>
2025-01-06 07:58:43 -08:00
..
2024-12-12 13:13:50 -08:00
2024-10-22 09:56:45 -07:00
2024-09-29 17:12:47 -07:00
2024-09-20 13:33:45 -07:00
2024-01-23 08:44:37 -08:00
2024-10-31 08:17:14 -07:00
2024-01-12 10:25:56 -08:00

Generate Text with MLX and 🤗 Hugging Face

This an example of large language model text generation that can pull models from the Hugging Face Hub.

For more information on this example, see the README in the parent directory.

This package also supports fine tuning with LoRA or QLoRA. For more information see the LoRA documentation.