diff --git a/llms/mlx_lm/LORA.md b/llms/mlx_lm/LORA.md index 2d0dcf60..32c7c607 100644 --- a/llms/mlx_lm/LORA.md +++ b/llms/mlx_lm/LORA.md @@ -222,6 +222,13 @@ data formats. Here are examples of these formats: } ``` + +The format for defining the `arguments` field in a function can vary depending on the model being used. Common formats include JSON strings and dictionaries. +The example provided follows the format used by [OpenAI](https://platform.openai.com/docs/guides/fine-tuning/fine-tuning-examples), which is also adopted by MistralAI [mistral-finetune](https://github.com/mistralai/mistral-finetune?tab=readme-ov-file#instruct). +However, in Hugging Face's [chat_template](https://huggingface.co/docs/transformers/main/en/chat_templating#a-complete-tool-use-example), a dictionary format is used. + +The choice of format should depend on the base model you are fine-tuning. It is recommended to refer to the documentation of the base model for detailed instructions regarding this aspect. + `completions`: