From b36625aa6dd9158f89c5b14448dd2f8aed3838f1 Mon Sep 17 00:00:00 2001 From: madroid Date: Wed, 23 Oct 2024 01:29:45 +0800 Subject: [PATCH] LoRA: update tools datasets docs --- llms/mlx_lm/LORA.md | 7 +++++++ 1 file changed, 7 insertions(+) diff --git a/llms/mlx_lm/LORA.md b/llms/mlx_lm/LORA.md index 2d0dcf60..32c7c607 100644 --- a/llms/mlx_lm/LORA.md +++ b/llms/mlx_lm/LORA.md @@ -222,6 +222,13 @@ data formats. Here are examples of these formats: } ``` + +The format for defining the `arguments` field in a function can vary depending on the model being used. Common formats include JSON strings and dictionaries. +The example provided follows the format used by [OpenAI](https://platform.openai.com/docs/guides/fine-tuning/fine-tuning-examples), which is also adopted by MistralAI [mistral-finetune](https://github.com/mistralai/mistral-finetune?tab=readme-ov-file#instruct). +However, in Hugging Face's [chat_template](https://huggingface.co/docs/transformers/main/en/chat_templating#a-complete-tool-use-example), a dictionary format is used. + +The choice of format should depend on the base model you are fine-tuning. It is recommended to refer to the documentation of the base model for detailed instructions regarding this aspect. + `completions`: