zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-08-30 02:53:41 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

LoRA: update tools datasets docs

Browse Source
This commit is contained in:
madroid 2024-10-23 01:29:45 +08:00
parent 66e7bcb886
commit b36625aa6d
1 changed files with 7 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
llms/mlx_lm/LORA.md
View File

@ -222,6 +222,13 @@ data formats. Here are examples of these formats:
}
```
The format for defining the `arguments` field in a function can vary depending on the model being used. Common formats include JSON strings and dictionaries.
The example provided follows the format used by [OpenAI](https://platform.openai.com/docs/guides/fine-tuning/fine-tuning-examples), which is also adopted by MistralAI [mistral-finetune](https://github.com/mistralai/mistral-finetune?tab=readme-ov-file#instruct).
However, in Hugging Face's [chat_template](https://huggingface.co/docs/transformers/main/en/chat_templating#a-complete-tool-use-example), a dictionary format is used.
The choice of format should depend on the base model you are fine-tuning. It is recommended to refer to the documentation of the base model for detailed instructions regarding this aspect.
</details>
`completions`: