zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-08-28 15:08:37 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update documentation

Browse Source
This commit is contained in:
Chime Ogbuji 2024-11-10 10:10:04 -05:00 committed by Awni Hannun
parent 3f08dfc762
commit 5ce58e4b6a
1 changed files with 3 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
llms/mlx_lm/LORA.md
View File

@ -77,9 +77,9 @@ You can resume fine-tuning with an existing adapter with
`--resume-adapter-file <path_to_adapters.safetensors>`. `--resume-adapter-file <path_to_adapters.safetensors>`.
### Input Masking ### Input Masking
There are custom functions for masking the input sequence of tokens during the loss calculation to ensure There are custom functions for masking the sequence of tokens associated with the `prompt` in a completion dataset
the model is not being penalized for not recreating the prompt. To fine-tune with masked input sequences, during the loss calculation to ensure the model is not being penalized for not recreating the prompt. To fine-tune
use the `--mask-inputs` argument. with masked input sequences, use the `--mask-inputs` argument.
### Evaluate ### Evaluate