mirror of
https://github.com/ml-explore/mlx-examples.git
synced 2025-08-29 18:26:37 +08:00
5c89d1f6a6
Fixes #484 Add support for instruct tuning with input/output pairs and alternative loss functions. * **llms/mlx_lm/lora.py** - Add `CompletionsDataset` class to support input/output pairs. - Modify `Dataset` class to handle different dataset types. - Update `main` function to include new dataset type. * **llms/mlx_lm/tuner/trainer.py** - Modify `default_loss` function to support alternative loss functions. - Add new `instruct_loss` function for instruct tuning. * **llms/mlx_lm/LORA.md** - Add instructions for instruct tuning with input/output pairs. - Update documentation to include alternative loss functions. * **llms/tests/test_datasets.py** - Add tests for `CompletionsDataset` and `create_dataset` functions. * **llms/tests/test_trainer.py** - Add tests for `default_loss` and `instruct_loss` functions. --- For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/ml-explore/mlx-examples/issues/484?shareId=XXXX-XXXX-XXXX-XXXX). |
||
|---|---|---|
| .. | ||
| test_datasets.py | ||
| test_datsets.py | ||
| test_finetune.py | ||
| test_generate.py | ||
| test_gguf.py | ||
| test_models.py | ||
| test_prompt_cache.py | ||
| test_sample_utils.py | ||
| test_server.py | ||
| test_tokenizers.py | ||
| test_trainer.py | ||
| test_tuner_utils.py | ||
| test_utils_load_model.py | ||
| test_utils.py | ||