Chime Ogbuji df6bc09d74 Configuration-based use of HF hub-hosted datasets for training (#701) ... * Add hf_dataset configuration for using HF hub-hosted datasets for (Q)LoRA training * Pre-commit formatting * Fix YAML config example * Print DS info * Include name * Add hf_dataset parameter default * Remove TextHFDataset and CompletionsHFDataset and use Dataset and CompletionsDataset instead, adding a text_key constructor argument to the former (and changing it to work with a provided data structure instead of just from a JSON file), and prompt_key and completion_key arguments to the latter with defaults for backwards compatibility. * nits * update docs --------- Co-authored-by: Awni Hannun <awni@apple.com>		2024-06-26 10:20:50 -07:00
..
test_datsets.py	Configuration-based use of HF hub-hosted datasets for training (#701)	2024-06-26 10:20:50 -07:00
test_gguf.py	fix(mlx-lm): type hints in gguf.py (#621)	2024-03-26 07:56:01 -07:00
test_lora.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
test_models.py	GPT2 Support (#798)	2024-06-02 16:33:20 -07:00
test_sample_utils.py	fix(mlx-lm): type hints in gguf.py (#621)	2024-03-26 07:56:01 -07:00
test_server.py	fix(mlx-lm): broken server.py (#690)	2024-04-18 14:26:18 -07:00
test_tuner_utils.py	LoRA: Extract small function (#614)	2024-06-02 06:38:42 -07:00
test_utils.py	LoRA on all linear transformer block layers (#546)	2024-03-12 07:37:40 -07:00