mirror of
				https://github.com/ml-explore/mlx-examples.git
				synced 2025-10-31 10:58:07 +08:00 
			
		
		
		
	Add support for fewshot and apply chat template lm_eval functionality (#1180)
* Add support for multiturn fewshot examples and chat templates Added two new arguments to the evaluation script: `--fewshot-as-multiturn` and `--apply-chat-template` which correspond to lm_eval options of similar names and are very often used to ensure apples-to-apples comparisons of lm_evaluation results * Add HF overrides for methods needed by added options * don't add duplicate bos --------- Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
		| @@ -32,7 +32,7 @@ jobs: | ||||
|             pip install --upgrade pip | ||||
|             pip install unittest-xml-reporting | ||||
|             cd llms/ | ||||
|             pip install -e ".[testing]" | ||||
|             pip install -e ".[test]" | ||||
|       - run: | ||||
|           name: Run Python tests | ||||
|           command: | | ||||
|   | ||||
		Reference in New Issue
	
	Block a user
	 Chime Ogbuji
					Chime Ogbuji