Chime Ogbuji f2619f507c Add support for fewshot and apply chat template lm_eval functionality (#1180) ... * Add support for multiturn fewshot examples and chat templates Added two new arguments to the evaluation script: `--fewshot-as-multiturn` and `--apply-chat-template` which correspond to lm_eval options of similar names and are very often used to ensure apples-to-apples comparisons of lm_evaluation results * Add HF overrides for methods needed by added options * don't add duplicate bos --------- Co-authored-by: Awni Hannun <awni@apple.com>		2025-01-06 07:58:43 -08:00
..
config.yml	Add support for fewshot and apply chat template lm_eval functionality (#1180)	2025-01-06 07:58:43 -08:00