2 Commits

Author	SHA1	Message	Date
nathan	0866e23a67	repetiton_penalty and logits_bias just using logits_processors (#1004) ... * refactor of repetition_penalty and logits_bias to use logits_processor * nits --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-09-30 08:49:03 -07:00
nathan	ace2bb5890	Add logits_processor option to generate_step function (#983) ... * Add logits_processor option for the generation as in huggingface transformers library * concatenation correction * Rename the tokens variable for clarity * remove the logit_bias argument from generate_step method * fix the variable name * nits + test * test * add back logit bias + test --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-09-28 10:08:49 -07:00