5 Commits

Author	SHA1	Message	Date
Matt Clayton	3d677f0870	Add "from_draft" to GenerationResponse (#1272) ... * Add from_draft field in GenerationResponse * Cleanup * Re-work for minimal changes, add test * Fix comment	2025-02-11 15:41:02 -08:00
Awni Hannun	0f135396ae	Generation refactor: part 2 (#1099) ... * unify with stream_generate * fixes * nit * some cleanup, warnings, tests * fix test + faster min p + test * version	2024-11-23 11:47:06 -08:00
Awni Hannun	657b4cc0aa	[MLX LM] Sampler refactor + a few improvements (#1094) ... * starting * refactor sampler/processor and a few improvements * fix stream * fix stream generate * fix eos handling in stream generate	2024-11-07 16:15:24 -08:00
nathan	0866e23a67	repetiton_penalty and logits_bias just using logits_processors (#1004) ... * refactor of repetition_penalty and logits_bias to use logits_processor * nits --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-09-30 08:49:03 -07:00
nathan	ace2bb5890	Add logits_processor option to generate_step function (#983) ... * Add logits_processor option for the generation as in huggingface transformers library * concatenation correction * Rename the tokens variable for clarity * remove the logit_bias argument from generate_step method * fix the variable name * nits + test * test * add back logit bias + test --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-09-28 10:08:49 -07:00