mirror of
https://github.com/ml-explore/mlx-examples.git
synced 2025-09-01 04:14:38 +08:00
mlx_lm: Add Streaming Capability to Generate Function (#807)
* Add streaming feature to text generation function * separate stream and regular functions --------- Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
@@ -149,10 +149,10 @@ def main():
|
||||
model,
|
||||
tokenizer,
|
||||
prompt,
|
||||
args.temp,
|
||||
args.max_tokens,
|
||||
True,
|
||||
verbose=True,
|
||||
formatter=formatter,
|
||||
temp=args.temp,
|
||||
top_p=args.top_p,
|
||||
)
|
||||
|
||||
|
||||
Reference in New Issue
Block a user