zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 04:14:38 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

mlx_lm: Add Streaming Capability to Generate Function (#807)

Browse Source 
* Add streaming feature to text generation function

* separate stream and regular functions

---------

Co-authored-by: Awni Hannun <awni@apple.com>
This commit is contained in:
Michał Kurc
2024-06-03 18:04:39 +02:00
committed by GitHub
parent 8353bbbf93
commit 43d6deb3c1
4 changed files with 89 additions and 37 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llms/mlx_lm/__init__.py
View File

@@ -1,4 +1,4 @@
# Copyright © 2023-2024 Apple Inc.
from .utils import convert, generate, load
from .utils import convert, generate, load, stream_generate
from .version import __version__