zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 12:49:50 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

fix response + bump version (#319)

Browse Source
This commit is contained in:
Awni Hannun
2024-01-15 11:51:21 -08:00
committed by GitHub
parent 195bec2fa3
commit b0870ed679
2 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
llms/mlx_lm/utils.py
View File

@@ -133,9 +133,9 @@ def generate(
print(s[skip:], end="", flush=True)
skip = len(s)
tokens = tokenizer.decode(tokens)[skip:]
tokens = tokenizer.decode(tokens)
if verbose:
print(tokens, flush=True)
print(tokens[skip:], flush=True)
return tokens