zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-04 15:54:34 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

concatenation correction

Browse Source
This commit is contained in:
Nathan Ranchin
2024-09-10 22:05:03 +02:00
committed by Awni Hannun
parent 67a9325603
commit 92ba4b2bf5
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llms/mlx_lm/utils.py
View File

@@ -255,7 +255,7 @@ def generate_step(
else: else:
y, logprobs = sample(logits) y, logprobs = sample(logits)
tokens_ids = mx.concat(tokens_ids, y, dim=0) tokens_ids = mx.concat([tokens_ids, y], axis=0)
if repetition_context_size: if repetition_context_size:
if len(repetition_context) > repetition_context_size: if len(repetition_context) > repetition_context_size: