zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-25 18:07:28 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #116 from idoru/fix-phi-2-temp-arg

Browse Source 
phi-2: fix --temp/--seed arguments.
This commit is contained in:
Awni Hannun 2023-12-15 12:29:19 -08:00 committed by GitHub
commit 86cae9ba57
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
phi2/phi2.py
View File

@ -201,7 +201,7 @@ if __name__ == "__main__":
print(args.prompt, end="", flush=True) print(args.prompt, end="", flush=True)
tokens = [] tokens = []
for token, _ in zip(generate(prompt, model), range(args.max_tokens)): for token, _ in zip(generate(prompt, model, args.temp), range(args.max_tokens)):
tokens.append(token) tokens.append(token)
if (len(tokens) % 10) == 0: if (len(tokens) % 10) == 0: