zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 04:14:38 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

chore(mlx-lm): fix the number of validation batches configuration. (#752)

Browse Source 
* chore: fix number of validation batches

* clean up

* address comment
This commit is contained in:
Anchen
2024-05-04 23:52:42 +10:00
committed by GitHub
parent 2bf11c4633
commit f30413b63c
2 changed files with 85 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

7
llms/mlx_lm/tuner/trainer.py
View File

@@ -137,8 +137,11 @@ def evaluate(
):
all_losses = []
ntokens = 0
for it, batch in zip(
range(num_batches),
index_iterator = iter(range(num_batches)) if num_batches != -1 else iter(int, 1)
for _, batch in zip(
index_iterator,
iterate_batches(
dataset=dataset,
tokenizer=tokenizer,