zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-24 17:31:18 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

chore: fix loar for moe model (#608)

Browse Source
This commit is contained in:
Anchen 2024-03-24 01:22:11 +11:00 committed by GitHub
parent b8a348c1b8
commit 494cdf8e96
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 0 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
llms/mlx_lm/tuner/trainer.py
View File

@ -189,7 +189,6 @@ def train(
state = [model.state, optimizer.state] state = [model.state, optimizer.state]
@partial(mx.compile, inputs=state, outputs=state)
def step(batch): def step(batch):
# Forward and backward pass # Forward and backward pass
(lvalue, toks), grad = loss_value_and_grad(model, *batch) (lvalue, toks), grad = loss_value_and_grad(model, *batch)