zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-09-01 04:14:38 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

chore(mlx-lm): add load model with adapter and fix bug in sample (#360)

Browse Source 
* chore: add load model with adapter support and fix bug in sample

* chore: ignore temp during calculating prob in sample
This commit is contained in:
Anchen
2024-01-23 19:47:39 -08:00
committed by GitHub
parent f5b80c95fb
commit ab91ac1075
2 changed files with 14 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
llms/mlx_lm/tuner/utils.py
View File

@@ -1,10 +1,11 @@
import mlx.core as mx
import mlx.nn as nn
from mlx.utils import tree_unflatten
from .lora import LoRALinear
def apply_lora_layers(model, adapter_file: str):
def apply_lora_layers(model: nn.Module, adapter_file: str) -> nn.Module:
adapters = list(mx.load(adapter_file).items())
linear_replacements = {}
lora_layers = set(