mlx-examples/merge_config.yaml at distributed-layers - mlx-examples - Gitea for Geophysics

zhangyiss/mlx-examples

mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-25 01:41:19 +08:00

Awni Hannun 8fd953ee2b

Support for slerp merging models (#455 )

* support for slerp merging models

* docs

* update docs

* format'

2024-02-19 20:37:15 -08:00

12 lines

249 B

YAML

Raw Permalink Blame History

 models:
   - OpenPipe/mistral-ft-optimized-1218
   - mlabonne/NeuralHermes-2.5-Mistral-7B
 method: slerp
 parameters:
   t:
     - filter: self_attn
       value: [0, 0.5, 0.3, 0.7, 1]
     - filter: mlp
       value: [1, 0.5, 0.7, 0.3, 0]
     - value: 0.5