mlx-examples/llms/mlx_lm/examples/merge_config.yaml

models: 
  - OpenPipe/mistral-ft-optimized-1218
  - mlabonne/NeuralHermes-2.5-Mistral-7B
method: slerp
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
Support for slerp merging models (#455) * support for slerp merging models * docs * update docs * format' 2024-02-20 12:37:15 +08:00			`models:`
			`- OpenPipe/mistral-ft-optimized-1218`
			`- mlabonne/NeuralHermes-2.5-Mistral-7B`
			`method: slerp`
			`parameters:`
			`t:`
			`- filter: self_attn`
			`value: [0, 0.5, 0.3, 0.7, 1]`
			`- filter: mlp`
			`value: [1, 0.5, 0.7, 0.3, 0]`
			`- value: 0.5`