Starcoder2: Update config and change GQA to use repeat (#520)

* update config

* change gqa to use repeat instead of concante

* contribution
This commit is contained in:
Prince Canuma
2024-03-03 15:12:03 +01:00
committed by GitHub
parent 1e3daea3bb
commit 3fdf85e79d
2 changed files with 7 additions and 17 deletions

View File

@@ -13,3 +13,4 @@ MLX Examples was developed with contributions from the following individuals:
- Gabrijel Boduljak: Implemented `CLIP`.
- Markus Enzweiler: Added the `cvae` examples.
- Rasmus Kinnunen: Fixed a security hole in the `llms/mlx_lm` example
- Prince Canuma: Helped add support for `Starcoder2` models.