Awni Hannun d3f8e4aee9 Fix argpartition call in Mixtral and other MOES (#676) ...

* Update mixtral.py

* fix all moes

---------

Co-authored-by: yuhai-china <yuhai.china@gmail.com>

2024-04-12 11:00:56 -07:00

..

__init__.py

Mlx llm package (#301)

2024-01-12 10:25:56 -08:00

base.py

Mlx llm package (#301)

2024-01-12 10:25:56 -08:00

cohere.py

Fix for cohere plus (#650)

2024-04-05 14:11:24 -07:00

dbrx.py

Fix argpartition call in Mixtral and other MOES (#676)

2024-04-12 11:00:56 -07:00

gemma.py

Configurable LR schedulers (#604)

2024-03-29 13:41:10 -07:00

llama.py

Switch to fast RMS/LN Norm (#603)

2024-03-23 07:13:51 -07:00

mixtral.py

Fix argpartition call in Mixtral and other MOES (#676)

2024-04-12 11:00:56 -07:00

olmo.py

Configurable LR schedulers (#604)

2024-03-29 13:41:10 -07:00

phi.py

Switch to fast RMS/LN Norm (#603)

2024-03-23 07:13:51 -07:00

phixtral.py

Fix argpartition call in Mixtral and other MOES (#676)

2024-04-12 11:00:56 -07:00

plamo.py

Configurable LR schedulers (#604)

2024-03-29 13:41:10 -07:00

qwen2_moe.py

Add support for qwen2moe (#640)

2024-04-02 11:33:29 -07:00

qwen2.py

Switch to fast RMS/LN Norm (#603)

2024-03-23 07:13:51 -07:00

qwen.py

Switch to fast RMS/LN Norm (#603)

2024-03-23 07:13:51 -07:00

stablelm.py

Stable lm 2 (#666)

2024-04-08 14:18:55 -07:00

starcoder2.py

Switch to fast RMS/LN Norm (#603)

2024-03-23 07:13:51 -07:00