mlx-examples/llms/mlx_lm/models
Awni Hannun 6731254e76
Use fast rope (#945)
* use fast rope

* fix llama

* use fast rope for llama3.1

* requires unreleased mlx

* fix su

* fix deepseek v2

* only one of base or freqs

* nit

* fix

* hard code freqs
2024-08-23 13:18:51 -07:00
..
__init__.py Mlx llm package (#301) 2024-01-12 10:25:56 -08:00
base.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
cohere.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
dbrx.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
deepseek_v2.py Use fast rope (#945) 2024-08-23 13:18:51 -07:00
deepseek.py feat: DeepSeek MoE v1 (#942) 2024-08-17 07:18:09 -07:00
gemma2.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
gemma.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
gpt2.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
gpt_bigcode.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
gpt_neox.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
internlm2.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
llama.py Use fast rope (#945) 2024-08-23 13:18:51 -07:00
minicpm.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
mixtral.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
olmo.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
openelm.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
phi3.py Use fast rope (#945) 2024-08-23 13:18:51 -07:00
phi3small.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
phi.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
phixtral.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
plamo.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
qwen2_moe.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
qwen2.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
qwen.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
recurrent_gemma.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
stablelm.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
starcoder2.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00
su_rope.py Use fast rope (#945) 2024-08-23 13:18:51 -07:00
switch_layers.py Handle longer prompt/generation (#931) 2024-08-16 15:28:39 -07:00