zhangyiss/mlx-examples
1
0
Fork 0
mirror of https://github.com/ml-explore/mlx-examples.git synced 2025-06-24 09:21:18 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
7a3ab1620a
mlx-examples/llms/mlx_lm/models
History
Alex Cheema cd8efc7fbc
Add support for Llama-3.1 (#907) 
* add dynamicNTK scaling rope

* remove unused var

* fix rope base

* llama3.1 fixes

* TODO for rope eval

* vectorise llama3 base freq calculation

* removed the arbitrary 2.0 rope_scale default case

* fix slow llama3.1 generation by evaluating stateless part of DynamicNTKScalingRoPE in init

* nits + format

* use mx.pi

* fix tests and add test for 3.1

---------

Co-authored-by: Prince Canuma <prince.gdt@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>
2024-07-23 13:21:32 -07:00
..
__init__.py Mlx llm package (#301) 2024-01-12 10:25:56 -08:00
base.py Add support for deepseek coder v2 lite (#882) 2024-07-17 07:23:28 -07:00
cohere.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
dbrx.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
deepseek_v2.py Add support for deepseek coder v2 lite (#882) 2024-07-17 07:23:28 -07:00
gemma2.py Add logit soft capping to gemma, and fix precision issues (#857) 2024-07-02 07:52:39 -07:00
gemma.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
gpt2.py GPT2 Support (#798) 2024-06-02 16:33:20 -07:00
gpt_bigcode.py Add support for ibm granite (#758) 2024-05-21 20:16:31 -07:00
gpt_neox.py Add GPT-neox model (#863) 2024-07-11 06:13:17 -07:00
internlm2.py Add support for InternLM-2.5 (#871) 2024-07-17 16:38:22 -07:00
llama.py Add support for Llama-3.1 (#907) 2024-07-23 13:21:32 -07:00
minicpm.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
mixtral.py fix moe conversion (#802) 2024-05-31 12:36:05 -07:00
olmo.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
openelm.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
phi3.py longrope (#886) 2024-07-12 07:19:11 -07:00
phi3small.py make models/phi3.py and models/phi3small.py compatible with mypy (#833) 2024-06-12 06:53:55 -07:00
phi.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
phixtral.py fix moe conversion (#802) 2024-05-31 12:36:05 -07:00
plamo.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
qwen2_moe.py Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835) 2024-06-14 09:44:50 -07:00
qwen2.py Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835) 2024-06-14 09:44:50 -07:00
qwen.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
recurrent_gemma.py Fix server for openai package (#877) 2024-07-08 12:34:31 -07:00
stablelm.py Kv cache (#643) 2024-05-08 08:18:13 -07:00
starcoder2.py Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835) 2024-06-14 09:44:50 -07:00
su_rope.py Su-RoPE(Rotary Position Embedding) for Phi-3 (#813) 2024-06-11 06:20:04 -07:00
switch_layers.py Rename block sparse to gather (#793) 2024-05-23 19:47:35 -07:00