Alex Cheema cd8efc7fbc Add support for Llama-3.1 (#907) ...

* add dynamicNTK scaling rope

* remove unused var

* fix rope base

* llama3.1 fixes

* TODO for rope eval

* vectorise llama3 base freq calculation

* removed the arbitrary 2.0 rope_scale default case

* fix slow llama3.1 generation by evaluating stateless part of DynamicNTKScalingRoPE in init

* nits + format

* use mx.pi

* fix tests and add test for 3.1

---------

Co-authored-by: Prince Canuma <prince.gdt@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>

2024-07-23 13:21:32 -07:00

..

__init__.py

Mlx llm package (#301)

2024-01-12 10:25:56 -08:00

base.py

Add support for deepseek coder v2 lite (#882)

2024-07-17 07:23:28 -07:00

cohere.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

dbrx.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

deepseek_v2.py

Add support for deepseek coder v2 lite (#882)

2024-07-17 07:23:28 -07:00

gemma2.py

Add logit soft capping to gemma, and fix precision issues (#857)

2024-07-02 07:52:39 -07:00

gemma.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

gpt2.py

GPT2 Support (#798)

2024-06-02 16:33:20 -07:00

gpt_bigcode.py

Add support for ibm granite (#758)

2024-05-21 20:16:31 -07:00

gpt_neox.py

Add GPT-neox model (#863)

2024-07-11 06:13:17 -07:00

internlm2.py

Add support for InternLM-2.5 (#871)

2024-07-17 16:38:22 -07:00

llama.py

Add support for Llama-3.1 (#907)

2024-07-23 13:21:32 -07:00

minicpm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

mixtral.py

fix moe conversion (#802)

2024-05-31 12:36:05 -07:00

olmo.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

openelm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

phi3.py

longrope (#886)

2024-07-12 07:19:11 -07:00

phi3small.py

make models/phi3.py and models/phi3small.py compatible with mypy (#833)

2024-06-12 06:53:55 -07:00

phi.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

phixtral.py

fix moe conversion (#802)

2024-05-31 12:36:05 -07:00

plamo.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

qwen2_moe.py

Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835)

2024-06-14 09:44:50 -07:00

qwen2.py

Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835)

2024-06-14 09:44:50 -07:00

qwen.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

recurrent_gemma.py

Fix server for openai package (#877)

2024-07-08 12:34:31 -07:00

stablelm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

starcoder2.py

Fix mypy errors with models/{qwen2,qwen2_moe,startcoder2}.py (#835)

2024-06-14 09:44:50 -07:00

su_rope.py

Su-RoPE(Rotary Position Embedding) for Phi-3 (#813)

2024-06-11 06:20:04 -07:00

switch_layers.py

Rename block sparse to gather (#793)

2024-05-23 19:47:35 -07:00