JosefAlbers fda41545a6 Su-RoPE(Rotary Position Embedding) for Phi-3 (#813) ...

* Su-RoPE

* nits

* Update su_rope.py

* Update su_rope.py

Per GPT4: "The error TypeError: 'type' object is not subscriptable is caused by using the type hint list[float] in a version of Python that does not support it. This syntax is only available in Python 3.9 and later."

* Ran isort

---------

Co-authored-by: Awni Hannun <awni@apple.com>

2024-06-11 06:20:04 -07:00

..

__init__.py

Mlx llm package (#301)

2024-01-12 10:25:56 -08:00

base.py

Add support for ibm granite (#758)

2024-05-21 20:16:31 -07:00

cohere.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

dbrx.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

gemma.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

gpt2.py

GPT2 Support (#798)

2024-06-02 16:33:20 -07:00

gpt_bigcode.py

Add support for ibm granite (#758)

2024-05-21 20:16:31 -07:00

internlm2.py

support internlm2 (#797)

2024-05-27 06:22:21 -07:00

llama.py

Correct the type annotation of cache in llama.py (#828)

2024-06-10 15:18:34 -07:00

minicpm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

mixtral.py

fix moe conversion (#802)

2024-05-31 12:36:05 -07:00

olmo.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

openelm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

phi3.py

Su-RoPE(Rotary Position Embedding) for Phi-3 (#813)

2024-06-11 06:20:04 -07:00

phi3small.py

Port of phi3small (#794)

2024-05-31 12:54:14 -07:00

phi.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

phixtral.py

fix moe conversion (#802)

2024-05-31 12:36:05 -07:00

plamo.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

qwen2_moe.py

fix moe conversion (#802)

2024-05-31 12:36:05 -07:00

qwen2.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

qwen.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

stablelm.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

starcoder2.py

Kv cache (#643)

2024-05-08 08:18:13 -07:00

su_rope.py

Su-RoPE(Rotary Position Embedding) for Phi-3 (#813)

2024-06-11 06:20:04 -07:00

switch_layers.py

Rename block sparse to gather (#793)

2024-05-23 19:47:35 -07:00