5 Commits

Author	SHA1	Message	Date
Yi Wang	6da07fb1b0	make models/phi3.py and models/phi3small.py compatible with mypy (#833)	2024-06-12 06:53:55 -07:00
JosefAlbers	fda41545a6	Su-RoPE(Rotary Position Embedding) for Phi-3 (#813) ... * Su-RoPE * nits * Update su_rope.py * Update su_rope.py Per GPT4: "The error TypeError: 'type' object is not subscriptable is caused by using the type hint list[float] in a version of Python that does not support it. This syntax is only available in Python 3.9 and later." * Ran isort --------- Co-authored-by: Awni Hannun <awni@apple.com>	2024-06-11 06:20:04 -07:00
Prince Canuma	69700d8431	Add support for Phi-3 Medium (#790) ... * update to support phi-3 medium * fuse qkv split	2024-05-22 16:47:06 -07:00
Awni Hannun	ee60e2a9d5	Kv cache (#643) ... * in place kv_cache * fix * fix kv cache size * partially fix kv cache dtype * step kv cache * multiple of step size * more teests + kv cache * more kv cache * udpate all models to use kv cache	2024-05-08 08:18:13 -07:00
Prince Canuma	abcd891851	Add support for phi-3 (#712) ... * Add phi-3 modelling * fix rope scaling warning * add tests and update tuner utils * update name and remove sanitize * fix lora	2024-04-23 09:20:00 -07:00