2 Commits

Author	SHA1	Message	Date
Awni Hannun	ee60e2a9d5	Kv cache (#643) ... * in place kv_cache * fix * fix kv cache size * partially fix kv cache dtype * step kv cache * multiple of step size * more teests + kv cache * more kv cache * udpate all models to use kv cache	2024-05-08 08:18:13 -07:00
Prince Canuma	c012eb173f	Add support for OpenELM (#719) ... * add openELM * update splitting logic * update qkv logic and, transformer and MLP block * code formatting and fix args * fix array slicing and remove unused var :) * add to tuner * use mx.split for slicing qkv * merge with phi3 * remove rope scaling logic * code formatting	2024-04-25 16:49:28 -07:00