Prince Canuma
|
c012eb173f
|
Add support for OpenELM (#719)
* add openELM
* update splitting logic
* update qkv logic and, transformer and MLP block
* code formatting and fix args
* fix array slicing and remove unused var :)
* add to tuner
* use mx.split for slicing qkv
* merge with phi3
* remove rope scaling logic
* code formatting
|
2024-04-25 16:49:28 -07:00 |
|