* support internlm2 * only attention projections --------- Co-authored-by: Awni Hannun <awni@apple.com>