Prince Canuma bf2da36fc6 Fix Cohere2: mask shape error (long context) (#1202) ...

* fix mask shape error (long context)

* Update llms/mlx_lm/models/cohere2.py

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>

* revert layer_idx

* black formatting

* Update cohere2.py

* format

---------

Co-authored-by: Awni Hannun <awni.hannun@gmail.com>
Co-authored-by: Awni Hannun <awni@apple.com>

2025-01-12 12:58:08 -08:00

6.4 KiB

Raw Blame History

View Raw