Brian Keene 1865299a30 Metal shaders for memory efficient self attention on large sequences (#964) ... * Metal shaders for efficient self attention on large sequences Updated fast attention: GEMM-ified with Steel primitives Uses flash attention 1 for scale correction * more compiler silencing * Address rebase issues * Templatize kernel instantiation, revise cpu bindings * Safer writes to output * Permit batch size > 1 * Numerical fixes for sdpa self attention * Re-enable test, remove unused variable * add benchmarking script * Disable sdpa prior to perf tuning, and simplify tests for per-patch CI		2024-06-03 09:16:19 -07:00
..
cpp	Update pre-commit hooks (#984)	2024-04-11 07:27:53 -07:00
numpy	Add isort pre-commit and run (#68)	2023-12-08 11:31:47 -08:00
python	Metal shaders for memory efficient self attention on large sequences (#964)	2024-06-03 09:16:19 -07:00