Commit Graph

3 Commits

Author SHA1 Message Date
Angelos Katharopoulos
7734bc5c4f Change layernorms to two pass algorithm 2025-06-06 10:45:52 -07:00
Angelos Katharopoulos
5e6c130d93
RMS norm without scaling (#1915) 2025-02-28 20:26:57 -08:00
Angelos Katharopoulos
29221fa238
Implement vjps for some primitives in the fast namespace (#883)
* Implement rope vjp in terms of rope
* RMSNormVJP primitive and kernel
* Add LayerNormVJP primitive and kernel
2024-03-26 16:35:34 -07:00