Commit Graph

6 Commits

Author SHA1 Message Date
Juarez Bochi
330f024d1c Move position biases to attention module 2023-12-15 11:30:17 -05:00
Juarez Bochi
d0497ddc0b Load decoder weights 2023-12-15 10:50:04 -05:00
Juarez Bochi
009ed0179c Load position bias embeddings 2023-12-15 10:16:11 -05:00
Juarez Bochi
62924d8135 Pass config to all modules, fix ln 2023-12-14 15:51:03 -05:00
Juarez Bochi
c0001a94f2 Load all encoder weights 2023-12-14 15:38:41 -05:00
Juarez Bochi
bca5ca4f98 Add skeleton 2023-12-14 15:21:36 -05:00