Commit Graph

2 Commits

Author SHA1 Message Date
Goekdeniz-Guelmez
e22b2dbf27 Fixed streaming generation and got rid of generating gibberish, but is still a litle slow: 0.222 tokens-per-sec 2024-11-21 22:01:28 +01:00
Goekdeniz-Guelmez
906f972d36 save push 2024-11-06 16:35:46 +01:00