Comment by UncleOxidant

1 hour ago

Hopefully they'll release some smaller models (<100B) that we can run on home hardware at faster than 10tok/s.

0 comments