Comment by UncleOxidant

2 hours ago

Hopefully they'll release some smaller models (<100B) that we can run on home hardware at faster than 10tok/s.

0 comments