Comment by _heimdall
16 days ago
There's no gain to be had there at all. Any optimizations that reduce resource usage per output will be gobbled up by just making more output.
OpenAI released an open source model only because they are capped on growth right now by the amount if hardware they have. Improve resource efficiency and you better believe they'll just crank up use of said resources until they capped again.
No comments yet
Contribute on Hacker News ↗