Comment by pqtyw
1 day ago
It's mostly R&D though, not inference. If LLM's effectively become a commodity then they are screwed anyway.
1 day ago
It's mostly R&D though, not inference. If LLM's effectively become a commodity then they are screwed anyway.
Aren’t the Chinese labs quickly turning them into a commodity?
The open-weight models will have a steady race to the bottom on inference costs just by dint of competition between providers. They aren’t at the frontier yet, but they are rapidly eating the flash market.