Comment by jononor
1 day ago
Seems like we may get local, open, workstation-grade models that are useful for coding in a few years. By workstation-grade I mean a computer around 2000 USD, and by useful for coding I mean around Sonnet 4 level. Current cloud based models are fun and useful, but a tool that is / will be so core to the developer experience, I want to be able to run locally.
This will be essential for the open source. Otherwise open source development will become unsustainable. I'm actually a little bit more optimistic. I think we will get something more than Sonnet 4 level in two years, that can be run on a $2,000 machine.
I've been waiting to do exactly this. Improved latency and no throttling is super appealing to me.
I would say by end of year, not 2 years.
Yeah, if we are lucky it might happen that fast!