Comment by cft
5 hours ago
This will be essential for the open source. Otherwise open source development will become unsustainable. I'm actually a little bit more optimistic. I think we will get something more than Sonnet 4 level in two years, that can be run on a $2,000 machine.
I've been waiting to do exactly this. Improved latency and no throttling is super appealing to me.