Comment by bubblyworld
7 days ago
For what it's worth, commercial models are in a completely different league to locally runnable models. If you are really interested in seeing state of the art right now at least give it a whack with opus/gemini/o3 or something of that calibre.
You might still be disappointed but at least you won't have shot your leg off out of the gates!
I'm trying to use local models for privacy reasons. Also, at some point, one of the employers out there will start suing people because those people shared code with a commercial model, and the commercial model decided to train on that code and output learned code to someone else. I'm not interested in anything of such a situation.