Comment by xnx

10 months ago

It's very cool that useful models can be run on single personal computers at all. For coding, your time is very valuable, and I'd never want to use anything less than the best. I'm happy to pay pennies to use a frontier model with a huge context model and great speed.

3 comments

xnx

Reply
chipsrafferty  10 months ago

This is mostly for one of 4 reasons:

1. Sovereignty over data, your outputs can't be stolen or trained on

2. Just for fun / learning / experiment on

3. Avoid detection that you're using AI

4. No Internet connection, in the woods at your cabin or something

  • biker142541  10 months ago

    Agreed. It’s definitely been fun playing locally, learning, fine tuning, etc, but these models just don’t quite cut it for serious development tasks (yet, and assuming none of the above considerations apply). I haven’t found better than Gemini 2.5 for my work so far.