Comment by csdvrx

> In my experience even the best open source 7B local models are close to unusable. They'd have been mindblowning a few years ago but when you are used to "full size" cutting edge models it feels like an enormous downgrade

Everything has limits - the only differences is where they are, and therefore how often you meet them.

If you are working with AI, using local models shows you where the problems can (and will) happen, which helps you write more robust code because you will be aware of these limits!

It's like how you write more efficient code if you have to use a resource constrained system.