Comment by theshrike79

You still can't beat an acre of specialized compute with any kind of home hardware. That's pretty much the power of cloud LLMs.

For a tool use loop local models are getting to "OK" levels, when they get to "pretty good", most of my own stuff can run locally, basically just coordinating tool calls.