← Back to context Comment by AlexCoventry 5 days ago What do you find interesting about it, and how does it compare to commercial offerings? 3 comments AlexCoventry Reply simonw 5 days ago It's rare to find a local model that's capable of running tools in a loop well enough to power a coding agent.I don't think gpt-oss:20b is strong enough to be honest, but 120b can do an OK job.Nowhere NEAR as good as the big hosted models though. ontouchstart 5 days ago Think of it as the early years of UNIX & PC. Running inferences and tools locally and offline opens doors to new industries. We might not even need client/server paradigm locally. LLM is just a probabilistic library we can call. AlexCoventry 5 days ago Thanks.
simonw 5 days ago It's rare to find a local model that's capable of running tools in a loop well enough to power a coding agent.I don't think gpt-oss:20b is strong enough to be honest, but 120b can do an OK job.Nowhere NEAR as good as the big hosted models though. ontouchstart 5 days ago Think of it as the early years of UNIX & PC. Running inferences and tools locally and offline opens doors to new industries. We might not even need client/server paradigm locally. LLM is just a probabilistic library we can call. AlexCoventry 5 days ago Thanks.
ontouchstart 5 days ago Think of it as the early years of UNIX & PC. Running inferences and tools locally and offline opens doors to new industries. We might not even need client/server paradigm locally. LLM is just a probabilistic library we can call.
It's rare to find a local model that's capable of running tools in a loop well enough to power a coding agent.
I don't think gpt-oss:20b is strong enough to be honest, but 120b can do an OK job.
Nowhere NEAR as good as the big hosted models though.
Think of it as the early years of UNIX & PC. Running inferences and tools locally and offline opens doors to new industries. We might not even need client/server paradigm locally. LLM is just a probabilistic library we can call.
Thanks.