Comment by tripzilch
2 hours ago
I always put the agent harness in an ubuntu-based Docker, with a /workspace folder where it can work and occasionally some other stuff mounted as read-only. The LLM server itself (llama-server) is running on a different more powerful computer on the local network, connected through Tailscale so I can also use it away from home.
I honestly don't trust these things to not accidentally mess something up, otherwise.
Now I think it's still technically possible to break out of that with some clever hacks? But the moment I see a model even vaguely considering that, I will never run it again.
(I don't use Claude but currently Qwen3.8 27B)
How is Qwen3.8 27B behaving in comparison with, say, the free models available at OpenRouter or OpenCode?
I'm interested in running models locally, and 27B is in the range of my budget.
That's my approach too. I even added on a firewall container to the compose so it could fetch packages and that's it. It isn't impossible for it to exfiltrate data that way but I think I put a limit on the request size and limited to get requested so if it did it was relatively slow. But once it has all the tools it needs, that can be cut
you used to only 'need' debug.com.