Comment by dools
9 hours ago
> LLMs are a great foundation but building your own harness is a huge undertaking, a deep rabbit hole
I’ve been doing this for the past few months. I started with a server where I ran pi in tmux and then used that to build an LLM gateway and agent session manager, then built deterministic workflows using bash scripts and a skill/script distribution system. The app works on desktop, mobile and web and it works great. Non technical colleagues are using it to build and ship real software and it’s cheap AF even using API pricing because it works well with Luna or deepseek.
I also use Luna and DeepSeek in a custom harness. (Mine is very minimal.) GLM also works great.
I had issues with some other models but it seems to do with the system prompt and tool calling format. Some models seem to only work well with some harnesses.
Ha yeah GLM and Kimi seem to always biff the tool calls. I recently added in a raw stream log switch to diagnose but since DS and Luna are so good and cheap I haven’t been that motivated to debug it …
This is the "i made a voice controlled agent" thread all over again. lol, I too have made a stable of harnesses and tools to run them and have different levels of them monitoring each other and different spends to code/review/triage.