Comment by montroser
3 hours ago
Yeah, you need both a smaller system prompt than OpenCode uses, and a larger context configured in llama.cpp. It's probably running into compaction cycles before it even gets to start thinking about the task at hand.
You'd have better luck with pi instead of OpenCode, and see how far you can get that context window higher. For any halfway actual work you need bare minimum 64k, ideally 128k+. You can use 8bit kv cache, despite whatever folklore you may hear otherwise.
No comments yet
Contribute on Hacker News ↗