Comment by yipinwong
4 hours ago
Harness changes dynamically depending on your LLM intelligence.
The smarter LLMs get, you apply less, as LLM takes care of pre-existing harnesses.
This is a shitty, unreliable, and unmaintainable way of using harness because the harness is built around for the sake of getting good benchmark scores (someone mentioned overfitting in comments, so that)
No comments yet
Contribute on Hacker News ↗