Comment by geraneum
7 hours ago
> Harness… seeing a file…
Thank you for making my point for me. But let’s keep the goalposts stationary. We’re talking about LLMs without scaffolding.
7 hours ago
> Harness… seeing a file…
Thank you for making my point for me. But let’s keep the goalposts stationary. We’re talking about LLMs without scaffolding.
Indeed, and it would be interesting whether it is much more likely to derail outside of a coding harness like in my examples.
I still don't know if that is the case, and how frequently it happens, since you did not share details beyond vaguely suggesting it would happen.