Comment by user43928
13 hours ago
I don't think so.
One could use gpt-4 or gpt-5 with today's harnesses and we'd see how well that goes.
13 hours ago
I don't think so.
One could use gpt-4 or gpt-5 with today's harnesses and we'd see how well that goes.
I think models using these harnesses were also RLHF'd hard on responding to looping instructions and following through on goals. Older models were tuned for basic chat responses.
If someone could tune models of that size to have comparable effectiveness at much much lower costs, they would have done so by now.
"The harness improvements are the real sauce" is like a sincere "It's gotta be the shoes" take about Micheal Jordan.
(For the younger: that line was from a series of Nike ads where his skills were being explained)