Comment by cchance
10 months ago
THIS!!!!!!! People act like Claude and 4o are base models with no funny business behind the scenes, we don't know just how much additional prompt steps are going on for each queue, all we know is what the API or Chat interface dump out, what is happening behind that is anyones guess.. The thinking step and refinement steps likely do exist on all the major commercial models. It's such a big gain for a minimal expenditure of backend tokens, WTF wouldn't they be doing it to improve the outputs?
Well they can't do a /lot/ of hidden stuff because they have APIs, so you can see the raw output and compare it to the web interface.
But they can do a little.
As if they couldn’t postprocess the api output before they send it to the client…
No, I mean they sell API access and you can query it.