Comment by yousif_123123
10 hours ago
Its crazy that OpenAI and Anthropic themselves aren't doing that. No attempts at reducing inference cost for code as far as I know from them.
10 hours ago
Its crazy that OpenAI and Anthropic themselves aren't doing that. No attempts at reducing inference cost for code as far as I know from them.
OpenAI do have codex models, which are half the price. I haven't used them enough to comment on the quality though.
I remember them saying a few years ago that, they didn't think it was worth specializing models for code, because their general purpose models kept beating them. I guess they changed their mind? Since they did start making codex models again.
They also stopped making them again.
My speculation is that frontier models are MoE, and they just have some number of experts for coding.