Comment by simianwords
2 days ago
GPT Terra is 50% cheaper than 5.5 while being more performant. So it’s like a straight up 50% reduction in cost!
That leads me to a question. Why wouldn’t they just default to terra in ChatGPT in the last few months? If they didn’t then they burnt money for no reason by giving a shittier model at a higher price
50% reduction in cost charged to customers, inference cost may as well be the same, we don't know.
Recent reports that OpenAI found optimisations would explain that these are legit
"while being more performant"
..on some specific set of benchmarks ;)