Comment by simonw

OpenAI's Adam Groth credits "engineers optimizing inferencing" for the price drop: https://twitter.com/TheRealAdamG/status/1932440328293806321

That seems likely to me, all of the LLM providers have been consistently finding new optimizations for the past couple of years.