Comment by danuker
2 years ago
> should you just cut out the middle-model and be using ChatGPT as your classifier?
And hope OpenAI forever provides the service, and at a reasonable price, latency, and volume?
2 years ago
> should you just cut out the middle-model and be using ChatGPT as your classifier?
And hope OpenAI forever provides the service, and at a reasonable price, latency, and volume?
> And hope OpenAI forever provides the service, and at a reasonable price, latency, and volume?
They are enjoying the be the market leader for now, but OpenAI will soon be facing real competition, and LLM services will become a commodity product. That must be partly why they seeked Microsoft backing: to be a part of the "big tech".
Besides that, there's the issue of efficiency.
Better quality training data might enable you to build a leaner more efficient model than is far cheaper to implement and run than the expensive model used to generate the data to train it.
See for example: https://twitter.com/SebastienBubeck/status/16713263696268533...