← Back to context

Comment by Xunjin

1 day ago

Let me give you the benefit of the doubt, can you expand what you run in production?

I'm the founder of a SaaS in the marketing industry with tens of thousands of paying users and we have lots of AI powered workflows where small changes between model versions can make some big differences so whenever we update models we have to thoroughly test them which is why we pin them at specific versions which has been a best practice (and common sense) for the last 3+ years

In the openai api and many other rapid you can pretty trivially pin not only the model but also the specific snapshot you want to use by using the model id for that snapshot. It's not that big a deal and has been available for years