Comment by Narciss

The choice of AI does matter, and older models can potentially do your task much better than newer ones.

In the course of building my side project (storytveller), I’ve found that newer models tend to do worse at storytelling. I’ve tested basically every model under the sun that is available for use in production, and one stands out - now it may be that others will come along and not do the research that I’ve done to choose the same model, and thus my application will be better than theirs in part because of the AI model I choose.

Having “AI” as part of your application will not matter as much, that I agree with, but having “the right AI” will.

Of course,the user experience will definitely matter as well, as will the marketing and other criteria - another point of agreement with the article. But that does not diminish the fact that, if your application does not involve testing benchmarks, there is a good chance that a model that may not be the newest could still be the best for your particular use case, so you should not just blindly choose the latest shiniest model as this article sort of implies.

The hammer does matter.