Comment by tyleo
2 days ago
We’re at a small startup and we mix models. But mainly just between the major providers. I wouldn’t say it’s as much to avoid spending money as it is to get the maximum benefit out of different capability spectrums.
2 days ago
We’re at a small startup and we mix models. But mainly just between the major providers. I wouldn’t say it’s as much to avoid spending money as it is to get the maximum benefit out of different capability spectrums.
Well, you can say that all day long but realistically would your “small startup” even exist if your firm was charged Enterprise rates or the actual compute costs and denied access to capital to subsidize your users? It’s a fair question.
The other, more complex one would be “what benefit” are you talking about? Clearly there are some differences in performance regarding speed and token cost, but industry news indicates not a single one has solved the inherent hallucination problem which makes the reliability akin to an untreated schizophrenic research or coding assistant.
Hallucinations are not really a big problem in day to day work
As a sysadmin I disagree mightily. LLMs are very bad at IT troubleshooting, server stuff, etc. Especially microsoft and powershell.
1 reply →
Depends on the work and the customer.
Are you the person paying for the hallucinations, or do you just like the free high?
1 reply →
The old, “it doesn’t matter because AI doesn’t work,” argument.
I thought we were past this.