Comment by csdreamer7
21 hours ago
> Let's say I use the $200/month Claude (I don't, I use a cheaper plan, but stay with me). If I switch to a Opus 4.5 equivalent local LLM, and it makes even a single production issue that 5.5 wouldn't, that mistake will cost thousands of dollars.
You are assuming that Opus would always be superior; the cloud AI providers can be very variable. They can be very useful for months, but during certain times their quality can drop off a cliff. People online speculate that the cloud providers drop quality during this time when they are training a new model or the service is over-subscribed. You do not have that issue with a local model.
That issue of quality of service is enough many businesses may prefer a locally run model because it will be more consistent.
Indeed, sometimes qwen is superior (even at q3), yesterday i asked both what a line from the logs meant and opus said "oh its just your dns server falling back from eodns to udp no worries" and qwen correctly recognized the ip address as docker subnet and said dont send dns there its probably off