Comment by charcircuit
4 hours ago
Why do you think the public wants to self host models over using a cheaper solution hosted in the cloud?
4 hours ago
Why do you think the public wants to self host models over using a cheaper solution hosted in the cloud?
Because the public prefers to use ad funded Google search over hosting a tiny web search index you can fit in memory. :)
Almost all the non-tech people I know acknowledge concerns about privacy but have no realistic alternative available to them. I think they won't want to self host until and unless it's easy to deploy, there's nothing to administrate, and the hardware cost is in the same ballpark as a new laptop was prior to the apocalypse.
Subscriptions are almost never actually cheaper.
It is cheaper to subscribe to AI for $500 a year for the rest of your life than to buy a machine capable of running a current frontier model with no subagents.