← Back to context

Comment by leptons

6 days ago

>what are you doing with all your time if you aren't reviewing the code and trying to make it maintainable?

I was told I'm not supposed to read pull requests at my job anymore (we all do agentic coding now), I'm just supposed to click "approve" on PRs because for some stupid reason it still requires several humans to approve the PR. Instead of reading PRs, we're all telling the AI to do more work to create even more PRs. It's not a good way forward, and I'm looking for another job.

>If hosted solutions get too expensive, people will selfhost.

To self-host a frontier-adjacent model at speed comparable to a commercial API, you're looking at roughly $250k-500k to buy or $20-35k/month to rent the GPUs. And that's only enough to operate at current "frontier" model capability, and buying also doesn't include the massive amounts of electricity it will cost every month to run that hardware. Admittedly I used AI to come up with those figures, so take it with a grain of salt, but judging from how much these AI companies are spending, it tracks that they are consuming massive amounts of money on a per-user basis just to gain market share. I've tried to self-host AI and it sucks. I wouldn't use it for coding.

>I think AI is here to stay.

Sure it is, but it may not cost what you think it should cost.

> I was told I'm not supposed to read pull requests at my job anymore (we all do agentic coding now), I'm just supposed to click "approve" on PRs because for some stupid reason it still requires several humans to approve the PR.

That sucks, may as well auto approve with a script.

> Sure it is, but it may not cost what you think it should cost.

You can go on open router and see what 3rd parties are hosting open models for. There are some pretty capable models (not frontier, but probably opus 4.5 level) for pretty cheap.

Those companies have no incentive to lose money. They are nameless, they are making a profit just providing the service, and it's cheaper than the frontier models of today.

So I think we have a pretty good idea about what the price can be, even without VC subsidizing.