Comment by Youden
10 hours ago
$5/hr = $3600/mo.
Unless you only need the AI available some of the time, $5/hr is pretty expensive. That's an RTX Pro twice a year.
If you're using it for discrete sessions of coding or something, that might make sense for you but if you're using it for an always-on assistant, that pricing kinda sucks.
I would imagine extremely few people are utilizing an H200 for every hour of a month. Especially for something like an assistant
5090's are like $0.20/hr
For a lot of people involved in local LLM, ownership and control of their data matters to them a lot. It's what pulls a lot of people toward local models. Renting a 5090 off of some random infrastructure provider that is reselling some random dude's 5090 does not fit the bill.