Comment by LeonM
3 hours ago
What you get is not what you cost.
40% overhead is quite typical, so you'd be looking at $120k/year. In the USA I'd consider that a competitive salary for an admin capable or keeping a $6M rack of specialized hardware running 24/7.
Yeah but you don't need two such people, or even one, dedicated to this single rack.
A company of the size that this is worthwhile for, probably has dedicated devops on staff already and can add this rack to the inventory with no additional staff.
Who is going to upgrade the models ?
Who is going to fix it when the api does something weird ?
Who is going to proactively make sure it’s not overheating?
Chat GPT has enterprise contracts for a reason.
The same person managing the company's email accounts and whatnot.
I didn't say it's fire-and-forget. I'm saying all that is maybe a day of work every 3 months.
All of the answers to your questions above are in gp's comment already:
> A company of the size that this is worthwhile for, probably has dedicated devops on staff already