← Back to context

Comment by wongarsu

2 hours ago

Where do I sign up to get 200k/yr to keep one rack running? Sounds like an incredibly chill job

Apparently it’s going to take the 3 of us to do this, mate. Going to get so much reading done.

What you get is not what you cost.

40% overhead is quite typical, so you'd be looking at $120k/year. In the USA I'd consider that a competitive salary for an admin capable or keeping a $6M rack of specialized hardware running 24/7.

  • Yeah but you don't need two such people, or even one, dedicated to this single rack.

    A company of the size that this is worthwhile for, probably has dedicated devops on staff already and can add this rack to the inventory with no additional staff.

    • Who is going to upgrade the models ?

      Who is going to fix it when the api does something weird ?

      Who is going to proactively make sure it’s not overheating?

      Chat GPT has enterprise contracts for a reason.

      1 reply →