Comment by jmward01
2 months ago
It is worth the exercise to honestly assess the maintenance, initial costs, ongoing costs, etc etc for owning your own. I did this at a company for a single server to let the ml group test fine tuning frameworks/throw crazy ideas at before spending real money on a training run and it paid for itself in like 3 months. Sometimes the math is overwhelmingly positive, sometimes it isn't. In general, the smaller/earlier you are the less it makes sense. Not because of the per hour costs, but because of the distraction away from implementing the core idea of the company. It is worth some, maybe a lot of, inefficiency to stay focused. When you get bigger and have strong fit and a clear direction it is a lot easier to focus on optimizing hosting costs and spending leadership time away from the core problem of the company.
It’s always a spreadsheet decision.
Seems like people missed the end of what I wrote though. We run some bare metal but do not physically handle it. There’s many companies who will rent huge boxes with good connectivity in a data center. DataPacket is the best we have found for price and reliability.
Physically racking only makes sense if you are huge or have special requirements.
> Physically racking only makes sense if you are huge or have special requirements.
CISA has identified 16 US industries where they have noted that companies should be able to operate indefinitely without internet access. See the Water Plant hack stories coming through right now across more than 19 states, for example. Water, electricity, internet access / telecom, military, chemical, logistics, transportation, etc.