Comment by wslh
2 days ago
Am I right that investing in your own ML hardware only makes sense when you are dealing with private data and confidential sessions, right? (Not counting development or tinkering work).
2 days ago
Am I right that investing in your own ML hardware only makes sense when you are dealing with private data and confidential sessions, right? (Not counting development or tinkering work).
If you think of it as API access vs temporary hosting running the same open model, it makes sense to run the hardware yourself whenever you are sure it can be fully utilized.