Comment by spaceman_2020
1 month ago
If you want to be completely watertight, you can absolutely run an on premises model. No data ever leaves your network, ever. Some pretty good models run on $5-10k hardware
Can’t do that with SaaS
Also, I’m baffled that on HN of all places, I have to actually defend the idea of rolling your own apps and protecting your data from cloud providers
Wait of course I was assuming a local model. People aren't using hosted AI on machines holding data that they care about being exfiltrated, right?
> People aren't using hosted AI on machines holding data that they care about being exfiltrated, right?
If only
I work in a DFARS-compliant office and I keep forgetting the world isn't like that