Comment by spaceman_2020

14 days ago

If you want to be completely watertight, you can absolutely run an on premises model. No data ever leaves your network, ever. Some pretty good models run on $5-10k hardware

Can’t do that with SaaS

Also, I’m baffled that on HN of all places, I have to actually defend the idea of rolling your own apps and protecting your data from cloud providers

3 comments

spaceman_2020

Reply
bandrami  14 days ago

Wait of course I was assuming a local model. People aren't using hosted AI on machines holding data that they care about being exfiltrated, right?

  • heavyset_go  14 days ago

    > People aren't using hosted AI on machines holding data that they care about being exfiltrated, right?

    If only