Comment by vadansky
10 hours ago
> with open models you can get a subscription with privacy
Unless you're running it locally, aren't you just trusting some other entity?
10 hours ago
> with open models you can get a subscription with privacy
Unless you're running it locally, aren't you just trusting some other entity?
correct, you are trusting another entity.
however the legal terms are different, openai reads your data. they store it for 30 days, but of course once it hits the disk you can keep as long as you like in a civil case like nyt v openai.
the same for google and anthropic. so, it's not always nice if someone is paid to read your data for safety. people upload sensitive matters, personal videos and so on.
i wouldn't prioritise it myself but you can also know that the data will all come out in discovery if you are in a legal issue. maybe that's not important, but people thought it did matter to give some protections to patient records, legal advice and therapy. you upload that to gpt and it goes into discovery.
While true - there are laws about saying you are doing the things you are doing, especially in certain regulated environments. If you are in the same country as the entity you are trusting, you have recourse if they are not living up to your trust usually in some form or another.
right, and on prem being an option is a god send, however you manage to do it
it's not a recommendation, its an option. if you don't have capital then it doesn't apply to you and move on. it wasn't an option for even people with capital.
come back in a few years when its more accessible
additionally I like that there are providers with faster special purpose processors for faster tokens/sec, all at different pricing strategies
so just pick something that matches your personal risk tolerance