Comment by idiotsecant
7 days ago
You realize the whole reason people use deepseek is that you can download and run it offline where the spooky Chinese people can't get your data, right?
7 days ago
You realize the whole reason people use deepseek is that you can download and run it offline where the spooky Chinese people can't get your data, right?
First, the Chinese people aren't spooky. That's not what I'm getting at. I think you know that, too.
Second, you can run it offline, but you aren't going to run the machine completely offline. You're going to have it on the internet. LLMs are probabilistic, not deterministic, programs. Evaluating them for what sort of security vulnerabilities they present - no matter what country made them - is still a fairly young field of information security, and isn't going to be as easy as evaluating a deterministic program.
Do I know for sure that there's some combination of states within a DeepSeek LLM that opens up an internet connection and sends information back to external servers? No. Do I know for sure that there's no combination of states within a DeepSeek LLM that opens up an internet connection and sends information back to external servers? Also no.
What I do know is that the People's Republic of China has an extensive history of offensive cyber operations against American and other Western computer networks. I also know that these efforts are likely ongoing.
Know who I don't have the same concerns about? Mistral.
I'm not sure if you've ever heard of firewalls before but you can in fact prevent network access you don't sanction.
Given that agentic AIs have shown an ability to exploit known vulnerabilities in software, it probably wouldn't be too far of a stretch to think they could get around firewalls in one way or another.
Which takes us back to the "it's hard to properly secure non-deterministic software" point.
2 replies →
do you think the French security state and tech industry are not competent enough to put in a backdoor ?
I think they have significantly less desire to than the PRC.
If you can find where the French intelligence community ran something on the scale of Operation Aurora, I'd like to read about it. Seriously.
[dead]
The article says it clearly:
> The models themselves may contain malware or other security vulnerabilities.
The weights contain malware? What security vulnerability do they contain? Is the claim that they will write insecure code? This seems easy enough to test - run a sufficiently large sample through another LLM
That's true in the sense that it's true for every single model.
Yeah, but it’s different if they’re our backdoors!
1 reply →
And the article must clearly be the whole truth and nothing but the truth.