Comment by rjsw
3 hours ago
I think the fear is that it might insert some "phone home" routine into the source code that it generates.
3 hours ago
I think the fear is that it might insert some "phone home" routine into the source code that it generates.
Has anyone demonstrated that this type of attack is even possible? Also the moment anyone detects this attack it will nuke deepseek/other chinese AI labs reputation completely, it is the most high risk low reward attack ever.
Yes.
https://arxiv.org/abs/2401.05566
In that paper, if it LLM was told it was 2023, then the code it generated was fine. If the prompt included the fact that it was 2024, then it intentionally wrote exploitable code.