Comment by redeux

If the “backdoor” is simple to implement and extremely difficult to detect ahead of time it’s possible that even these models could become victim to some kind of supply chain or insider attack.

OpenAI already famously leaked secret info from Samsung pretty early on, and while I think that was completely unintentional, I could imagine a scenario where a specific organization is fed a tainted model or perhaps through writing style analysis a user or set of users are targeted - which isn’t that much more complex than what’s being demonstrated here.