Comment by malfist

4 days ago

It's a critical problem like when a drug dealers supply kills someone and they get a bump in business because they're selling "the real deal"

Irrelevant to your point, but drug users dying is more often the result of a dealer cutting their supply with something dangerous than it is the result of purity.

  • Right, and an LLM being able to "escape confinement" is more likely to be poor confinement or a PR stunt than a "too powerful" llm. Same situation

    • No, not really as almost no one runs LLMs in confinement once they are released and the capability is a jailbreak away. Poor confinement is irrelevant, if I use your model to check the security of my code and it hacks into the company that makes libraries used inside of it it's a huge problem.

  • Second this. Lots of fentanyl overdose are caused by accident, not because the buyers are buying them. It is extremely dangerous