Comment by intenex

18 hours ago

Nukes don’t kill people, people with nukes kill people. How do you feel about giving everyone on earth access to nukes?

A simple thought experiment - imagine AI discovers a way to make nuclear bombs capable of destroying the entire world radically more cheaply and accessibly with common items anyone can purchase. AI can help anyone build these nukes trivially. Even if the AI and the nukes don’t kill people on their own, do you want literally every human on earth to have this power in their pocket? Do you think it would be a net positive outcome for us vs a world where that’s not the case?

https://nickbostrom.com/papers/vulnerable.pdf

Yeah, let's also ban 3d printers, drone motors, and YouTube chemistry videos. If you want to be dangerous, there's a world of opportunities already, with existing open models quite sufficient for a lot of interesting cases.