you can already get that information by reading books in the library.
The biggest barrier is not information, it's the ability to secure enough of the materials and equipment.
For example, information for how to make a nuclear weapon is already there in the library. However, mining enough yellow cake and then purifying it is an industrial scale operation, out of reach unless you are a nation state, and have good mountain tunnels, etc. To a lesser extent, this is also true for producing chemical weapons. The theory is there, but actual production extremely out of reach. No LLM can help you there. (You can verify by reading up on Aum Shinrikyo to get an idea of the staggering scale required)
Sure, information on all sorts of things is in “the library”. But (a) most people in the world don’t have access to a decent library (if you’re on HN you’re statistically much more likely to), (b) most people have no idea how to use one (same), and most importantly (c) AI will distill the knowledge from ten books you might need to read into step by step simple instructions if you ask.
I don't think it should be outright banned, automated intelligence is like a gun, hammer, knife, nuclear warhead, etc.
Ok I may agree with this. Instead to ban it we should nerf it to the point it’s useless.
Maybe nerf should start selling ai models.
1 reply →
I see that intelligence itself is a tool, but that doesn't mean I want an automated gun, automated hammer, automated nuclear warhead, etc.
You may not want them, but the NRA certainly wants that you want them.
1 reply →
not really, though. you don't see automated intelligence in the hands of junkies et al. ... and you don't see it coming, either ...
Junkies et al can log into chatgpt right now and use it to create a phishing email to steal drug money from your Grandma. Many people saw this coming.
1 reply →
[dead]
I wonder if every future announcement will be met with this criticism. Like, what's the point if they'll ban it in a few days.
I don't really want the average LLM being able to tell anyone exactly how to syntheize lethal nerve agents.
you can already get that information by reading books in the library.
The biggest barrier is not information, it's the ability to secure enough of the materials and equipment.
For example, information for how to make a nuclear weapon is already there in the library. However, mining enough yellow cake and then purifying it is an industrial scale operation, out of reach unless you are a nation state, and have good mountain tunnels, etc. To a lesser extent, this is also true for producing chemical weapons. The theory is there, but actual production extremely out of reach. No LLM can help you there. (You can verify by reading up on Aum Shinrikyo to get an idea of the staggering scale required)
Sure, information on all sorts of things is in “the library”. But (a) most people in the world don’t have access to a decent library (if you’re on HN you’re statistically much more likely to), (b) most people have no idea how to use one (same), and most importantly (c) AI will distill the knowledge from ten books you might need to read into step by step simple instructions if you ask.
> mining enough yellow cake and then purifying it is an industrial scale operation, out of reach unless you are a nation state
or a transnational (or even national scale) energy and or minerals company.
Might be hard to slip past the shareholders, but dark projects have flown under the annual reports of several large players.
1 reply →