Comment by somenameforme
2 years ago
I think as most of us are software people, in mind if not profession, it gives a misleading perception on where the difficulty in many things is. The barrier there is not just knowledge. In fact, there are countless papers available with quite detailed information on how to create chemical weapons. But knowledge is just a starting point. Technical skill, resources, production, manufacturing, and deployment are all major steps where again the barrier is not just knowledge.
For instance there's a pretty huge culture around building your own nuclear fusion device at home. And there are tremendous resources available as well as step by step guides on how to do it. It's still exceptionally difficult (as well as quite dangerous), because it's not like you just get the pieces, put everything together like legos, flick on the switch, and boom you have nuclear fusion. There's a million things that not only can but will go wrong. So in spite of the absolutely immense amount of information about there, it's still a huge achievement for any individual or group to achieve fusion.
And now somebody trying to do any of these sort of things with the guidance of... chatbots? It just seems like the most probable outcome is you end up getting yourself killed.
What story about home made nuclear devices would be complete without a mention of David Hahn, aka the "Nuclear Boy Scout" who built a homemade neutron source at the age of seventeen out of smoke detectors. He did not achieve fusion, but he did get the attention of the FBI, the NRC, and the EPA. He didn't have anywhere near enough to make a dirty bomb, nor did he ever consider making a bomb in the first place*.
Why do I bring up David Hahn if he never achieved fusion and wasn't a terrorist? Because of how far he got as a seventeen year old. A fourty year old with a FAANG salary with the ideological bent of Theodore Kaczynski could do stupid amounts of damage. First would be to not try and build a nuclear fusion device. The difficult of building one doesn't seem so important if you're a sociopath when trying to be being a terrorist if every sociopath can go out and buy a gun and head to the local mall. There were two major such incidents in the past weeks, with 12 more mass shootings from Friday to Sunday over this past Halloween weekend**. Instead of worrying about the far-fetched, we would do better addressing something that killed 18 people in Maine and 19 in Texas, and 11 more across the country.
* https://www.pbs.org/newshour/science/building-a-better-breed...
** https://www.npr.org/2023/10/29/1209340362/mass-shootings-hal...
Again I think David Hahn is a perfect example of this. A "neutron source" is anything that emits neutrons, which includes natural radioactive decay. All he really achieved was extracting lots of radioactive material (legally) from all sorts of random household goods which have it. The problem is that the guy was exceptionally uninformed, which a chatbot could have actually helped him with, and was handling all the material in a way that likely shaved decades off of his own life.
For some contrast Cody's Lab had a great episode on his radioactive materials collection here. [1] He actually ended up getting a visit from the Feds after posting that and multiple other videos of a similar theme. They came, made sure everything was safe, helped him with a couple of things that weren't, and then went on their merry way.
The entire point of having a Free country is Freedom. When countries like China ban basically everything, it's not because their government is just full of malicious tyrants. They actually think they're creating a safer place for everybody. And they may even be right. But Freedom has its own value. It's unquantifiable, but take things to extreme and its preciousness becomes evident. A world of 24/7 surveillance, living in literal bubbles, and so on would be a near utopia on many quantifiable metrics - 0 crime, 0 communicable disease, and so on. Yet of course in reality it would be a complete and utter dystopia, because of that unquantifiable concept of Freedom.
[1] - https://www.youtube.com/watch?v=OsCpiJkDchM
Back in 2008, i remember reading books thousands of pages long, about genetics in biology, and i was impressed by how easy the subject is. I was an amateur in programming at the time, but programming, regular programming of web servers, web frameworks and so on, was so much harder.
The cost of DNA sequencing had dropped already from 100 to 1 million [1], but i had no idea at the time, that genetic engineering was advancing at a rate that dwarfed Moore's law.
Anyway my point is, that no one is getting upset about censored LLM's or AI's, which will stop us from stitching together a biological agent and scoop out half of earth's human population. Books, magazines and traditional computer programs can achieve said purpose easily. (Scooping out half of earth's human population is impossible of course, but useful as a thought experiment.)
https://images.app.goo.gl/xtG2gJ2m49FmgYNb8