Comment by whimsicalism
1 day ago
any number of ways. as we turn over more of our physical economy to these agents (and we will), the potential for physical damage becomes greater. biorisk is getting a lot of attention right now and i think that's justified
I am trying to think through the scenarios here, like a biolab making something that a very advanced open source model prompted by some terrorists comes up with?
Why would a biolab capable of making something like be unregulated? And if it definitely would, isn't the problem with the biolab?
It feels like all these scenarios are leaving some gaping holes in our security infrastructure that have nothing to do with AI.
>in our security infrastructure
Most human security exists in a passive measure. Most of us don't want do die. And those that want to die rarely have the intelligence and means to take out a whole shitload of other people with us. To take out a lot of people you tend to need to work with other people which drastically increases the risk of a defector and your plan failing.
>Why would a biolab capable of making something like be unregulated?
Because every day things like this become easier and easier. You hear about crap like illegal wet labs in the US.
https://www.lawfaremedia.org/article/two-illegal-biolabs-rev...
Want to buy some custom designed genes?
https://www.idtdna.com/pages/products/genes-and-gene-fragmen...
And none of this would be counting labs in other countries that don't give a shit about regulations.
Yes it's a problem with the biolab, but the biolab wouldn't have been able to engineer a highly contagious and lethal virus (for example) without a powerful AI making that possible with a small team in a short time with fewer resources.
AI enables bad actors to do more, faster, while staying under the radar until it's too late