Comment by fleventynine
4 hours ago
I don't think society has enough power to control what billionaires spend their money on. The promise of AI is such an attractive nuisance for power seekers that trying to crack down on it will just force it underground, where it will be developed with even less care and oversight than it is now.
Our institutions aren't even able to control what dirt-poor pirates do on hardware they own. How in the heck are they going to be able to control what incomprehensibly-rich people do? They can purchase political favors from whichever nations are selling them.
> trying to crack down on it will just force it underground, where it will be developed with even less care and oversight than it is now.
With way less access to infrastructure, hardware, capital, people. That’s literally what we need, it should be constrained by having way less resources
Having fewer resources such as security engineers will not lead to better outcomes. A skeleton team with gigawatts of compute in some middle east bunker is MORE likely to unleash something poorly aligned.
Gigawatt of power doesn’t come from nowhere. You cannot have that much power consumption without being visible to regulators (of course that assumes a government that isn’t as corrupt as the US).
You can create bioweapons today, from a small lab. Doesn’t mean we allow it
Advancing the state of the art takes so many resources that it can't happen underground, at least for now. Slap enough controls on the means and the handbrakes are on. So your doomsday scenario could be preventable. The crux is that enough people need to come out in favor to put constraints in place. It's not impossible, but public opinions form slowly.