Comment by crossroadsguy

Yes and this is what worries me.. the not yet part.

> AI doesn't yet improve on it's own

I mean when that day arrives and that aspect of AI is not controlled from now it will be quite unfortuante for most of the humanity (and let's just assume here we are not wiped out by AI; or not even mention that).

Think of nuclear technology. Is it smarter than us or something on those lines? the answer is it doens't matter. What matters is whoever weilds this power and then limited/restricted others (this was a good thing and a bad thing because some had – at the same time) from having that power essentially had a controlling upper hand on a whole lot of humanity.

AI is something like that with a big difference that it is essentially on the way to "replace" our usefulness, our professional relevance if I can say that. We can go about long spirals of "but soemthing else" will turn up, just like we can keep going about what if nuclear tech didn't even happen, wasn't invented, or what if it was done in such a controlled manner that only it's energy and other need was possible to harness (no pun intended!). It happened and this is how it happened. That's exacty what is happening with AI.

In the hands of few. Extremely powerful. Even if there are open models, running the bigger and better ones are simply out of reach for most companies (let alone people). And yes, it is already being weaponised. It's going to be such a weapon of control that nuclear tech won't even compare. Usign nukes to subdue a nation earlier meant also destrying a a lot of shared environment in the process. But with AI and almost exclsuive frontier level weaponised access to it with deployment capabiltiy the damage can be done is such controlled manner and scale that even things like protests will become too hard to do. In fact AI wiping out the humanity is least of my worries.