Comment by short_sells_poo

And one day AI might use this complex math to eradicate humans and you will still be "it's all completely fine"?

The fundamental argument boils down to: "who is all this being made for"? And the answer should be "us, humans". A lot of people here seem to breathlessly fawn over AI as some sort of value in itself, but this is incorrect. There is no absolute value in the universe (as far as we know), the only value to us as humans is subjective.

If AI is not generating value for humans, it isn't generating value, full stop.

Hence the question: "what's the point if we can't understand it?" is perfectly valid and should be discussed. The broader question of "what's the point of AI if not for improving human lives" gets lost in breathless adoration of a technology where nobody knows the outcome.

I'm not saying we need to abandon the pursuit of AI, but we must ask difficult questions at every step because if the technology ends up being as ground-breaking as many here think, it could just as well precipitate a dystopia.