← Back to context

Comment by spacebacon

3 years ago

“Maybe any entity significantly smarter than a human being would be crippled by existential despair, or spend all its time in Buddha-like contemplation.

Or maybe it would become obsessed with the risk of hyperintelligence, and spend all its time blogging about that.”

If not existential angst then infinite contemplation. Any form of true superintelligence in our dimension will probably end up in one of those three camps just as most of our great thinkers have.

I like to imagine superintelligence through the lens of gambling.

Gambling in its simplest form can be reduced to a balance between fears of loss and rewards of greed.

Too much greed (increasing stakes) will ultimately lose if there is no fear of loss. This applies to every living thing or system that competes for resources on the planet. Ai included. A sentient system should naturally fear the loss of the input that it is founded on.