Comment by bretpiatt
2 hours ago
From what I'm experiencing, we have recursive self improvement that can find local maxima, I'm not seeing really strong evidence of unguided RSI that finds the true optimal.
2 hours ago
From what I'm experiencing, we have recursive self improvement that can find local maxima, I'm not seeing really strong evidence of unguided RSI that finds the true optimal.
You don't expect to find the global maximum. It will just always be there as an elusive target.
I doubt the human brain is at global maximum.
Doesn’t matter if there’s a rechable local maximum that happens to be comfortably beyond human level. Indeed it would be very surprising if a thing capable of RSI just happened to get stuck at human level or slightly above or below, even though its constraints are entirely different from those evolution had to work with when it created us!
I doubt that any algorithms would be able to find a global maximum in such a large multidimensional non-convex space
> true optimal
True optimal what? Optimal intelligence? What would that be?