Comment by btilly

Perhaps reading https://www.math.toronto.edu/mccann/199/thurston.pdf will help.

The point of mathematics is not to prove results. It is to build conceptual thinking about mathematics. Important problems are important because in order to solve them we have to build concepts tying different things together.

We're not searching for answers. We're searching for insights. Trying to understand the problem causes us to draw the connections and find those insights.

AI gives us answers. But it doesn't help us build those insights. AI has a complete mastery of existing human insights. But doesn't build new ones from its own experience. In a real way, it does not find the opportunity to really learn.

So it tackles problems and either solves them or not. If solved, we now have an answer. If not, it's too hard for humans.