Comment by bananaflag
5 hours ago
> I don’t have a solution here, and I’m worried it’s coming to all human fields. So it’s more of an ability to observe what might happen to all of us.
You can also look (as I did back in 2018 when contemplating the end of math) at how chess or Go players adapted mentally to the idea that whatever they may do, a machine could do it better (Lee Sedol famously quit Go).
I think this matters very little. These were adaptations to initial advances of small scope which we are rapidly leaving behind. If there is truly no near and practical ceiling to the abilities of AI in mathematics, not even in terms of efficiency, then I think it is likely there is similarly no ceiling in other cognitive endeavours.
In that case, everything stands to be disrupted and those who wield AI will have massive amounts of power in the short term. But this is not a stable situation, and therefore those who wield AI will have to cede control of it or otherwise enter into a great war with those that do not.
I hope for all our sakes that there is a practical ceiling.