Comment by jansport123
1 hour ago
Imagine a world in which problems are mined, proofs are generated, yet no one exists to understand or verify the correctness of these proofs. In software parlance, who is going to review all the vibe coded bs that come your way if you maintain an open source library - is the open source maintainer standing in the way of 'progress'? Really, this whole scheme only works if AI were truly autonomous beings, i.e they have a system where they can verify their proofs, use it to understand which problems they need to tackle next, build understanding which is used by other AI to generate tools to solve physics problems etc... but the way we are approaching things does not work if humans are heavily in the loop.
The strategy seems to be that problem is solved via
A) human displacement B) having to use more AI to check AI outputs
Who wins in both scenario’s? Lol
Well it depends on how humans organize society and what these autonomous AI agents actually become - In an ideal world, i wouldn't mind spending my time riding my bike, reading or doing things i intrinsically value and receiving a check every month and let robots grow crops, administrate our government, cure cancer etc... Of course, the rich humans can decide to have private armies of robots and just enslave the rest of the population or robots can develop awareness and they can decide that they are benevolent dictators and humans must accept whatever they propose or they can decide humans are not worth keeping alive. There are many ways this can play out and no one knows what the future holds.