Comment by doctoboggan
8 hours ago
Someone should make the millennium problems for AI alignment so the frontier labs will actually try to solve that problem.
8 hours ago
Someone should make the millennium problems for AI alignment so the frontier labs will actually try to solve that problem.
> Someone should make the millennium problems for AI alignment so the frontier labs will actually try to solve that problem.
Rather: Someone should make the millennium problems for human alignment so the top researchers will actually try to solve that problem. :-)
A group already (sort-of) has for the broader theory: https://arxiv.org/abs/2604.21691
It's a good list, but "alignment" is much more targetted. I attended a workshop with researchers from OpenAI and Anthropic also present, where the objective was to hash out what the problems in alignment even are. This, it turned out, was extraordinarily difficult.
The problems with alignment are to do with how we define and search for this vague notion when it is mathematically ill-posed at present.
The only thing the frontier labs are interested in is their trillion dollar IPOs.
You'd think that believing they are going to destroy humanity would motivate them.
If you ignore what people say and instead observe what they do, the world makes a lot more sense.
They're for-profit corporations above all.
They are human institutions above all. Saying 'we're a corporation' doesn't at all absolve them from human traits, consequences, and responsibilities.
Corporations are really the embodiment of Moloch.
[dead]