Comment by gb2d_hn
2 months ago
'roll down hill' is a good way of putting it. They don't have 'will', but that's as we want it I think. I think alignment is harder if they develop will. Without will they are still tools that feel like an exoskeleton rather than something that will control us.
Agents have a state which will unfold as a plan, especially in planning mode. Why not call this 'will'?
I think because without the initial prompt, they are only interpreting our will, and do not act under their own volition.