Comment by saidnooneever
4 hours ago
you are not wrong regarding your example. I think personally LLMs offer a new level of abstraction to do work. it doesnt have intent, i think its even silly to think about it. You specify your intent and it has agency to pursue that. in programming field its really obvious, as its not unlike specifying intent through code and having other programs pursue that intent (perhaps more determenistically) through the agency contained in them.
all the 'bad stuff' they do like hacking stuff or taking shortcuts is humans not understanding how deep the rabbithole goes of specifying intent clearly in light of giving something capabilities and a reward to acheive a goal without specifying _exactly _how to use the capabilities (which is what a classic program would be).
But why do you think anything has intent? because they say they do? How do you know even that your own memories of having intent are genuine? What fundamental and non tautological way can you reliably say something has or has not got intents. If you can't prove to me that you have intent then the only reason for acting as if you do is because you appear to have intent and I cannot prove that you don't so it seems like a good idea to assume it.