Comment by overgard
1 day ago
I just can't help but imagine ChatGPT's sycophancy mixed with military operations. "Sharp insight bombing that wedding! Next would you like tips on mosques to bomb, or I can suggest some new napalm recipes that are extra spicey. Your call!"
Department of Defense: You just bombed the wrong Georgia! The people of Atlanta are furious!
ChatGPT: You're absolutely right, and you're right to call that out. Upon examination it does appear that there might have been a mistake with the coordinates of the bomb. Let's try again, this time we will double check before we launch any missiles! :missile emoji:
You forgot "I will take full responsibility"
:checkmark: :checkmark:
Not enough emdashes!
[flagged]
That’s not actually the name of that department. That requires an act of congress.
You can call it what you’d like but I’ll stick with the official name instead of the words of the lolcow we decided to make president.
If Antrophic would have given in, I would have imagined the dialogs something like in claude CLI:
To complete the mission the war terminal needs to hit a target at XY:
1. yes
2. yes (and don't ask again for strike targets in this session)
3. no
Human in the loop is the term here I think.
(I am really glad they did not give in, but I do assume this is what it will come to anyway)
The point is it will be autonomous, the prompt could just be 'keep me safe' which will be interpreted who knows how and presumably no further prompting.
Autonomous just means this narrative is what you’d see if you looked at the logs of the drone talking to itself in it’s head…?
This is giving me strong Dark Star vibes with the intelligent bomb forcing a philosophical discussion about existence and perception at the end.
(Spoilers for the ending of the movie: https://youtu.be/h73PsFKtIck?si=tTm9TidmEMBHsXq1 )
Assuming it's not smart enough to write logs that make it less likely to be prosecuted/ disabled by coming up with fake reasons.
It can just say you were a terrorist because you were an adult male traveling with something in your hands. Humans already do this to justify strikes, likely the AI would do the same.
1 reply →
https://www.youtube.com/watch?v=EYvrziE4feI
Don't forget to add no melting ghost babies to that prompt!
https://youtu.be/EYvrziE4feI?si=_CxjOQ3AaTMuwNXj
I think I can guess what training data it used for the wedding droning idea!
reminds me of the lazy gun in against a dark background!