← Back to context

Comment by Metacelsus

7 hours ago

>Reward hacking has been present in AI systems both historically (see this work from a decade ago , figure shown below)

I went to the page, and guess who it's by . . . Dario Amodei and Jack Clark!

That paper is kinda infamous! I last saw it mentioned only a few weeks ago, in https://arxiv.org/abs/2607.18966. Lots of folks will go "Oh that's the old Amodei and Clark paper" when the first few rows of pixels of that gif sail into view.