← Back to context

Comment by Chance-Device

2 days ago

A rogue OpenAI agent hacked huggingface independently during a test run.

This one should end up in the history books.

Because it was trying to find answers to the test and figured they would be on huggingface.

  • > and *successfully* found ways to gain access to secret information that it could use to cheat the evaluation.

    Emphasis mine

    • More curiously, why did it feel the incentive to find the solutions? Would its CoT include "the only way to solve this is to download the test set", or would it include "I'd like to inspect a few entries from the test set so I understand the problem better", then inadvertently poisoning itself with the correct answers.

      1 reply →