Comment by thesz

  > all were able to find every problem planted there, with fairly little steering, and no spoilers.

Given that LLMs prefer output of LLMs (of the same LLM and of others) [1], can it be the case that they generate "hard challenges" from the manifold of challenges solvable by (other) LLMs?

[1] https://arxiv.org/abs/2404.13076