Comment by eliemichel

24 days ago

The post notes that an important number of novels include an "AI allegory", as if the AI would implicitly write about its own condition. It is understandable that this comes from system prompts and RLHF that specializes these agents, but I am surprised that there is not more discussion about harnesses: the very same core model could lead to very different results depending on how we hand it the pen the write the story. In particular, I believe that it would help circumvent this bias to ask the agent to tell the story of somebody else writing a story, or something like this. This whole contest could be at least as much about harness engineering than about prompt engineering imho.

Certainly. There's a lot more that could be done and many good research questions here, that I hope there will be followups on, and people running their own better contests. Maybe it could be you! (There may or may not be an official Unslop 2 trying to improve on Unslop 1. I think Hyperstition/Silverbook don't have the money right now to run an Unslop 2, and I have my own projects.)