Comment by gwern

Who will be the first AI-first company to close the loop with autonomous coding bots, and create self-fulfilling prophecies where a customer support bot hallucinates a policy like OP, it gets stored in the Q&A/documentation retrieval database, and the autonomous bots implement and roll out the policy and lock out all the users (and maybe the original human developers as well)?