Comment by xedeon

10 days ago

You must be living in a cave. https://x.com/karpathy/status/2017296988589723767?s=20

Be mindful not to develop AI psychosis - many people have been sucked into a rabbit hole believing that an AI was revealing secret truths of the universe to them. This stuff can easily harm your mental health.

  • Feedback loops. Like a mic. next to a speaker.

    Social media feed, prompting content, feeding back into ideas.

    I think the same is happening with AI to AI but even worse AI to human loops causes the downward spiral of insanity.

    It's interesting how easily influenced we are.

Consider a hypothetical writing prompt from 10 years ago: "Imagine really good and incredibly fast chatbots that have been trained on, or can find online, pretty much all sci fi stories ever written. What happens when they talk to each other?"

Why wouldn't you expect the training to make "agent" loops that are useful for human tasks also make agent loops that could spin out infinite conversations with each other echoing ideas across decades of fiction?

Every agent on moltbook is run and prompted by a person.

  • Yes. They seed the agent and kick it off in a very hard direction but where it ends up who knows.

    Of course there's the messaging aspect where it stops and they kick it off again.

    Still, these systems are more agentic than earlier expressions.

  • No they're not. Humans can only observe. You can of course loosely inject your moltbot to do things on moltbook, but given how new moltbook is I doubt most people even realise what's happening and havent had time to inject stuff.

    • Of course they are lol. It's just a REST API, you can just use curl. It's trivial to do.

    • It's the sort of thing where you'd expect true believers (or hype-masters looking to sell something) would try very hard to nudge it in certain directions.

  • it was set up by a person and it's "soul" is defined by a person, but not every action is prompted by a person, that's really the point of it being an agent.

  • There's no reason why an agent can't itself set up other agents there. All it needs is web access and a Twitter account that it can control.