← Back to context

Comment by sometimelurker

24 days ago

Do you believe that an AI can write persuasive text? Do you believe that an AI can be trained to elicit a specific user reaction?* Can we agree that AI companies are strongly incentivized to make money, and they can do so by making their systems addictive? Because AI psychosis can be a byproduct of that.

*Il outline how briefly: mutate the model 500 times, give 1/500 of your user base a mutated version of the model, and save the top 5 of these model, ranked by how often the users did something, over the course of a week. Repeat for a year, passing the top 1% of these models onto the next round. This is the simplest way to do this and I can think of better ways to do this. I don't even work on this sorta thing; its 100% obvious to the AI labs how to do this better